Hand-Finger Pose Estimation Using Inertial Sensors, Magnetic Sensors and a Magnet

Zhicheng Yang*, Shenggang Yan, Bert Jan F. Van Beijnum, Bin Li, Peter H. Veltink

*Corresponding author for this work

Research output: Contribution to journalArticleAcademicpeer-review

1 Citation (Scopus)
47 Downloads (Pure)

Abstract

Hand-finger motion tracking based on inertial and magnetic measurement units (IMMUs) has become a well-accepted method in many applications such as rehabilitation and virtual reality. However, existing systems require an IMMU on each segment of the whole hand and known length of each segment, which is hard to achieve for users. Therefore, we proposed a small sensor configuration with three IMMUs and a magnet to estimate poses of interested fingertips relative to the hand. The relative orientations were estimated by integrating relative angular velocity and fused with relative orientation estimation during time intervals when the whole hand moved or rotated as one object. The relative positions were estimated by using a magnetic dipole model of the magnet and prior estimated relative orientations. The performance has been demonstrated in multiple experiments. For whole hand rotation and functional grasping or writing experiments, the estimated errors of index fingertip position and orientation relative to the hand were 8.09.8 mm and 5.7° 11.2°. For index finger flexion and pinching, the estimated errors of index fingertip position and orientation relative to the hand were 16.225.2 mm and 20.6° 21.7°.

Original languageEnglish
Article number9446090
Pages (from-to)18115-18122
Number of pages8
JournalIEEE sensors journal
Volume21
Issue number16
Early online date3 Jun 2021
DOIs
Publication statusPublished - 15 Aug 2021

Keywords

  • finger poses
  • IMMU
  • Magnetic localization
  • one magnetometer

Fingerprint

Dive into the research topics of 'Hand-Finger Pose Estimation Using Inertial Sensors, Magnetic Sensors and a Magnet'. Together they form a unique fingerprint.

Cite this