Skip to main navigation Skip to search Skip to main content

Human Arm Pose Estimation with a Shoulder-Worn Force-Myography Device for Human-Robot Interaction

  • Rotem Atari
  • , Eran Bamani
  • , Avishai Sintov*
  • *Corresponding author for this work

Research output: Contribution to journal › Article › peer-review

4 Scopus citations

Abstract

Accurate human pose estimation is essential for effective Human-Robot Interaction (HRI). By observing a user's arm movements, robots can respond appropriately, whether it's providing assistance or avoiding collisions. While visual perception offers potential for human pose estimation, it can be hindered by factors like poor lighting or occlusions. Additionally, wearable inertial sensors, though useful, require frequent calibration as they do not provide absolute position information. Force-myography (FMG) is an alternative approach where muscle perturbations are externally measured. It has been used to observe finger movements, but its application to full arm state estimation is unexplored. In this letter, we investigate the use of a wearable FMG device that can observe the state of the human arm for real-time applications of HRI. We propose a Transformer-based model to map FMG measurements from the shoulder of the user to the physical pose of the arm. The model is also shown to be transferable to other users with limited decline in accuracy. Through real-world experiments with a robotic arm, we demonstrate collision avoidance without relying on visual perception.

Original languageEnglish
Pages (from-to)2974-2981
Number of pages8
JournalIEEE Robotics and Automation Letters
Volume10
Issue number3
DOIs
StatePublished - 2025

Funding

FundersFunder number
Israel Science Foundation1565/20

    UN SDGs

    This output contributes to the following UN Sustainable Development Goals (SDGs)

    1. SDG 3 - Good Health and Well-being
      SDG 3 Good Health and Well-being

    Keywords

    • Human detection and tracking
    • human-robot collaboration

    Fingerprint

    Dive into the research topics of 'Human Arm Pose Estimation with a Shoulder-Worn Force-Myography Device for Human-Robot Interaction'. Together they form a unique fingerprint.

    Cite this