MIT researchers channel AI to turn hand gestures into robot training data
In tests with eight volunteers, the wristband mirrored hand gestures in 120 milliseconds and could help robots learn dexterous tasks.
- Researchers at the Massachusetts Institute of Technology developed an ultrasound wristband that captures muscle and tendon movements beneath the skin, relaying images to enable nearby robotic hands to mimic human gestures.
- Humanoid robots struggle with complex grasping tasks because the human hand possesses 22 degrees of freedom—specific ways joints bend or rotate—that remain difficult for machines to replicate.
- The wristband uses high-frequency sound waves to "see" "through its wearer's" skin, with an AI algorithm decoding images into gestures including all 26 letters of American Sign Language.
- Beyond simple remote control, the system provides data for tasks requiring precise finger and hand flexion, including surgery and complex housework.
- MIT professor Xuanhe Zhao aims to imbue artificial intelligence with sensory data from the physical world, enabling humanoid robots to eventually learn dexterous tasks without human guidance.
41 Articles
41 Articles
MIT's ultrasound wristband tracks every finger movement and lets you control a robot hand in real time
Engineers at MIT have built an ultrasound wristband that can track 22 degrees of freedom in the human hand and use that data to control a robotic hand in real time, according to research published in Nature Electronics in March 2026. The device uses a ring of small ultrasound transducers worn around the wrist to […] This story continues at The Next Web
Associated Press News
MIT researchers channel AI to turn hand gestures into robot training data
Humanoid robots struggling with tasks like grasping a cup have a new teacher — a person wearing an ultrasound wristband that captures the movement of muscles, tendons and ligaments beneath the skin.
Humanoid robots who have difficulties with tasks like grabbing a cup have a new teacher: a person who wears an ultrasound bracelet that captures the movement of muscles, tendons and ligaments under the skin.
Coverage Details
Bias Distribution
- 46% of the sources lean Left
Factuality
To view factuality data please Upgrade to Premium
