Skip to content

This Project is create a vision-based, automatically controlled prosthetic hand.

Notifications You must be signed in to change notification settings

devsangho/Control-of-Prosthetic-Hand-with-6D-Pose-Estimation

Repository files navigation

Control of Prosthetic Hand with 6D Pose Estimation

demo2 demo1

Motivation

When gripping an object, the axial rotation responsible for internal and external electrical conduction is the most important of the three degrees of freedom of the wrist. This is because, if it is impossible to rotate, it can be compensated by other movements of the arm and body, causing pain, discomfort, and secondary osteomyuscular diseases.

However, conventional prosthetic limbs have inconveniences in controlling the wrist or hand. Because you have to operate your wrist or hand one at a time using a dual control method that controls things with the same muscle.

figure


In this project, we conduct a study to control the rotation of the prosthetic wrist in consideration of the object's Pose and its surroundings.

  1. Adjust the angle of the prosthetic hand's wrist to the tilt of the object using images obtained from the human viewing angle.
  2. It determines the situation in which the goods are handed over and controls them to respond flexibly.

This project uses Objectron, Hand Landmakrs Detection Model and eEMG Model to control prosthetic hand to pick up and receive objects.

More Information


Installation

pip install -r requirements.txt

Run

python main.py

Maintainers

Team

About

This Project is create a vision-based, automatically controlled prosthetic hand.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published