Nowadays, most of the functional relationships between brain signals and the corresponding complex hand/fingers movements (cause, effect, feedback) are not yet completely understood. In the last years it has been assisted to important advances in Brain Computer Interfaces (BCI), computer vision (CV)-based tracking systems and Robots, especially due to: hardware improvements and miniaturization; increasing pursuit of intelligent and real time tracking systems; fast design, prototyping and production of consumer robots facilitated by 3D printing technologies. We present an integrated system composed by a BCI, a CV-based hand tracking system and a motorized robotic arm reproducing the hand and the forearm of a person (scale 1:1). The proposal is to synchronize and to monitor the brain activity during complex hand and fingers movements (interpreted and reproduced in real time on a numerical hand model by the tracking system). Further, we aim at recognizing the brain signals which give rise to specific movements and, finally, at using them for producing the corresponding movements on the robotic arm. Different scenarios and potential use-cases are reported and their usefulness discussed.

Integration of a BCI with a Hand Tracking System and a Motorized Robotic Arm to Improve Decoding of Brain Signals Related to Hand and Finger Movements

Placidi G.
;
De Gasperis G.;Mignosi F.;Polsinelli M.;Spezialetti M.
2021

Abstract

Nowadays, most of the functional relationships between brain signals and the corresponding complex hand/fingers movements (cause, effect, feedback) are not yet completely understood. In the last years it has been assisted to important advances in Brain Computer Interfaces (BCI), computer vision (CV)-based tracking systems and Robots, especially due to: hardware improvements and miniaturization; increasing pursuit of intelligent and real time tracking systems; fast design, prototyping and production of consumer robots facilitated by 3D printing technologies. We present an integrated system composed by a BCI, a CV-based hand tracking system and a motorized robotic arm reproducing the hand and the forearm of a person (scale 1:1). The proposal is to synchronize and to monitor the brain activity during complex hand and fingers movements (interpreted and reproduced in real time on a numerical hand model by the tracking system). Further, we aim at recognizing the brain signals which give rise to specific movements and, finally, at using them for producing the corresponding movements on the robotic arm. Different scenarios and potential use-cases are reported and their usefulness discussed.
File in questo prodotto:
File Dimensione Formato  
Placidi2021_Chapter_IntegrationOfABCIWithAHandTrac.pdf

solo utenti autorizzati

Descrizione: Scaricato dal sito dell'Editore. L'università ha accesso.
Tipologia: Documento in Versione Editoriale
Licenza: Creative commons
Dimensione 2.15 MB
Formato Adobe PDF
2.15 MB Adobe PDF   Visualizza/Apri   Richiedi una copia

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: http://hdl.handle.net/11697/180794
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 0
  • ???jsp.display-item.citation.isi??? ND
social impact