A Human–Computer Interface Replacing Mouse and Keyboard for Individuals with Limited Upper Limb Mobility
People with physical disabilities in their upper extremities face serious issues in using classical input devices due to lacking movement possibilities and precision. This article suggests an alternative input concept and presents corresponding input devices. The proposed interface combines an inert...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2020-11-01
|
| Series: | Multimodal Technologies and Interaction |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2414-4088/4/4/84 |
| _version_ | 1797546523608743936 |
|---|---|
| author | Diyar Gür Niklas Schäfer Mario Kupnik Philipp Beckerle |
| author_facet | Diyar Gür Niklas Schäfer Mario Kupnik Philipp Beckerle |
| author_sort | Diyar Gür |
| collection | DOAJ |
| description | People with physical disabilities in their upper extremities face serious issues in using classical input devices due to lacking movement possibilities and precision. This article suggests an alternative input concept and presents corresponding input devices. The proposed interface combines an inertial measurement unit and force sensing resistors, which can replace mouse and keyboard. Head motions are mapped to mouse pointer positions, while mouse button actions are triggered by contracting mastication muscles. The contact pressures of each fingertip are acquired to replace the conventional keyboard. To allow for complex text entry, the sensory concept is complemented by an ambiguous keyboard layout with ten keys. The related word prediction function provides disambiguation at word level. Haptic feedback is provided to users corresponding to their virtual keystrokes for enhanced closed-loop interactions. This alternative input system enables text input as well as the emulation of a two-button mouse. |
| first_indexed | 2024-03-10T14:31:00Z |
| format | Article |
| id | doaj.art-4f59c7bdd68a4680b9e3acaf00a2eb39 |
| institution | Directory Open Access Journal |
| issn | 2414-4088 |
| language | English |
| last_indexed | 2024-03-10T14:31:00Z |
| publishDate | 2020-11-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Multimodal Technologies and Interaction |
| spelling | doaj.art-4f59c7bdd68a4680b9e3acaf00a2eb392023-11-20T22:33:03ZengMDPI AGMultimodal Technologies and Interaction2414-40882020-11-01448410.3390/mti4040084A Human–Computer Interface Replacing Mouse and Keyboard for Individuals with Limited Upper Limb MobilityDiyar Gür0Niklas Schäfer1Mario Kupnik2Philipp Beckerle3Department of Electrical Engineering and Information Technology, Technical University of Darmstadt, 64283 Darmstadt, GermanyMeasurement and Sensor Technology, Department of Electrical Engineering and Information Technology, Technical University of Darmstadt, 64283 Darmstadt, GermanyMeasurement and Sensor Technology, Department of Electrical Engineering and Information Technology, Technical University of Darmstadt, 64283 Darmstadt, GermanyElastic Lightweight Robotics Group, Robotics Research Institute, Department of Electrical Engineering and Information Technology, Technische Universität Dortmund, 44227 Dortmund, GermanyPeople with physical disabilities in their upper extremities face serious issues in using classical input devices due to lacking movement possibilities and precision. This article suggests an alternative input concept and presents corresponding input devices. The proposed interface combines an inertial measurement unit and force sensing resistors, which can replace mouse and keyboard. Head motions are mapped to mouse pointer positions, while mouse button actions are triggered by contracting mastication muscles. The contact pressures of each fingertip are acquired to replace the conventional keyboard. To allow for complex text entry, the sensory concept is complemented by an ambiguous keyboard layout with ten keys. The related word prediction function provides disambiguation at word level. Haptic feedback is provided to users corresponding to their virtual keystrokes for enhanced closed-loop interactions. This alternative input system enables text input as well as the emulation of a two-button mouse.https://www.mdpi.com/2414-4088/4/4/84assistive technologyalternative input devicekeyboard replacementhands-free mousevibrotactile feedback |
| spellingShingle | Diyar Gür Niklas Schäfer Mario Kupnik Philipp Beckerle A Human–Computer Interface Replacing Mouse and Keyboard for Individuals with Limited Upper Limb Mobility Multimodal Technologies and Interaction assistive technology alternative input device keyboard replacement hands-free mouse vibrotactile feedback |
| title | A Human–Computer Interface Replacing Mouse and Keyboard for Individuals with Limited Upper Limb Mobility |
| title_full | A Human–Computer Interface Replacing Mouse and Keyboard for Individuals with Limited Upper Limb Mobility |
| title_fullStr | A Human–Computer Interface Replacing Mouse and Keyboard for Individuals with Limited Upper Limb Mobility |
| title_full_unstemmed | A Human–Computer Interface Replacing Mouse and Keyboard for Individuals with Limited Upper Limb Mobility |
| title_short | A Human–Computer Interface Replacing Mouse and Keyboard for Individuals with Limited Upper Limb Mobility |
| title_sort | human computer interface replacing mouse and keyboard for individuals with limited upper limb mobility |
| topic | assistive technology alternative input device keyboard replacement hands-free mouse vibrotactile feedback |
| url | https://www.mdpi.com/2414-4088/4/4/84 |
| work_keys_str_mv | AT diyargur ahumancomputerinterfacereplacingmouseandkeyboardforindividualswithlimitedupperlimbmobility AT niklasschafer ahumancomputerinterfacereplacingmouseandkeyboardforindividualswithlimitedupperlimbmobility AT mariokupnik ahumancomputerinterfacereplacingmouseandkeyboardforindividualswithlimitedupperlimbmobility AT philippbeckerle ahumancomputerinterfacereplacingmouseandkeyboardforindividualswithlimitedupperlimbmobility AT diyargur humancomputerinterfacereplacingmouseandkeyboardforindividualswithlimitedupperlimbmobility AT niklasschafer humancomputerinterfacereplacingmouseandkeyboardforindividualswithlimitedupperlimbmobility AT mariokupnik humancomputerinterfacereplacingmouseandkeyboardforindividualswithlimitedupperlimbmobility AT philippbeckerle humancomputerinterfacereplacingmouseandkeyboardforindividualswithlimitedupperlimbmobility |