Digital Theremin with computer vision
This study presents the methodology and development of a digital Theremin using MediaPipe to enable gesture-based controls for pitch, volume, and vibrato. Through a comprehensive user study, the project evaluated the intuitiveness of the gesture-based controls and the produced sound quality with...
| Main Author: | |
|---|---|
| Other Authors: | |
| Format: | Final Year Project (FYP) |
| Language: | English |
| Published: |
Nanyang Technological University
2024
|
| Subjects: | |
| Online Access: | https://hdl.handle.net/10356/175253 |
| _version_ | 1811696772792188928 |
|---|---|
| author | Chua, Ryuichi |
| author2 | Goh Wooi Boon |
| author_facet | Goh Wooi Boon Chua, Ryuichi |
| author_sort | Chua, Ryuichi |
| collection | NTU |
| description | This study presents the methodology and development of a digital Theremin using
MediaPipe to enable gesture-based controls for pitch, volume, and vibrato. Through a
comprehensive user study, the project evaluated the intuitiveness of the gesture-based
controls and the produced sound quality with PyAudio. The digital Theremin was generally
well-received, with participants demonstrating high controllability and showing a strong
preference for a particular sound version noted for its warmth and expressiveness. Challenges
identified include weak detection at screen edges and precise note-playing. Future work
includes enhancing responsiveness and gesture recognition accuracy to expand the digital
Theremin's appeal. Additionally, future work can investigate leveraging hand gestures in
Unity development |
| first_indexed | 2024-10-01T07:44:41Z |
| format | Final Year Project (FYP) |
| id | ntu-10356/175253 |
| institution | Nanyang Technological University |
| language | English |
| last_indexed | 2024-10-01T07:44:41Z |
| publishDate | 2024 |
| publisher | Nanyang Technological University |
| record_format | dspace |
| spelling | ntu-10356/1752532024-04-26T15:41:17Z Digital Theremin with computer vision Chua, Ryuichi Goh Wooi Boon School of Computer Science and Engineering ASWBGOH@ntu.edu.sg Computer and Information Science Computer vision Human computer interaction Mediapipe Theremin This study presents the methodology and development of a digital Theremin using MediaPipe to enable gesture-based controls for pitch, volume, and vibrato. Through a comprehensive user study, the project evaluated the intuitiveness of the gesture-based controls and the produced sound quality with PyAudio. The digital Theremin was generally well-received, with participants demonstrating high controllability and showing a strong preference for a particular sound version noted for its warmth and expressiveness. Challenges identified include weak detection at screen edges and precise note-playing. Future work includes enhancing responsiveness and gesture recognition accuracy to expand the digital Theremin's appeal. Additionally, future work can investigate leveraging hand gestures in Unity development Bachelor's degree 2024-04-23T01:44:47Z 2024-04-23T01:44:47Z 2024 Final Year Project (FYP) Chua, R. (2024). Digital Theremin with computer vision. Final Year Project (FYP), Nanyang Technological University, Singapore. https://hdl.handle.net/10356/175253 https://hdl.handle.net/10356/175253 en application/pdf Nanyang Technological University |
| spellingShingle | Computer and Information Science Computer vision Human computer interaction Mediapipe Theremin Chua, Ryuichi Digital Theremin with computer vision |
| title | Digital Theremin with computer vision |
| title_full | Digital Theremin with computer vision |
| title_fullStr | Digital Theremin with computer vision |
| title_full_unstemmed | Digital Theremin with computer vision |
| title_short | Digital Theremin with computer vision |
| title_sort | digital theremin with computer vision |
| topic | Computer and Information Science Computer vision Human computer interaction Mediapipe Theremin |
| url | https://hdl.handle.net/10356/175253 |
| work_keys_str_mv | AT chuaryuichi digitalthereminwithcomputervision |