EMI Spy: Harnessing electromagnetic interference for low-cost, rapid prototyping of proxemic interaction
We present a wearable system that uses ambient electromagnetic interference (EMI) as a signature to identify electronic devices and support proxemic interaction. We designed a low cost tool, called EMI Spy, and a software environment for rapid deployment and evaluation of ambient EMI-based interacti...
| Main Authors: | , , , , |
|---|---|
| Other Authors: | |
| Format: | Article |
| Language: | en_US |
| Published: |
Institute of Electrical and Electronics Engineers (IEEE)
2016
|
| Online Access: | http://hdl.handle.net/1721.1/103785 https://orcid.org/0000-0003-2810-5878 https://orcid.org/0000-0001-7524-1106 https://orcid.org/0000-0003-4417-649X https://orcid.org/0000-0002-0719-7104 |
| _version_ | 1826204952105582592 |
|---|---|
| author | Zhao, Nan Dublon, Gershon Gillian, Nicholas Dementyev, Artem Paradiso, Joseph A. |
| author2 | Massachusetts Institute of Technology. Media Laboratory |
| author_facet | Massachusetts Institute of Technology. Media Laboratory Zhao, Nan Dublon, Gershon Gillian, Nicholas Dementyev, Artem Paradiso, Joseph A. |
| author_sort | Zhao, Nan |
| collection | MIT |
| description | We present a wearable system that uses ambient electromagnetic interference (EMI) as a signature to identify electronic devices and support proxemic interaction. We designed a low cost tool, called EMI Spy, and a software environment for rapid deployment and evaluation of ambient EMI-based interactive infrastructure. EMI Spy captures electromagnetic interference and delivers the signal to a user's mobile device or PC through either the device's wired audio input or wirelessly using Bluetooth. The wireless version can be worn on the wrist, communicating with the user;s mobile device in their pocket. Users are able to train the system in less than 1 second to uniquely identify displays in a 2-m radius around them, as well as to detect pointing at a distance and touching gestures on the displays in real-time. The combination of a low cost EMI logger and an open source machine learning tool kit allows developers to quickly prototype proxemic, touch-to-connect, and gestural interaction. We demonstrate the feasibility of mobile, EMI-based device and gesture recognition with preliminary user studies in 3 scenarios, achieving 96% classification accuracy at close range for 6 digital signage displays distributed throughout a building, and 90% accuracy in classifying pointing gestures at neighboring desktop LCD displays. We were able to distinguish 1- and 2-finger touching with perfect accuracy and show indications of a way to determine power consumption of a device via touch. Our system is particularly well-suited to temporary use in a public space, where the sensors could be distributed to support a popup interactive environment anywhere with electronic devices. By designing for low cost, mobile, flexible, and infrastructure-free deployment, we aim to enable a host of new proxemic interfaces to existing appliances and displays. |
| first_indexed | 2024-09-23T13:03:57Z |
| format | Article |
| id | mit-1721.1/103785 |
| institution | Massachusetts Institute of Technology |
| language | en_US |
| last_indexed | 2024-09-23T13:03:57Z |
| publishDate | 2016 |
| publisher | Institute of Electrical and Electronics Engineers (IEEE) |
| record_format | dspace |
| spelling | mit-1721.1/1037852022-10-01T12:53:53Z EMI Spy: Harnessing electromagnetic interference for low-cost, rapid prototyping of proxemic interaction Zhao, Nan Dublon, Gershon Gillian, Nicholas Dementyev, Artem Paradiso, Joseph A. Massachusetts Institute of Technology. Media Laboratory Zhao, Nan Dublon, Gershon Gillian, Nicholas Dementyev, Artem Paradiso, Joseph A. We present a wearable system that uses ambient electromagnetic interference (EMI) as a signature to identify electronic devices and support proxemic interaction. We designed a low cost tool, called EMI Spy, and a software environment for rapid deployment and evaluation of ambient EMI-based interactive infrastructure. EMI Spy captures electromagnetic interference and delivers the signal to a user's mobile device or PC through either the device's wired audio input or wirelessly using Bluetooth. The wireless version can be worn on the wrist, communicating with the user;s mobile device in their pocket. Users are able to train the system in less than 1 second to uniquely identify displays in a 2-m radius around them, as well as to detect pointing at a distance and touching gestures on the displays in real-time. The combination of a low cost EMI logger and an open source machine learning tool kit allows developers to quickly prototype proxemic, touch-to-connect, and gestural interaction. We demonstrate the feasibility of mobile, EMI-based device and gesture recognition with preliminary user studies in 3 scenarios, achieving 96% classification accuracy at close range for 6 digital signage displays distributed throughout a building, and 90% accuracy in classifying pointing gestures at neighboring desktop LCD displays. We were able to distinguish 1- and 2-finger touching with perfect accuracy and show indications of a way to determine power consumption of a device via touch. Our system is particularly well-suited to temporary use in a public space, where the sensors could be distributed to support a popup interactive environment anywhere with electronic devices. By designing for low cost, mobile, flexible, and infrastructure-free deployment, we aim to enable a host of new proxemic interfaces to existing appliances and displays. 2016-07-20T21:03:25Z 2016-07-20T21:03:25Z 2015-06 Article http://purl.org/eprint/type/ConferencePaper 978-1-4673-7201-5 INSPEC Accession Number: 15525176 http://hdl.handle.net/1721.1/103785 Zhao, Nan, Gershon Dublon, Nicholas Gillian, Artem Dementyev, and Joseph A. Paradiso. “EMI Spy: Harnessing Electromagnetic Interference for Low-Cost, Rapid Prototyping of Proxemic Interaction.” 2015 IEEE 12th International Conference on Wearable and Implantable Body Sensor Networks (BSN) (June 2015), Cambridge, MA. pp.1-6. https://orcid.org/0000-0003-2810-5878 https://orcid.org/0000-0001-7524-1106 https://orcid.org/0000-0003-4417-649X https://orcid.org/0000-0002-0719-7104 en_US http://dx.doi.org/10.1109/BSN.2015.7299402 2015 IEEE 12th International Conference on Wearable and Implantable Body Sensor Networks (BSN) Creative Commons Attribution-Noncommercial-Share Alike http://creativecommons.org/licenses/by-nc-sa/4.0/ application/pdf Institute of Electrical and Electronics Engineers (IEEE) MIT web domain |
| spellingShingle | Zhao, Nan Dublon, Gershon Gillian, Nicholas Dementyev, Artem Paradiso, Joseph A. EMI Spy: Harnessing electromagnetic interference for low-cost, rapid prototyping of proxemic interaction |
| title | EMI Spy: Harnessing electromagnetic interference for low-cost, rapid prototyping of proxemic interaction |
| title_full | EMI Spy: Harnessing electromagnetic interference for low-cost, rapid prototyping of proxemic interaction |
| title_fullStr | EMI Spy: Harnessing electromagnetic interference for low-cost, rapid prototyping of proxemic interaction |
| title_full_unstemmed | EMI Spy: Harnessing electromagnetic interference for low-cost, rapid prototyping of proxemic interaction |
| title_short | EMI Spy: Harnessing electromagnetic interference for low-cost, rapid prototyping of proxemic interaction |
| title_sort | emi spy harnessing electromagnetic interference for low cost rapid prototyping of proxemic interaction |
| url | http://hdl.handle.net/1721.1/103785 https://orcid.org/0000-0003-2810-5878 https://orcid.org/0000-0001-7524-1106 https://orcid.org/0000-0003-4417-649X https://orcid.org/0000-0002-0719-7104 |
| work_keys_str_mv | AT zhaonan emispyharnessingelectromagneticinterferenceforlowcostrapidprototypingofproxemicinteraction AT dublongershon emispyharnessingelectromagneticinterferenceforlowcostrapidprototypingofproxemicinteraction AT gilliannicholas emispyharnessingelectromagneticinterferenceforlowcostrapidprototypingofproxemicinteraction AT dementyevartem emispyharnessingelectromagneticinterferenceforlowcostrapidprototypingofproxemicinteraction AT paradisojosepha emispyharnessingelectromagneticinterferenceforlowcostrapidprototypingofproxemicinteraction |