Real Time Object Detection with Noisy Sensors Using Deep Learning
In this paper, we introduce a first of its kind, radio-signal based object detection system for controlled environments, which substitutes complex signal processing and expensive hardware with deep learning networks to detect patterns from low-quality, inexpensive sensors. Our system operates in the...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IFSA Publishing, S.L.
2021-02-01
|
| Series: | Sensors & Transducers |
| Subjects: | |
| Online Access: | https://sensorsportal.com/HTML/DIGEST/february_2021/Vol_249/P_3203.pdf |
| _version_ | 1797752223227183104 |
|---|---|
| author | Aditya Singh Pratyush Kumar Vedansh Priyadarshi Yash More |
| author_facet | Aditya Singh Pratyush Kumar Vedansh Priyadarshi Yash More |
| author_sort | Aditya Singh |
| collection | DOAJ |
| description | In this paper, we introduce a first of its kind, radio-signal based object detection system for controlled environments, which substitutes complex signal processing and expensive hardware with deep learning networks to detect patterns from low-quality, inexpensive sensors. Our system operates in the less crowded low- frequency range of 433 MHz in contrast to existing RF-based sensing methods and uses mini-Doppler maps generated from raw I/Q data, thereby allowing us to use cheap, off-the-shelf software defined radios. We demonstrate that our system is versatile enough to handle occlusions and is also sensitive to multiple objects; additionally, it does not use visual data and hence is not hampered by bad lighting. The core of our system is a VGG-16 based CNN architecture trained on the mini-Doppler maps. We achieve an accuracy of 0.96 on a binary classification task of detecting the presence or absence of an object in an enclosed space. Furthermore, we observe that our system shows promise for more complicated detection algorithms as it is able to successfully differentiate between the presence of a single object and two identical objects placed together. Our results indicate that convolutional networks can learn features important enough from spectrograms that enable it to distinguish the presence of objects, thereby eliminating the need of sophisticated signal processing methods to do the same. |
| first_indexed | 2024-03-12T17:01:13Z |
| format | Article |
| id | doaj.art-c71c8fbd8e274366a2c130c57e9f71cc |
| institution | Directory Open Access Journal |
| issn | 2306-8515 1726-5479 |
| language | English |
| last_indexed | 2024-03-12T17:01:13Z |
| publishDate | 2021-02-01 |
| publisher | IFSA Publishing, S.L. |
| record_format | Article |
| series | Sensors & Transducers |
| spelling | doaj.art-c71c8fbd8e274366a2c130c57e9f71cc2023-08-07T13:45:06ZengIFSA Publishing, S.L.Sensors & Transducers2306-85151726-54792021-02-0124921724Real Time Object Detection with Noisy Sensors Using Deep LearningAditya Singh0Pratyush Kumar1Vedansh Priyadarshi2Yash More3 Ashoka University Ashoka University Ashoka University Ashoka UniversityIn this paper, we introduce a first of its kind, radio-signal based object detection system for controlled environments, which substitutes complex signal processing and expensive hardware with deep learning networks to detect patterns from low-quality, inexpensive sensors. Our system operates in the less crowded low- frequency range of 433 MHz in contrast to existing RF-based sensing methods and uses mini-Doppler maps generated from raw I/Q data, thereby allowing us to use cheap, off-the-shelf software defined radios. We demonstrate that our system is versatile enough to handle occlusions and is also sensitive to multiple objects; additionally, it does not use visual data and hence is not hampered by bad lighting. The core of our system is a VGG-16 based CNN architecture trained on the mini-Doppler maps. We achieve an accuracy of 0.96 on a binary classification task of detecting the presence or absence of an object in an enclosed space. Furthermore, we observe that our system shows promise for more complicated detection algorithms as it is able to successfully differentiate between the presence of a single object and two identical objects placed together. Our results indicate that convolutional networks can learn features important enough from spectrograms that enable it to distinguish the presence of objects, thereby eliminating the need of sophisticated signal processing methods to do the same.https://sensorsportal.com/HTML/DIGEST/february_2021/Vol_249/P_3203.pdfdeep learningcnnobject detectionsoftware defined radio (sdr) |
| spellingShingle | Aditya Singh Pratyush Kumar Vedansh Priyadarshi Yash More Real Time Object Detection with Noisy Sensors Using Deep Learning Sensors & Transducers deep learning cnn object detection software defined radio (sdr) |
| title | Real Time Object Detection with Noisy Sensors Using Deep Learning |
| title_full | Real Time Object Detection with Noisy Sensors Using Deep Learning |
| title_fullStr | Real Time Object Detection with Noisy Sensors Using Deep Learning |
| title_full_unstemmed | Real Time Object Detection with Noisy Sensors Using Deep Learning |
| title_short | Real Time Object Detection with Noisy Sensors Using Deep Learning |
| title_sort | real time object detection with noisy sensors using deep learning |
| topic | deep learning cnn object detection software defined radio (sdr) |
| url | https://sensorsportal.com/HTML/DIGEST/february_2021/Vol_249/P_3203.pdf |
| work_keys_str_mv | AT adityasingh realtimeobjectdetectionwithnoisysensorsusingdeeplearning AT pratyushkumar realtimeobjectdetectionwithnoisysensorsusingdeeplearning AT vedanshpriyadarshi realtimeobjectdetectionwithnoisysensorsusingdeeplearning AT yashmore realtimeobjectdetectionwithnoisysensorsusingdeeplearning |