Mitigating Inaudible Ultrasound Attacks on Voice Assistants With Acoustic Metamaterials

Voice assistants play an important role in facilitating human–machine interactions and have been widely used in audio consumer electronic products. However, it has been shown that they are susceptible to inaudible attacks in which the malicious signals are in the ultrasound regime and can...

Full description

Bibliographic Details
Main Authors: Joshua S. Lloyd, Cole G. Ludwikowski, Cyrus Malik, Chen Shen
Format: Article
Language:English
Published: IEEE 2023-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/10100683/
_version_ 1797844402671976448
author Joshua S. Lloyd
Cole G. Ludwikowski
Cyrus Malik
Chen Shen
author_facet Joshua S. Lloyd
Cole G. Ludwikowski
Cyrus Malik
Chen Shen
author_sort Joshua S. Lloyd
collection DOAJ
description Voice assistants play an important role in facilitating human–machine interactions and have been widely used in audio consumer electronic products. However, it has been shown that they are susceptible to inaudible attacks in which the malicious signals are in the ultrasound regime and cannot be heard by human ears. In this study, we show that a judiciously designed acoustic metamaterial filter can mitigate such attacks by modulating the received signals by the microphones. The metamaterial filter is composed of rigid plates with individual holes which exhibit local resonance phenomena that suppress incoming waves at specific frequencies. The effectiveness of the metamaterial filter is confirmed by experiments that show a combination of the holes can collectively distort the attack signals and protect the smart speakers. Moreover, normal audible signals are not affected by the proposed metamaterial, which adds to the flexibility of the device. The metamaterial filter has a small footprint and can be easily installed on various audio products. Our proposed strategy expands the capacity of acoustic metamaterials and improves the security of devices that use voice assistants.
first_indexed 2024-04-09T17:21:14Z
format Article
id doaj.art-122ee51dd6ff4ac78e5b41216df0412f
institution Directory Open Access Journal
issn 2169-3536
language English
last_indexed 2024-04-09T17:21:14Z
publishDate 2023-01-01
publisher IEEE
record_format Article
series IEEE Access
spelling doaj.art-122ee51dd6ff4ac78e5b41216df0412f2023-04-18T23:00:17ZengIEEEIEEE Access2169-35362023-01-0111364643647010.1109/ACCESS.2023.326672210100683Mitigating Inaudible Ultrasound Attacks on Voice Assistants With Acoustic MetamaterialsJoshua S. Lloyd0Cole G. Ludwikowski1Cyrus Malik2Chen Shen3https://orcid.org/0000-0003-3535-8494Department of Mechanical Engineering, Rowan University, Glassboro, NJ, USADepartment of Mechanical Engineering, Rowan University, Glassboro, NJ, USADepartment of Electrical and Computer Engineering, Rowan University, Glassboro, NJ, USADepartment of Mechanical Engineering, Rowan University, Glassboro, NJ, USAVoice assistants play an important role in facilitating human–machine interactions and have been widely used in audio consumer electronic products. However, it has been shown that they are susceptible to inaudible attacks in which the malicious signals are in the ultrasound regime and cannot be heard by human ears. In this study, we show that a judiciously designed acoustic metamaterial filter can mitigate such attacks by modulating the received signals by the microphones. The metamaterial filter is composed of rigid plates with individual holes which exhibit local resonance phenomena that suppress incoming waves at specific frequencies. The effectiveness of the metamaterial filter is confirmed by experiments that show a combination of the holes can collectively distort the attack signals and protect the smart speakers. Moreover, normal audible signals are not affected by the proposed metamaterial, which adds to the flexibility of the device. The metamaterial filter has a small footprint and can be easily installed on various audio products. Our proposed strategy expands the capacity of acoustic metamaterials and improves the security of devices that use voice assistants.https://ieeexplore.ieee.org/document/10100683/Acoustic metamaterialsfiltersultrasoundvoice assistantswave propagation
spellingShingle Joshua S. Lloyd
Cole G. Ludwikowski
Cyrus Malik
Chen Shen
Mitigating Inaudible Ultrasound Attacks on Voice Assistants With Acoustic Metamaterials
IEEE Access
Acoustic metamaterials
filters
ultrasound
voice assistants
wave propagation
title Mitigating Inaudible Ultrasound Attacks on Voice Assistants With Acoustic Metamaterials
title_full Mitigating Inaudible Ultrasound Attacks on Voice Assistants With Acoustic Metamaterials
title_fullStr Mitigating Inaudible Ultrasound Attacks on Voice Assistants With Acoustic Metamaterials
title_full_unstemmed Mitigating Inaudible Ultrasound Attacks on Voice Assistants With Acoustic Metamaterials
title_short Mitigating Inaudible Ultrasound Attacks on Voice Assistants With Acoustic Metamaterials
title_sort mitigating inaudible ultrasound attacks on voice assistants with acoustic metamaterials
topic Acoustic metamaterials
filters
ultrasound
voice assistants
wave propagation
url https://ieeexplore.ieee.org/document/10100683/
work_keys_str_mv AT joshuaslloyd mitigatinginaudibleultrasoundattacksonvoiceassistantswithacousticmetamaterials
AT colegludwikowski mitigatinginaudibleultrasoundattacksonvoiceassistantswithacousticmetamaterials
AT cyrusmalik mitigatinginaudibleultrasoundattacksonvoiceassistantswithacousticmetamaterials
AT chenshen mitigatinginaudibleultrasoundattacksonvoiceassistantswithacousticmetamaterials