The security of human-computer interaction by speech

<p>This thesis investigates the security issues associated with human-computer interaction by speech, focussing on the context of voice-controlled digital assistants. The security of human-computer interaction by speech has become increasingly important as use of voice control has become more...

Mô tả đầy đủ

Chi tiết về thư mục
Tác giả chính: Bispham, MK
Tác giả khác: Goldsmith, M
Định dạng: Luận văn
Ngôn ngữ:English
Được phát hành: 2020
Những chủ đề:
_version_ 1826273746704400384
author Bispham, MK
author2 Goldsmith, M
author_facet Goldsmith, M
Bispham, MK
author_sort Bispham, MK
collection OXFORD
description <p>This thesis investigates the security issues associated with human-computer interaction by speech, focussing on the context of voice-controlled digital assistants. The security of human-computer interaction by speech has become increasingly important as use of voice control has become more widespread. The research questions addressed in the thesis are whether the speech interface presents particular vulnerabilities that are not relevant to other types of interfaces, and, if so, what these vulnerabilities are and how attacks exploiting them can be defended. Based on a critical review of prior work, it is argued that the speech interface does represent a new attack surface with specific security vulnerabilities that have not as yet been comprehensively studied. These vulnerabilities arise both in relation to the inherently open nature of the speech interface, as well in relation to unintended functionality in the technologies implemented in voice-controlled systems to imitate human speech and language processing. </p> <p>The thesis makes three main contributions towards closing the gaps in knowledge on the security of human-computer interaction by speech identified in the review of prior work. The first contribution of the thesis is a novel taxonomy of the types of attacks that might be executed via a speech interface, representing a systemisation of knowledge in this area. The second contribution of the thesis is experimental work demonstrating new types of attacks via the speech interface that are foreshadowed in prior work, but have not been validated in practice. The experimental work develops systematic methodologies for executing attacks that hide malicious voice commands in nonsensical word sounds and in apparently unrelated utterances. The methodologies applied in these experiments involve testing both machine and human responses to such input to assess the potential for exploiting differences in machine and human perceptions to execute covert attacks. The third contribution of the thesis is proposals for the development of new defence mechanisms to counter attacks via the speech interface for which no effective defence mechanisms are currently available. These proposals include feasibility tests on the application of two existing technologies for security purposes in voice-controlled systems. The proposals for new defence mechanisms are grounded in a novel attack and defence modelling approach for analysing the security of human-computer interaction by speech that enables conceptualisation of the security of the speech interface in an inclusive framework, and facilitates a review of currently available defence mechanisms.</p>
first_indexed 2024-03-06T22:32:55Z
format Thesis
id oxford-uuid:58dd8f9f-ead0-44f2-b6a3-b4c9b0f5a46b
institution University of Oxford
language English
last_indexed 2024-03-06T22:32:55Z
publishDate 2020
record_format dspace
spelling oxford-uuid:58dd8f9f-ead0-44f2-b6a3-b4c9b0f5a46b2022-03-26T17:06:22ZThe security of human-computer interaction by speechThesishttp://purl.org/coar/resource_type/c_db06uuid:58dd8f9f-ead0-44f2-b6a3-b4c9b0f5a46bspeech and language processingcyber securitycomputer scienceEnglishHyrax Deposit2020Bispham, MKGoldsmith, MAgrafiotis, I<p>This thesis investigates the security issues associated with human-computer interaction by speech, focussing on the context of voice-controlled digital assistants. The security of human-computer interaction by speech has become increasingly important as use of voice control has become more widespread. The research questions addressed in the thesis are whether the speech interface presents particular vulnerabilities that are not relevant to other types of interfaces, and, if so, what these vulnerabilities are and how attacks exploiting them can be defended. Based on a critical review of prior work, it is argued that the speech interface does represent a new attack surface with specific security vulnerabilities that have not as yet been comprehensively studied. These vulnerabilities arise both in relation to the inherently open nature of the speech interface, as well in relation to unintended functionality in the technologies implemented in voice-controlled systems to imitate human speech and language processing. </p> <p>The thesis makes three main contributions towards closing the gaps in knowledge on the security of human-computer interaction by speech identified in the review of prior work. The first contribution of the thesis is a novel taxonomy of the types of attacks that might be executed via a speech interface, representing a systemisation of knowledge in this area. The second contribution of the thesis is experimental work demonstrating new types of attacks via the speech interface that are foreshadowed in prior work, but have not been validated in practice. The experimental work develops systematic methodologies for executing attacks that hide malicious voice commands in nonsensical word sounds and in apparently unrelated utterances. The methodologies applied in these experiments involve testing both machine and human responses to such input to assess the potential for exploiting differences in machine and human perceptions to execute covert attacks. The third contribution of the thesis is proposals for the development of new defence mechanisms to counter attacks via the speech interface for which no effective defence mechanisms are currently available. These proposals include feasibility tests on the application of two existing technologies for security purposes in voice-controlled systems. The proposals for new defence mechanisms are grounded in a novel attack and defence modelling approach for analysing the security of human-computer interaction by speech that enables conceptualisation of the security of the speech interface in an inclusive framework, and facilitates a review of currently available defence mechanisms.</p>
spellingShingle speech and language processing
cyber security
computer science
Bispham, MK
The security of human-computer interaction by speech
title The security of human-computer interaction by speech
title_full The security of human-computer interaction by speech
title_fullStr The security of human-computer interaction by speech
title_full_unstemmed The security of human-computer interaction by speech
title_short The security of human-computer interaction by speech
title_sort security of human computer interaction by speech
topic speech and language processing
cyber security
computer science
work_keys_str_mv AT bisphammk thesecurityofhumancomputerinteractionbyspeech
AT bisphammk securityofhumancomputerinteractionbyspeech