Intent Classification by the Use of Automatically Generated Knowledge Graphs

Intent classification is an essential task for goal-oriented dialogue systems for automatically identifying customers’ goals. Although intent classification performs well in general settings, domain-specific user goals can still present a challenge for this task. To address this challenge, we automa...

Full description

Bibliographic Details
Main Authors: Mihael Arcan, Sampritha Manjunath, Cécile Robin, Ghanshyam Verma, Devishree Pillai, Simon Sarkar, Sourav Dutta, Haytham Assem, John P. McCrae, Paul Buitelaar
Format: Article
Language:English
Published: MDPI AG 2023-05-01
Series:Information
Subjects:
Online Access:https://www.mdpi.com/2078-2489/14/5/288
_version_ 1827741144539201536
author Mihael Arcan
Sampritha Manjunath
Cécile Robin
Ghanshyam Verma
Devishree Pillai
Simon Sarkar
Sourav Dutta
Haytham Assem
John P. McCrae
Paul Buitelaar
author_facet Mihael Arcan
Sampritha Manjunath
Cécile Robin
Ghanshyam Verma
Devishree Pillai
Simon Sarkar
Sourav Dutta
Haytham Assem
John P. McCrae
Paul Buitelaar
author_sort Mihael Arcan
collection DOAJ
description Intent classification is an essential task for goal-oriented dialogue systems for automatically identifying customers’ goals. Although intent classification performs well in general settings, domain-specific user goals can still present a challenge for this task. To address this challenge, we automatically generate knowledge graphs for targeted data sets to capture domain-specific knowledge and leverage embeddings trained on these knowledge graphs for the intent classification task. As existing knowledge graphs might not be suitable for a targeted domain of interest, our automatic generation of knowledge graphs can extract the semantic information of any domain, which can be incorporated within the classification process. We compare our results with state-of-the-art pre-trained sentence embeddings and our evaluation of three data sets shows improvement in the intent classification task in terms of precision.
first_indexed 2024-03-11T03:38:29Z
format Article
id doaj.art-5f2817ceddc74bdd8cc6f084aa0a9c0d
institution Directory Open Access Journal
issn 2078-2489
language English
last_indexed 2024-03-11T03:38:29Z
publishDate 2023-05-01
publisher MDPI AG
record_format Article
series Information
spelling doaj.art-5f2817ceddc74bdd8cc6f084aa0a9c0d2023-11-18T01:48:08ZengMDPI AGInformation2078-24892023-05-0114528810.3390/info14050288Intent Classification by the Use of Automatically Generated Knowledge GraphsMihael Arcan0Sampritha Manjunath1Cécile Robin2Ghanshyam Verma3Devishree Pillai4Simon Sarkar5Sourav Dutta6Haytham Assem7John P. McCrae8Paul Buitelaar9Insight SFI Research Centre for Data Analytics, Data Science Institute, University of Galway, H91 AEX4 Galway, IrelandInsight SFI Research Centre for Data Analytics, Data Science Institute, University of Galway, H91 AEX4 Galway, IrelandInsight SFI Research Centre for Data Analytics, Data Science Institute, University of Galway, H91 AEX4 Galway, IrelandInsight SFI Research Centre for Data Analytics, Data Science Institute, University of Galway, H91 AEX4 Galway, IrelandInsight SFI Research Centre for Data Analytics, Data Science Institute, University of Galway, H91 AEX4 Galway, IrelandInsight SFI Research Centre for Data Analytics, Data Science Institute, University of Galway, H91 AEX4 Galway, IrelandHuawei Research, D02 R156 Dublin, IrelandAmazon Alexa AI, Cambridge CB1 2GA, UKInsight SFI Research Centre for Data Analytics, Data Science Institute, University of Galway, H91 AEX4 Galway, IrelandInsight SFI Research Centre for Data Analytics, Data Science Institute, University of Galway, H91 AEX4 Galway, IrelandIntent classification is an essential task for goal-oriented dialogue systems for automatically identifying customers’ goals. Although intent classification performs well in general settings, domain-specific user goals can still present a challenge for this task. To address this challenge, we automatically generate knowledge graphs for targeted data sets to capture domain-specific knowledge and leverage embeddings trained on these knowledge graphs for the intent classification task. As existing knowledge graphs might not be suitable for a targeted domain of interest, our automatic generation of knowledge graphs can extract the semantic information of any domain, which can be incorporated within the classification process. We compare our results with state-of-the-art pre-trained sentence embeddings and our evaluation of three data sets shows improvement in the intent classification task in terms of precision.https://www.mdpi.com/2078-2489/14/5/288intent classificationterm extractionnamed entity extractionrelation extractionknowledge graph generation
spellingShingle Mihael Arcan
Sampritha Manjunath
Cécile Robin
Ghanshyam Verma
Devishree Pillai
Simon Sarkar
Sourav Dutta
Haytham Assem
John P. McCrae
Paul Buitelaar
Intent Classification by the Use of Automatically Generated Knowledge Graphs
Information
intent classification
term extraction
named entity extraction
relation extraction
knowledge graph generation
title Intent Classification by the Use of Automatically Generated Knowledge Graphs
title_full Intent Classification by the Use of Automatically Generated Knowledge Graphs
title_fullStr Intent Classification by the Use of Automatically Generated Knowledge Graphs
title_full_unstemmed Intent Classification by the Use of Automatically Generated Knowledge Graphs
title_short Intent Classification by the Use of Automatically Generated Knowledge Graphs
title_sort intent classification by the use of automatically generated knowledge graphs
topic intent classification
term extraction
named entity extraction
relation extraction
knowledge graph generation
url https://www.mdpi.com/2078-2489/14/5/288
work_keys_str_mv AT mihaelarcan intentclassificationbytheuseofautomaticallygeneratedknowledgegraphs
AT samprithamanjunath intentclassificationbytheuseofautomaticallygeneratedknowledgegraphs
AT cecilerobin intentclassificationbytheuseofautomaticallygeneratedknowledgegraphs
AT ghanshyamverma intentclassificationbytheuseofautomaticallygeneratedknowledgegraphs
AT devishreepillai intentclassificationbytheuseofautomaticallygeneratedknowledgegraphs
AT simonsarkar intentclassificationbytheuseofautomaticallygeneratedknowledgegraphs
AT souravdutta intentclassificationbytheuseofautomaticallygeneratedknowledgegraphs
AT haythamassem intentclassificationbytheuseofautomaticallygeneratedknowledgegraphs
AT johnpmccrae intentclassificationbytheuseofautomaticallygeneratedknowledgegraphs
AT paulbuitelaar intentclassificationbytheuseofautomaticallygeneratedknowledgegraphs