Online Incremental Learning Based on Crowdsourcing For Indonesian Ontology Relation Extraction
Ontology is one form of structured representation of knowledge. Ontology is widely used and developed in information retrieval because of its ability to represent knowledge in a form that machines and humans can understand. With the increasing scale and complexity of ontology, there are more signif...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Asociación Española para la Inteligencia Artificial
2023-09-01
|
| Series: | Inteligencia Artificial |
| Subjects: | |
| Online Access: | http://www.journal.iberamia.org/index.php/intartif/article/view/906 |
| _version_ | 1797672899444736000 |
|---|---|
| author | Eunike Andriani Kardinata Nur Aini Rakhmawati |
| author_facet | Eunike Andriani Kardinata Nur Aini Rakhmawati |
| author_sort | Eunike Andriani Kardinata |
| collection | DOAJ |
| description |
Ontology is one form of structured representation of knowledge. Ontology is widely used and developed in information retrieval because of its ability to represent knowledge in a form that machines and humans can understand. With the increasing scale and complexity of ontology, there are more significant challenges in identifying extra-logical errors. Ontological development methods mostly use machine learning, which is at risk of missed extra-logical errors. To handle it, crowdsourcing is used, i.e. dividing a large job into several small jobs and hiring the masses to complete it. Data processing is usually done offline to take advantage of crowdsourcing, and batches are converted into online and incremental. Online incremental learning directly arranges an iterative model after a change is made by ensuring that the knowledge that has been obtained before is maintained. This study built an interactive medium to present the initial relationship between concept pairs. Crowdsourcing participants were asked to validate the relationship repeatedly until a specified accuracy value was reached. This study found that the crowdsourcing process was able to improve the model used in the relationship extraction process, from F1-Score 87.2% to 89.8%. Improvements using crowdsourcing achieve the same result as improvements by experts. Thus, crowdsourcing can correct extra-logical errors appropriately as an expert. In addition, it was also found that offline incremental learning using Random Forest resulted in higher model accuracy than incremental online learning using Mondrian Forest. The accuracy of the Random Forest model has a final accuracy of 90.6%, while the accuracy of the Mondrian Forest model is 89.7%. From these results, it was concluded that incremental online learning cannot provide better results than offline incremental learning to improve the meronymy relationship extraction process.
|
| first_indexed | 2024-03-11T21:36:58Z |
| format | Article |
| id | doaj.art-8ca7d1c150904078be95da4efec7fa7c |
| institution | Directory Open Access Journal |
| issn | 1137-3601 1988-3064 |
| language | English |
| last_indexed | 2024-03-11T21:36:58Z |
| publishDate | 2023-09-01 |
| publisher | Asociación Española para la Inteligencia Artificial |
| record_format | Article |
| series | Inteligencia Artificial |
| spelling | doaj.art-8ca7d1c150904078be95da4efec7fa7c2023-09-26T22:00:48ZengAsociación Española para la Inteligencia ArtificialInteligencia Artificial1137-36011988-30642023-09-01267210.4114/intartif.vol26iss72pp124-136Online Incremental Learning Based on Crowdsourcing For Indonesian Ontology Relation Extraction Eunike Andriani Kardinata0Nur Aini Rakhmawati1Institut Sains dan Teknologi Terpadu Surabaya, IndonesiaInstitut Teknologi Sepuluh Nopember Surabaya, Indonesia Ontology is one form of structured representation of knowledge. Ontology is widely used and developed in information retrieval because of its ability to represent knowledge in a form that machines and humans can understand. With the increasing scale and complexity of ontology, there are more significant challenges in identifying extra-logical errors. Ontological development methods mostly use machine learning, which is at risk of missed extra-logical errors. To handle it, crowdsourcing is used, i.e. dividing a large job into several small jobs and hiring the masses to complete it. Data processing is usually done offline to take advantage of crowdsourcing, and batches are converted into online and incremental. Online incremental learning directly arranges an iterative model after a change is made by ensuring that the knowledge that has been obtained before is maintained. This study built an interactive medium to present the initial relationship between concept pairs. Crowdsourcing participants were asked to validate the relationship repeatedly until a specified accuracy value was reached. This study found that the crowdsourcing process was able to improve the model used in the relationship extraction process, from F1-Score 87.2% to 89.8%. Improvements using crowdsourcing achieve the same result as improvements by experts. Thus, crowdsourcing can correct extra-logical errors appropriately as an expert. In addition, it was also found that offline incremental learning using Random Forest resulted in higher model accuracy than incremental online learning using Mondrian Forest. The accuracy of the Random Forest model has a final accuracy of 90.6%, while the accuracy of the Mondrian Forest model is 89.7%. From these results, it was concluded that incremental online learning cannot provide better results than offline incremental learning to improve the meronymy relationship extraction process. http://www.journal.iberamia.org/index.php/intartif/article/view/906CrowdsourcingExtra-Logical ErrorOnline Incremental learningRelationontology |
| spellingShingle | Eunike Andriani Kardinata Nur Aini Rakhmawati Online Incremental Learning Based on Crowdsourcing For Indonesian Ontology Relation Extraction Inteligencia Artificial Crowdsourcing Extra-Logical Error Online Incremental learning Relation ontology |
| title | Online Incremental Learning Based on Crowdsourcing For Indonesian Ontology Relation Extraction |
| title_full | Online Incremental Learning Based on Crowdsourcing For Indonesian Ontology Relation Extraction |
| title_fullStr | Online Incremental Learning Based on Crowdsourcing For Indonesian Ontology Relation Extraction |
| title_full_unstemmed | Online Incremental Learning Based on Crowdsourcing For Indonesian Ontology Relation Extraction |
| title_short | Online Incremental Learning Based on Crowdsourcing For Indonesian Ontology Relation Extraction |
| title_sort | online incremental learning based on crowdsourcing for indonesian ontology relation extraction |
| topic | Crowdsourcing Extra-Logical Error Online Incremental learning Relation ontology |
| url | http://www.journal.iberamia.org/index.php/intartif/article/view/906 |
| work_keys_str_mv | AT eunikeandrianikardinata onlineincrementallearningbasedoncrowdsourcingforindonesianontologyrelationextraction AT nurainirakhmawati onlineincrementallearningbasedoncrowdsourcingforindonesianontologyrelationextraction |