RODI: Benchmarking relational-to-ontology mapping generation quality
Accessing and utilizing enterprise or Web data that is scattered across multiple data sources is an important task for both applications and users. Ontology-based data integration, where an ontology mediates between the raw data and its consumers, is a promising approach to facilitate such scenario...
| Main Authors: | , , , , , , , , , , |
|---|---|
| Format: | Journal article |
| Published: |
IOS Press
2017
|
| _version_ | 1826272451849355264 |
|---|---|
| author | Pinkel, C Binnig, C Jiménez-Ruiz, E Kharlamov, E May, W Nikolov, A Skjæveland, M Solimando, A Taheriyan, M Heupel, C Horrocks, I |
| author_facet | Pinkel, C Binnig, C Jiménez-Ruiz, E Kharlamov, E May, W Nikolov, A Skjæveland, M Solimando, A Taheriyan, M Heupel, C Horrocks, I |
| author_sort | Pinkel, C |
| collection | OXFORD |
| description | Accessing and utilizing enterprise or Web data that is scattered across multiple data sources is an important task for both applications and users. Ontology-based data integration, where an ontology mediates between the raw data and its consumers, is a promising approach to facilitate such scenarios. This approach crucially relies on useful mappings to relate the ontology and the data, the latter being typically stored in relational databases. A number of systems to support the construction of such mappings have recently been developed. A generic and effective benchmark for reliable and comparable evaluation of the practical utility of such systems would make an important contribution to the development of ontology-based data integration systems and their application in practice. We have proposed such a benchmark, called RODI. In this paper, we present a new version of RODI, which significantly extends our previous benchmark, and we evaluate various systems with it. RODI includes test scenarios from the domains of scientific conferences, geographical data, and oil and gas exploration. Scenarios are constituted of databases, ontologies, and queries to test expected results. Systems that compute relational-to-ontology mappings can be evaluated using RODI by checking how well they can handle various features of relational schemas and ontologies, and how well the computed mappings work for query answering. Using RODI, we conducted a comprehensive evaluation of seven systems. |
| first_indexed | 2024-03-06T22:12:47Z |
| format | Journal article |
| id | oxford-uuid:5261ded8-e61e-44cd-8139-d3c629637185 |
| institution | University of Oxford |
| last_indexed | 2024-03-06T22:12:47Z |
| publishDate | 2017 |
| publisher | IOS Press |
| record_format | dspace |
| spelling | oxford-uuid:5261ded8-e61e-44cd-8139-d3c6296371852022-03-26T16:25:18ZRODI: Benchmarking relational-to-ontology mapping generation qualityJournal articlehttp://purl.org/coar/resource_type/c_dcae04bcuuid:5261ded8-e61e-44cd-8139-d3c629637185Symplectic Elements at OxfordIOS Press2017Pinkel, CBinnig, CJiménez-Ruiz, EKharlamov, EMay, WNikolov, ASkjæveland, MSolimando, ATaheriyan, MHeupel, CHorrocks, I Accessing and utilizing enterprise or Web data that is scattered across multiple data sources is an important task for both applications and users. Ontology-based data integration, where an ontology mediates between the raw data and its consumers, is a promising approach to facilitate such scenarios. This approach crucially relies on useful mappings to relate the ontology and the data, the latter being typically stored in relational databases. A number of systems to support the construction of such mappings have recently been developed. A generic and effective benchmark for reliable and comparable evaluation of the practical utility of such systems would make an important contribution to the development of ontology-based data integration systems and their application in practice. We have proposed such a benchmark, called RODI. In this paper, we present a new version of RODI, which significantly extends our previous benchmark, and we evaluate various systems with it. RODI includes test scenarios from the domains of scientific conferences, geographical data, and oil and gas exploration. Scenarios are constituted of databases, ontologies, and queries to test expected results. Systems that compute relational-to-ontology mappings can be evaluated using RODI by checking how well they can handle various features of relational schemas and ontologies, and how well the computed mappings work for query answering. Using RODI, we conducted a comprehensive evaluation of seven systems. |
| spellingShingle | Pinkel, C Binnig, C Jiménez-Ruiz, E Kharlamov, E May, W Nikolov, A Skjæveland, M Solimando, A Taheriyan, M Heupel, C Horrocks, I RODI: Benchmarking relational-to-ontology mapping generation quality |
| title | RODI: Benchmarking relational-to-ontology mapping generation quality |
| title_full | RODI: Benchmarking relational-to-ontology mapping generation quality |
| title_fullStr | RODI: Benchmarking relational-to-ontology mapping generation quality |
| title_full_unstemmed | RODI: Benchmarking relational-to-ontology mapping generation quality |
| title_short | RODI: Benchmarking relational-to-ontology mapping generation quality |
| title_sort | rodi benchmarking relational to ontology mapping generation quality |
| work_keys_str_mv | AT pinkelc rodibenchmarkingrelationaltoontologymappinggenerationquality AT binnigc rodibenchmarkingrelationaltoontologymappinggenerationquality AT jimenezruize rodibenchmarkingrelationaltoontologymappinggenerationquality AT kharlamove rodibenchmarkingrelationaltoontologymappinggenerationquality AT mayw rodibenchmarkingrelationaltoontologymappinggenerationquality AT nikolova rodibenchmarkingrelationaltoontologymappinggenerationquality AT skjævelandm rodibenchmarkingrelationaltoontologymappinggenerationquality AT solimandoa rodibenchmarkingrelationaltoontologymappinggenerationquality AT taheriyanm rodibenchmarkingrelationaltoontologymappinggenerationquality AT heupelc rodibenchmarkingrelationaltoontologymappinggenerationquality AT horrocksi rodibenchmarkingrelationaltoontologymappinggenerationquality |