A benchmark for end-user structured data exploration and search user interfaces
During the years, it has been possible to assess significant improvements in the computational efficiency of Semantic Web search and exploration systems. However, it has been much harder to assess how well different semantic systems’ user interfaces help their users. One of the key factors facilitat...
| Main Authors: | , , , |
|---|---|
| Other Authors: | |
| Format: | Article |
| Language: | English |
| Published: |
Elsevier BV
2021
|
| Online Access: | https://hdl.handle.net/1721.1/129459 |
| _version_ | 1826199386063896576 |
|---|---|
| author | García, Roberto Gil, Rosa Bakke, Eirik Karger, David R |
| author2 | Massachusetts Institute of Technology. Computer Science and Artificial Intelligence Laboratory |
| author_facet | Massachusetts Institute of Technology. Computer Science and Artificial Intelligence Laboratory García, Roberto Gil, Rosa Bakke, Eirik Karger, David R |
| author_sort | García, Roberto |
| collection | MIT |
| description | During the years, it has been possible to assess significant improvements in the computational efficiency of Semantic Web search and exploration systems. However, it has been much harder to assess how well different semantic systems’ user interfaces help their users. One of the key factors facilitating the advancement of research in a particular field is the ability to compare the performance of different approaches. Though there are many such benchmarks in Semantic Web fields that have experienced significant improvements, this is not the case for Semantic Web user interfaces for data exploration. We propose and demonstrate the use of a benchmark for evaluating such user interfaces, which includes a set of typical user tasks and a well-defined procedure for assigning a measure of performance on those tasks to a semantic system. We have applied the benchmark to four such systems. Moreover, all the required resources to apply the benchmark are openly available online. We intend to initiate a community conversation that will lead to a generally accepted framework for comparing systems and for measuring, and thus encouraging, progress towards better semantic search and exploration tools. |
| first_indexed | 2024-09-23T11:19:04Z |
| format | Article |
| id | mit-1721.1/129459 |
| institution | Massachusetts Institute of Technology |
| language | English |
| last_indexed | 2024-09-23T11:19:04Z |
| publishDate | 2021 |
| publisher | Elsevier BV |
| record_format | dspace |
| spelling | mit-1721.1/1294592022-12-05T05:06:34Z A benchmark for end-user structured data exploration and search user interfaces García, Roberto Gil, Rosa Bakke, Eirik Karger, David R Massachusetts Institute of Technology. Computer Science and Artificial Intelligence Laboratory During the years, it has been possible to assess significant improvements in the computational efficiency of Semantic Web search and exploration systems. However, it has been much harder to assess how well different semantic systems’ user interfaces help their users. One of the key factors facilitating the advancement of research in a particular field is the ability to compare the performance of different approaches. Though there are many such benchmarks in Semantic Web fields that have experienced significant improvements, this is not the case for Semantic Web user interfaces for data exploration. We propose and demonstrate the use of a benchmark for evaluating such user interfaces, which includes a set of typical user tasks and a well-defined procedure for assigning a measure of performance on those tasks to a semantic system. We have applied the benchmark to four such systems. Moreover, all the required resources to apply the benchmark are openly available online. We intend to initiate a community conversation that will lead to a generally accepted framework for comparing systems and for measuring, and thus encouraging, progress towards better semantic search and exploration tools. 2021-01-19T22:09:31Z 2021-01-19T22:09:31Z 2020-12 2020-07 2020-12-23T15:40:39Z Article http://purl.org/eprint/type/JournalArticle 1570-8268 https://hdl.handle.net/1721.1/129459 Garcia, Roberto et al. "A benchmark for end-user structured data exploration and search user interfaces." Journal of Web Semantics 65 (December 2020): 100610 © 2020 Elsevier B.V. en http://dx.doi.org/10.1016/j.websem.2020.100610 Journal of Web Semantics Creative Commons Attribution-NonCommercial-NoDerivs License http://creativecommons.org/licenses/by-nc-nd/4.0/ application/pdf Elsevier BV Other repository |
| spellingShingle | García, Roberto Gil, Rosa Bakke, Eirik Karger, David R A benchmark for end-user structured data exploration and search user interfaces |
| title | A benchmark for end-user structured data exploration and search user interfaces |
| title_full | A benchmark for end-user structured data exploration and search user interfaces |
| title_fullStr | A benchmark for end-user structured data exploration and search user interfaces |
| title_full_unstemmed | A benchmark for end-user structured data exploration and search user interfaces |
| title_short | A benchmark for end-user structured data exploration and search user interfaces |
| title_sort | benchmark for end user structured data exploration and search user interfaces |
| url | https://hdl.handle.net/1721.1/129459 |
| work_keys_str_mv | AT garciaroberto abenchmarkforenduserstructureddataexplorationandsearchuserinterfaces AT gilrosa abenchmarkforenduserstructureddataexplorationandsearchuserinterfaces AT bakkeeirik abenchmarkforenduserstructureddataexplorationandsearchuserinterfaces AT kargerdavidr abenchmarkforenduserstructureddataexplorationandsearchuserinterfaces AT garciaroberto benchmarkforenduserstructureddataexplorationandsearchuserinterfaces AT gilrosa benchmarkforenduserstructureddataexplorationandsearchuserinterfaces AT bakkeeirik benchmarkforenduserstructureddataexplorationandsearchuserinterfaces AT kargerdavidr benchmarkforenduserstructureddataexplorationandsearchuserinterfaces |