An AI toolkit for libraries
Now that artificial intelligence (AI) tools are being widely used across academic publishing, how can we make informed assessments of these utilities? There is a need for a set of skills for evaluating new tools and measuring existing ones, which should enable anyone commissioning or managing AI uti...
| Main Author: | |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Ubiquity Press
2022-11-01
|
| Series: | Insights: The UKSG Journal |
| Subjects: | |
| Online Access: | https://insights.uksg.org/articles/592 |
| _version_ | 1797980874610835456 |
|---|---|
| author | Michael Upshall |
| author_facet | Michael Upshall |
| author_sort | Michael Upshall |
| collection | DOAJ |
| description | Now that artificial intelligence (AI) tools are being widely used across academic publishing, how can we make informed assessments of these utilities? There is a need for a set of skills for evaluating new tools and measuring existing ones, which should enable anyone commissioning or managing AI utilities to understand what questions to ask, what parameters to measure and possible pitfalls to avoid when introducing a new utility. The skills required are not technical. Potential problems include bias in the corpus, a poor training set or poor use of metrics for evaluation. This article gives a quick overview of some of areas where AI tools are being used and how they work. It then provides a checklist for assessment. The goal is not to discredit AI, but to make effective use of it. |
| first_indexed | 2024-04-11T06:00:46Z |
| format | Article |
| id | doaj.art-3e6587fc54e14fd8970d556be017a347 |
| institution | Directory Open Access Journal |
| issn | 2048-7754 |
| language | English |
| last_indexed | 2024-04-11T06:00:46Z |
| publishDate | 2022-11-01 |
| publisher | Ubiquity Press |
| record_format | Article |
| series | Insights: The UKSG Journal |
| spelling | doaj.art-3e6587fc54e14fd8970d556be017a3472022-12-22T04:41:40ZengUbiquity PressInsights: The UKSG Journal2048-77542022-11-013510.1629/uksg.592524An AI toolkit for librariesMichael Upshall0ConsultantNow that artificial intelligence (AI) tools are being widely used across academic publishing, how can we make informed assessments of these utilities? There is a need for a set of skills for evaluating new tools and measuring existing ones, which should enable anyone commissioning or managing AI utilities to understand what questions to ask, what parameters to measure and possible pitfalls to avoid when introducing a new utility. The skills required are not technical. Potential problems include bias in the corpus, a poor training set or poor use of metrics for evaluation. This article gives a quick overview of some of areas where AI tools are being used and how they work. It then provides a checklist for assessment. The goal is not to discredit AI, but to make effective use of it.https://insights.uksg.org/articles/592ainlpevaluationmetricsresearch support |
| spellingShingle | Michael Upshall An AI toolkit for libraries Insights: The UKSG Journal ai nlp evaluation metrics research support |
| title | An AI toolkit for libraries |
| title_full | An AI toolkit for libraries |
| title_fullStr | An AI toolkit for libraries |
| title_full_unstemmed | An AI toolkit for libraries |
| title_short | An AI toolkit for libraries |
| title_sort | ai toolkit for libraries |
| topic | ai nlp evaluation metrics research support |
| url | https://insights.uksg.org/articles/592 |
| work_keys_str_mv | AT michaelupshall anaitoolkitforlibraries AT michaelupshall aitoolkitforlibraries |