A Testing Framework for AI Linguistic Systems (<i>testFAILS</i>)

A Testing Framework for AI Linguistic Systems (<i>testFAILS</i>)

This paper presents an innovative testing framework, <i>testFAILS</i>, designed for the rigorous evaluation of AI Linguistic Systems (AILS), with particular emphasis on the various iterations of ChatGPT. Leveraging orthogonal array coverage, this framework provides a robust mechanism for...

Full description

Bibliographic Details
Main Authors:	Yulia Kumar, Patricia Morreale, Peter Sorial, Justin Delgado, J. Jenny Li, Patrick Martins
Format:	Article
Language:	English
Published:	MDPI AG 2023-07-01
Series:	Electronics
Subjects:	chatbots chatbot validation bots a testing framework for AI linguistic systems (<i>testFAILS</i>) <i>AIDoctor</i>
Online Access:	https://www.mdpi.com/2079-9292/12/14/3095

Similar Items

What We Should Do Before the Social Bots Take Over: Online Privacy Protection and the Political Economy of Our Near Future
by: Graeff, Erhardt
Published: (2020)

The application of the sensemaking perspective for the examination of employees’ behavioural responses to the HR chatbot
by: Harmat Vanda
Published: (2023-08-01)

Role of AI chatbots in education: systematic literature review
by: Lasha Labadze, et al.
Published: (2023-10-01)

Enhancements in BlenderBot 3: Expanding Beyond a Singular Model Governance and Boosting Generational Performance
by: Ondrej Kobza, et al.
Published: (2023-11-01)

A Phenomenological Exploration of Students’ Perceptions of AI Chatbots in Higher Education
by: Soniya Antony, et al.
Published: (2023-08-01)

API2CAN: a dataset & service for canonical utterance generation for REST APIs
by: Mohammad-Ali Yaghoub-Zadeh-Fard, et al.
Published: (2021-09-01)

GenAI et al.: Cocreation, Authorship, Ownership, Academic Ethics and Integrity in a Time of Generative AI
by: Aras Bozkurt
Published: (2024-02-01)

An experimental study on a conversational agent in software testing lessons
by: Leo Natan PASCHOAL, et al.
Published: (2023-03-01)

Editorial: Conversational AI
by: Stephan Raaijmakers, et al.
Published: (2023-05-01)

EduChat: An AI-Based Chatbot for University-Related Information Using a Hybrid Approach
by: Hoa Dinh, et al.
Published: (2023-11-01)

Development of a Chatbot for Pregnant Women on a <i>Posyandu</i> Application in Indonesia: From Qualitative Approach to Decision Tree Method
by: Indriana Widya Puspitasari, et al.
Published: (2022-10-01)

Unleashing the potential of generative AI, conversational agents and chatbots in educational praxis: A systematic review and bibliometric analysis of GenAI in education
by: Aras Bozkurt
Published: (2023-11-01)

AI in healthcare: navigating opportunities and challenges in digital communication
by: George Sun, et al.
Published: (2023-12-01)

Development of OpenAI API Based Chatbot to Improve User Interaction on the JBMS Website
by: Gerald Santoso, et al.
Published: (2023-10-01)

Customized AI powered website chatbot using retrieval augmented generation (RAG) framework
by: Zhou, Qiren
Published: (2024)

The Effectiveness of Software Designed to Detect AI-Generated Writing: A Comparison of 16 AI Text Detectors
by: Walters William H.
Published: (2023-10-01)

Human-Computer Interaction in Customer Service: The Experience with AI Chatbots—A Systematic Literature Review
by: Luminița Nicolescu, et al.
Published: (2022-05-01)

Chatbots applications in education: A systematic review
by: Chinedu Wilfred Okonkwo, et al.
Published: (2021-01-01)

Educational Psychology Aspects of Learning with Chatbots without Artificial Intelligence: Suggestions for Designers
by: Michal Černý
Published: (2023-01-01)

AI-based online chat and the future of oncology care: a promising technology or a solution in search of a problem?
by: Joseph Kassab, et al.
Published: (2023-05-01)

“Chatting with ChatGPT”: Analyzing the factors influencing users' intention to Use the Open AI's ChatGPT using the UTAUT model
by: Devadas Menon, et al.
Published: (2023-11-01)

First-year students AI-competence as a predictor for intended and de facto use of AI-tools for supporting learning processes in higher education
by: Jan Delcker, et al.
Published: (2024-03-01)

Assessing the Usability of ChatGPT for Formal English Language Learning
by: Sarang Shaikh, et al.
Published: (2023-09-01)

Adoption and impacts of generative artificial intelligence: Theoretical underpinnings and research agenda
by: Ruchi Gupta, et al.
Published: (2024-04-01)

What will ChatGPT revolutionize in the financial industry?
by: Hassnian Ali, et al.
Published: (2023-11-01)

Analysis of Language-Model-Powered Chatbots for Query Resolution in PDF-Based Automotive Manuals
by: Thaís Medeiros, et al.
Published: (2023-10-01)

From Joseph Weizenbaum to ChatGPT
by: Christiane Floyd
Published: (2023-10-01)

Contributions to the Improvement of the Process of Internal Audit at Public Educational Entities by Using Chatbots
by: Anisoara – Elena Pavelescu (Belbe)
Published: (2024-02-01)

Modeling Students’ Perceptions of Chatbots in Learning: Integrating Technology Acceptance with the Value-Based Adoption Model
by: Ahlam Mohammed Al-Abdullatif
Published: (2023-11-01)

InterviewBot: Real-Time End-to-End Dialogue System for Interviewing Students for College Admission
by: Zihao Wang, et al.
Published: (2023-08-01)

Feminist Re-Engineering of Religion-Based AI Chatbots
by: Hazel T. Biana
Published: (2024-01-01)

An AI Chatbot for Personalized Music Recommendations Based on User Emotions
by: Rula M Ali Farkash, et al.
Published: (2024-03-01)

The Experience of Conversation and Relation with a Well-Being Chabot: Between Proximity and Remoteness
by: Joanna Wygnańska
Published: (2023-10-01)

Creativity and Innovation in Civic Spaces Supported by Cognitive Flexibility When Learning with AI Chatbots in Smart Cities
by: Sarah A. Chauncey, et al.
Published: (2024-02-01)

Analyzing the OpenAI Chatbot writing on Economic Development: The case for High Pyrenees and Aran Region and IDAPA
by: Guilherme Fráguas Nobre
Published: (2023-12-01)

Graph-Based Conversational AI: Towards a Distributed and Collaborative Multi-Chatbot Approach for Museums
by: Savvas Varitimiadis, et al.
Published: (2021-10-01)

AI Chatbots in Chinese higher education: adoption, perception, and influence among graduate students—an integrated analysis utilizing UTAUT and ECM models
by: Weiqi Tian, et al.
Published: (2024-02-01)

Chatbots, Generative AI, and Scholarly Manuscripts: WAME Recommendations on Chatbots and Generative Artificial Intelligence in Relation to Scholarly Publications Revised May 31, 2023
by: Chris Zielinski, et al.
Published: (2023-06-01)

Chatbots Put to the Test in Math and Logic Problems: A Comparison and Assessment of ChatGPT-3.5, ChatGPT-4, and Google Bard
by: Vagelis Plevris, et al.
Published: (2023-10-01)

BERT-Based Medical Chatbot: Enhancing Healthcare Communication through Natural Language Understanding
by: Arun Babu, et al.
Published: (2024-03-01)