Data on human decision, feedback, and confidence during an artificial intelligence-assisted decision-making task
The data are collected from a human subjects study in which 100 participants solve chess puzzle problems with artificial intelligence (AI) assistance. The participants are assigned to one of the two experimental conditions determined by the direction of the change in AI performance at problem 20: 1)...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Elsevier
2023-02-01
|
| Series: | Data in Brief |
| Subjects: | |
| Online Access: | http://www.sciencedirect.com/science/article/pii/S2352340923000021 |
| _version_ | 1797938064375414784 |
|---|---|
| author | Leah Chong Guanglu Zhang Kosa Goucher-Lambert Kenneth Kotovsky Jonathan Cagan |
| author_facet | Leah Chong Guanglu Zhang Kosa Goucher-Lambert Kenneth Kotovsky Jonathan Cagan |
| author_sort | Leah Chong |
| collection | DOAJ |
| description | The data are collected from a human subjects study in which 100 participants solve chess puzzle problems with artificial intelligence (AI) assistance. The participants are assigned to one of the two experimental conditions determined by the direction of the change in AI performance at problem 20: 1) high- to low-performing and 2) low- to high-performing. The dataset contains information about the participants’ move before an AI suggestion, the goodness evaluation score of these moves, AI suggestion, feedback, and the participants’ confidence in AI and self-confidence during three initial practice problems and 30 experimental problems. The dataset contains 100 CSV files, one per participant. There is opportunity for this dataset to be utilized in various domains that research human-AI collaboration scenarios such as human-computer interaction, psychology, computer science, and team management in engineering/business. Not only can the dataset enable further cognitive and behavioral analysis in human-AI collaboration contexts but also provide an experimental platform to develop and test future confidence calibration methods. |
| first_indexed | 2024-04-10T18:54:52Z |
| format | Article |
| id | doaj.art-982fbf1753e94da881cd94af4cc7e0ef |
| institution | Directory Open Access Journal |
| issn | 2352-3409 |
| language | English |
| last_indexed | 2024-04-10T18:54:52Z |
| publishDate | 2023-02-01 |
| publisher | Elsevier |
| record_format | Article |
| series | Data in Brief |
| spelling | doaj.art-982fbf1753e94da881cd94af4cc7e0ef2023-02-01T04:26:45ZengElsevierData in Brief2352-34092023-02-0146108884Data on human decision, feedback, and confidence during an artificial intelligence-assisted decision-making taskLeah Chong0Guanglu Zhang1Kosa Goucher-Lambert2Kenneth Kotovsky3Jonathan Cagan4Massachusetts Institute of Technology, 77 Massachusetts Ave, Cambridge, MA 02139, United StatesCarnegie Mellon University, 5000 Forbes Ave, Pittsburgh, PA 15213, United StatesUniversity of California, Berkeley, 110 Sproul Hall, Berkeley, CA 94720, United StatesCarnegie Mellon University, 5000 Forbes Ave, Pittsburgh, PA 15213, United StatesCarnegie Mellon University, 5000 Forbes Ave, Pittsburgh, PA 15213, United States; Corresponding author.The data are collected from a human subjects study in which 100 participants solve chess puzzle problems with artificial intelligence (AI) assistance. The participants are assigned to one of the two experimental conditions determined by the direction of the change in AI performance at problem 20: 1) high- to low-performing and 2) low- to high-performing. The dataset contains information about the participants’ move before an AI suggestion, the goodness evaluation score of these moves, AI suggestion, feedback, and the participants’ confidence in AI and self-confidence during three initial practice problems and 30 experimental problems. The dataset contains 100 CSV files, one per participant. There is opportunity for this dataset to be utilized in various domains that research human-AI collaboration scenarios such as human-computer interaction, psychology, computer science, and team management in engineering/business. Not only can the dataset enable further cognitive and behavioral analysis in human-AI collaboration contexts but also provide an experimental platform to develop and test future confidence calibration methods.http://www.sciencedirect.com/science/article/pii/S2352340923000021Artificial intelligenceHuman-AI interactionConfidenceDecision-makingAI assistanceTrust |
| spellingShingle | Leah Chong Guanglu Zhang Kosa Goucher-Lambert Kenneth Kotovsky Jonathan Cagan Data on human decision, feedback, and confidence during an artificial intelligence-assisted decision-making task Data in Brief Artificial intelligence Human-AI interaction Confidence Decision-making AI assistance Trust |
| title | Data on human decision, feedback, and confidence during an artificial intelligence-assisted decision-making task |
| title_full | Data on human decision, feedback, and confidence during an artificial intelligence-assisted decision-making task |
| title_fullStr | Data on human decision, feedback, and confidence during an artificial intelligence-assisted decision-making task |
| title_full_unstemmed | Data on human decision, feedback, and confidence during an artificial intelligence-assisted decision-making task |
| title_short | Data on human decision, feedback, and confidence during an artificial intelligence-assisted decision-making task |
| title_sort | data on human decision feedback and confidence during an artificial intelligence assisted decision making task |
| topic | Artificial intelligence Human-AI interaction Confidence Decision-making AI assistance Trust |
| url | http://www.sciencedirect.com/science/article/pii/S2352340923000021 |
| work_keys_str_mv | AT leahchong dataonhumandecisionfeedbackandconfidenceduringanartificialintelligenceassisteddecisionmakingtask AT guangluzhang dataonhumandecisionfeedbackandconfidenceduringanartificialintelligenceassisteddecisionmakingtask AT kosagoucherlambert dataonhumandecisionfeedbackandconfidenceduringanartificialintelligenceassisteddecisionmakingtask AT kennethkotovsky dataonhumandecisionfeedbackandconfidenceduringanartificialintelligenceassisteddecisionmakingtask AT jonathancagan dataonhumandecisionfeedbackandconfidenceduringanartificialintelligenceassisteddecisionmakingtask |