From Knowledge Transmission to Knowledge Construction: A Step towards Human-Like Active Learning

Machines usually employ a guess-and-check strategy to analyze data: they take the data, make a guess, check the answer, adjust it with regard to the correct one if necessary, and try again on a new data set. An active learning environment guarantees better performance while training on less, but car...

Full description

Bibliographic Details
Main Authors: Ilona Kulikovskikh, Tomislav Lipic, Tomislav Šmuc
Format: Article
Language:English
Published: MDPI AG 2020-08-01
Series:Entropy
Subjects:
Online Access:https://www.mdpi.com/1099-4300/22/8/906
_version_ 1797557345937522688
author Ilona Kulikovskikh
Tomislav Lipic
Tomislav Šmuc
author_facet Ilona Kulikovskikh
Tomislav Lipic
Tomislav Šmuc
author_sort Ilona Kulikovskikh
collection DOAJ
description Machines usually employ a guess-and-check strategy to analyze data: they take the data, make a guess, check the answer, adjust it with regard to the correct one if necessary, and try again on a new data set. An active learning environment guarantees better performance while training on less, but carefully chosen, data which reduces the costs of both annotating and analyzing large data sets. This issue becomes even more critical for deep learning applications. Human-like active learning integrates a variety of strategies and instructional models chosen by a teacher to contribute to learners’ knowledge, while machine active learning strategies lack versatile tools for shifting the focus of instruction away from knowledge transmission to learners’ knowledge construction. We approach this gap by considering an active learning environment in an educational setting. We propose a new strategy that measures the information capacity of data using the information function from the four-parameter logistic item response theory (4PL IRT). We compared the proposed strategy with the most common active learning strategies—Least Confidence and Entropy Sampling. The results of computational experiments showed that the Information Capacity strategy shares similar behavior but provides a more flexible framework for building transparent knowledge models in deep learning.
first_indexed 2024-03-10T17:15:51Z
format Article
id doaj.art-fce34e0862aa46b192b289912828f247
institution Directory Open Access Journal
issn 1099-4300
language English
last_indexed 2024-03-10T17:15:51Z
publishDate 2020-08-01
publisher MDPI AG
record_format Article
series Entropy
spelling doaj.art-fce34e0862aa46b192b289912828f2472023-11-20T10:31:54ZengMDPI AGEntropy1099-43002020-08-0122890610.3390/e22080906From Knowledge Transmission to Knowledge Construction: A Step towards Human-Like Active LearningIlona Kulikovskikh0Tomislav Lipic1Tomislav Šmuc2Department of Information Systems and Technologies, Samara National Research University, Moskovskoe Shosse 34, 443086 Samara, RussiaDivision of Electronics, Ruđer Bošković Institute, Bijenička cesta 54, 10000 Zagreb, CroatiaDivision of Electronics, Ruđer Bošković Institute, Bijenička cesta 54, 10000 Zagreb, CroatiaMachines usually employ a guess-and-check strategy to analyze data: they take the data, make a guess, check the answer, adjust it with regard to the correct one if necessary, and try again on a new data set. An active learning environment guarantees better performance while training on less, but carefully chosen, data which reduces the costs of both annotating and analyzing large data sets. This issue becomes even more critical for deep learning applications. Human-like active learning integrates a variety of strategies and instructional models chosen by a teacher to contribute to learners’ knowledge, while machine active learning strategies lack versatile tools for shifting the focus of instruction away from knowledge transmission to learners’ knowledge construction. We approach this gap by considering an active learning environment in an educational setting. We propose a new strategy that measures the information capacity of data using the information function from the four-parameter logistic item response theory (4PL IRT). We compared the proposed strategy with the most common active learning strategies—Least Confidence and Entropy Sampling. The results of computational experiments showed that the Information Capacity strategy shares similar behavior but provides a more flexible framework for building transparent knowledge models in deep learning.https://www.mdpi.com/1099-4300/22/8/906item informationpool-based samplingmultiple-choice testingitem response theoryactive learningdeep learning
spellingShingle Ilona Kulikovskikh
Tomislav Lipic
Tomislav Šmuc
From Knowledge Transmission to Knowledge Construction: A Step towards Human-Like Active Learning
Entropy
item information
pool-based sampling
multiple-choice testing
item response theory
active learning
deep learning
title From Knowledge Transmission to Knowledge Construction: A Step towards Human-Like Active Learning
title_full From Knowledge Transmission to Knowledge Construction: A Step towards Human-Like Active Learning
title_fullStr From Knowledge Transmission to Knowledge Construction: A Step towards Human-Like Active Learning
title_full_unstemmed From Knowledge Transmission to Knowledge Construction: A Step towards Human-Like Active Learning
title_short From Knowledge Transmission to Knowledge Construction: A Step towards Human-Like Active Learning
title_sort from knowledge transmission to knowledge construction a step towards human like active learning
topic item information
pool-based sampling
multiple-choice testing
item response theory
active learning
deep learning
url https://www.mdpi.com/1099-4300/22/8/906
work_keys_str_mv AT ilonakulikovskikh fromknowledgetransmissiontoknowledgeconstructionasteptowardshumanlikeactivelearning
AT tomislavlipic fromknowledgetransmissiontoknowledgeconstructionasteptowardshumanlikeactivelearning
AT tomislavsmuc fromknowledgetransmissiontoknowledgeconstructionasteptowardshumanlikeactivelearning