Black-Box-Based Mathematical Modelling of Machine Intelligence Measuring
Current machine intelligence metrics rely on a different philosophy, hindering their effective comparison. There is no standardization of what is machine intelligence and what should be measured to quantify it. In this study, we investigate the measurement of intelligence from the viewpoint of real-...
| Main Author: | |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2021-03-01
|
| Series: | Mathematics |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2227-7390/9/6/681 |
| _version_ | 1797540417725530112 |
|---|---|
| author | László Barna Iantovics |
| author_facet | László Barna Iantovics |
| author_sort | László Barna Iantovics |
| collection | DOAJ |
| description | Current machine intelligence metrics rely on a different philosophy, hindering their effective comparison. There is no standardization of what is machine intelligence and what should be measured to quantify it. In this study, we investigate the measurement of intelligence from the viewpoint of real-life difficult-problem-solving abilities, and we highlight the importance of being able to make accurate and robust comparisons between multiple cooperative multiagent systems (CMASs) using a novel metric. A recent metric presented in the scientific literature, called <i>MetrIntPair</i>, is capable of comparing the intelligence of only two CMASs at an application. In this paper, we propose a generalization of that metric called <i>MetrIntPairII</i>. <i>MetrIntPairII</i> is based on pairwise problem-solving intelligence comparisons (for the same problem, the problem-solving intelligence of the studied CMASs is evaluated experimentally in pairs). The pairwise intelligence comparison is proposed to decrease the necessary number of experimental intelligence measurements. <i>MetrIntPairII</i> has the same properties as <i>MetrIntPair</i>, with the main advantage that it can be applied to any number of CMASs conserving the accuracy of the comparison, while it exhibits enhanced robustness. An important property of the proposed metric is the universality, as it can be applied as a black-box method to intelligent agent-based systems (IABSs) generally, not depending on the aspect of IABS architecture. To demonstrate the effectiveness of the <i>MetrIntPairII</i> metric, we provide a representative experimental study, comparing the intelligence of several CMASs composed of agents specialized in solving an NP-hard problem. |
| first_indexed | 2024-03-10T13:00:51Z |
| format | Article |
| id | doaj.art-484bcedd8e064eee94c59bfae4bc021f |
| institution | Directory Open Access Journal |
| issn | 2227-7390 |
| language | English |
| last_indexed | 2024-03-10T13:00:51Z |
| publishDate | 2021-03-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Mathematics |
| spelling | doaj.art-484bcedd8e064eee94c59bfae4bc021f2023-11-21T11:32:36ZengMDPI AGMathematics2227-73902021-03-019668110.3390/math9060681Black-Box-Based Mathematical Modelling of Machine Intelligence MeasuringLászló Barna Iantovics0Department of Electrical Engineering and Information Technology, Faculty of Engineering and Information Technology, “George Emil Palade” University of Medicine, Pharmacy, Sciences, and Technology of Tg. Mures, Gh. Marinescu 38, 540142 Tg. Mures, RomaniaCurrent machine intelligence metrics rely on a different philosophy, hindering their effective comparison. There is no standardization of what is machine intelligence and what should be measured to quantify it. In this study, we investigate the measurement of intelligence from the viewpoint of real-life difficult-problem-solving abilities, and we highlight the importance of being able to make accurate and robust comparisons between multiple cooperative multiagent systems (CMASs) using a novel metric. A recent metric presented in the scientific literature, called <i>MetrIntPair</i>, is capable of comparing the intelligence of only two CMASs at an application. In this paper, we propose a generalization of that metric called <i>MetrIntPairII</i>. <i>MetrIntPairII</i> is based on pairwise problem-solving intelligence comparisons (for the same problem, the problem-solving intelligence of the studied CMASs is evaluated experimentally in pairs). The pairwise intelligence comparison is proposed to decrease the necessary number of experimental intelligence measurements. <i>MetrIntPairII</i> has the same properties as <i>MetrIntPair</i>, with the main advantage that it can be applied to any number of CMASs conserving the accuracy of the comparison, while it exhibits enhanced robustness. An important property of the proposed metric is the universality, as it can be applied as a black-box method to intelligent agent-based systems (IABSs) generally, not depending on the aspect of IABS architecture. To demonstrate the effectiveness of the <i>MetrIntPairII</i> metric, we provide a representative experimental study, comparing the intelligence of several CMASs composed of agents specialized in solving an NP-hard problem.https://www.mdpi.com/2227-7390/9/6/681mathematical modelling machine intelligence measuringintelligent systemindustry 4.0machine intelligenceintelligent agentcooperative multiagent system |
| spellingShingle | László Barna Iantovics Black-Box-Based Mathematical Modelling of Machine Intelligence Measuring Mathematics mathematical modelling machine intelligence measuring intelligent system industry 4.0 machine intelligence intelligent agent cooperative multiagent system |
| title | Black-Box-Based Mathematical Modelling of Machine Intelligence Measuring |
| title_full | Black-Box-Based Mathematical Modelling of Machine Intelligence Measuring |
| title_fullStr | Black-Box-Based Mathematical Modelling of Machine Intelligence Measuring |
| title_full_unstemmed | Black-Box-Based Mathematical Modelling of Machine Intelligence Measuring |
| title_short | Black-Box-Based Mathematical Modelling of Machine Intelligence Measuring |
| title_sort | black box based mathematical modelling of machine intelligence measuring |
| topic | mathematical modelling machine intelligence measuring intelligent system industry 4.0 machine intelligence intelligent agent cooperative multiagent system |
| url | https://www.mdpi.com/2227-7390/9/6/681 |
| work_keys_str_mv | AT laszlobarnaiantovics blackboxbasedmathematicalmodellingofmachineintelligencemeasuring |