Mining Dynamics: Using Data Mining Techniques to Analyze Multi-agent Learning
Analyzing the learning dynamics in multi-agent systems (MASs) has received growing attention in recent years. Theoretical analysis of the dynamics was only possible in simple domains and simple algorithms. When one or more of these restrictions do not apply, theoretical analysis becomes prohibitivel...
| Main Author: | |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
De Gruyter
2017-09-01
|
| Series: | Journal of Intelligent Systems |
| Subjects: | |
| Online Access: | https://doi.org/10.1515/jisys-2016-0136 |
| _version_ | 1818668934795100160 |
|---|---|
| author | Sherief Abdallah |
| author_facet | Sherief Abdallah |
| author_sort | Sherief Abdallah |
| collection | DOAJ |
| description | Analyzing the learning dynamics in multi-agent systems (MASs) has received growing attention in recent years. Theoretical analysis of the dynamics was only possible in simple domains and simple algorithms. When one or more of these restrictions do not apply, theoretical analysis becomes prohibitively difficult, and researchers rely on experimental analysis instead. In experimental analysis, researchers have used some global performance metric(s) as a rough approximation to the internal dynamics of the adaptive MAS. For example, if the overall payoff improved over time and eventually appeared to stabilize, then the learning dynamics were assumed to be stable as well. In this paper, we promote a middle ground between the thorough theoretical analysis and the high-level experimental analysis. We introduce the concept of mining dynamics and propose data-mining-based methodologies to analyze multi-agent learning dynamics. Using our methodologies, researchers can identify clusters of learning parameter values that lead to similar performance, and discover frequent sequences in agent dynamics. We verify the potential of our approach using the well-known iterated prisoner’s dilemma (with multiple states) domain. |
| first_indexed | 2024-12-17T06:44:13Z |
| format | Article |
| id | doaj.art-bf0f21260c484a9d85439552a10c1c4c |
| institution | Directory Open Access Journal |
| issn | 0334-1860 2191-026X |
| language | English |
| last_indexed | 2024-12-17T06:44:13Z |
| publishDate | 2017-09-01 |
| publisher | De Gruyter |
| record_format | Article |
| series | Journal of Intelligent Systems |
| spelling | doaj.art-bf0f21260c484a9d85439552a10c1c4c2022-12-21T21:59:47ZengDe GruyterJournal of Intelligent Systems0334-18602191-026X2017-09-0126461362410.1515/jisys-2016-0136Mining Dynamics: Using Data Mining Techniques to Analyze Multi-agent LearningSherief Abdallah0British University in Dubai, Dubai, United Arab EmiratesAnalyzing the learning dynamics in multi-agent systems (MASs) has received growing attention in recent years. Theoretical analysis of the dynamics was only possible in simple domains and simple algorithms. When one or more of these restrictions do not apply, theoretical analysis becomes prohibitively difficult, and researchers rely on experimental analysis instead. In experimental analysis, researchers have used some global performance metric(s) as a rough approximation to the internal dynamics of the adaptive MAS. For example, if the overall payoff improved over time and eventually appeared to stabilize, then the learning dynamics were assumed to be stable as well. In this paper, we promote a middle ground between the thorough theoretical analysis and the high-level experimental analysis. We introduce the concept of mining dynamics and propose data-mining-based methodologies to analyze multi-agent learning dynamics. Using our methodologies, researchers can identify clusters of learning parameter values that lead to similar performance, and discover frequent sequences in agent dynamics. We verify the potential of our approach using the well-known iterated prisoner’s dilemma (with multiple states) domain.https://doi.org/10.1515/jisys-2016-0136simulation and experimental verificationmulti-agent learningdata mining68t05 learning and adaptive systems68t42 agent technology |
| spellingShingle | Sherief Abdallah Mining Dynamics: Using Data Mining Techniques to Analyze Multi-agent Learning Journal of Intelligent Systems simulation and experimental verification multi-agent learning data mining 68t05 learning and adaptive systems 68t42 agent technology |
| title | Mining Dynamics: Using Data Mining Techniques to Analyze Multi-agent Learning |
| title_full | Mining Dynamics: Using Data Mining Techniques to Analyze Multi-agent Learning |
| title_fullStr | Mining Dynamics: Using Data Mining Techniques to Analyze Multi-agent Learning |
| title_full_unstemmed | Mining Dynamics: Using Data Mining Techniques to Analyze Multi-agent Learning |
| title_short | Mining Dynamics: Using Data Mining Techniques to Analyze Multi-agent Learning |
| title_sort | mining dynamics using data mining techniques to analyze multi agent learning |
| topic | simulation and experimental verification multi-agent learning data mining 68t05 learning and adaptive systems 68t42 agent technology |
| url | https://doi.org/10.1515/jisys-2016-0136 |
| work_keys_str_mv | AT sheriefabdallah miningdynamicsusingdataminingtechniquestoanalyzemultiagentlearning |