Proximal Policy Optimization-Based Reinforcement Learning and Hybrid Approaches to Explore the Cross Array Task Optimal Solution
In an era characterised by rapid technological advancement, the application of algorithmic approaches to address complex problems has become crucial across various disciplines. Within the realm of education, there is growing recognition of the pivotal role played by computational thinking (CT). This...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2023-11-01
|
| Series: | Machine Learning and Knowledge Extraction |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2504-4990/5/4/82 |
| _version_ | 1797380279765041152 |
|---|---|
| author | Samuel Corecco Giorgia Adorni Luca Maria Gambardella |
| author_facet | Samuel Corecco Giorgia Adorni Luca Maria Gambardella |
| author_sort | Samuel Corecco |
| collection | DOAJ |
| description | In an era characterised by rapid technological advancement, the application of algorithmic approaches to address complex problems has become crucial across various disciplines. Within the realm of education, there is growing recognition of the pivotal role played by computational thinking (CT). This skill set has emerged as indispensable in our ever-evolving digital landscape, accompanied by an equal need for effective methods to assess and measure these skills. This research places its focus on the Cross Array Task (CAT), an educational activity designed within the Swiss educational system to assess students’ algorithmic skills. Its primary objective is to evaluate pupils’ ability to deconstruct complex problems into manageable steps and systematically formulate sequential strategies. The CAT has proven its effectiveness as an educational tool in tracking and monitoring the development of CT skills throughout compulsory education. Additionally, this task presents an enthralling avenue for algorithmic research, owing to its inherent complexity and the necessity to scrutinise the intricate interplay between different strategies and the structural aspects of this activity. This task, deeply rooted in logical reasoning and intricate problem solving, often poses a substantial challenge for human solvers striving for optimal solutions. Consequently, the exploration of computational power to unearth optimal solutions or uncover less intuitive strategies presents a captivating and promising endeavour. This paper explores two distinct algorithmic approaches to the CAT problem. The first approach combines clustering, random search, and move selection to find optimal solutions. The second approach employs reinforcement learning techniques focusing on the Proximal Policy Optimization (PPO) model. The findings of this research hold the potential to deepen our understanding of how machines can effectively tackle complex challenges like the CAT problem but also have broad implications, particularly in educational contexts, where these approaches can be seamlessly integrated into existing tools as a tutoring mechanism, offering assistance to students encountering difficulties. This can ultimately enhance students’ CT and problem-solving abilities, leading to an enriched educational experience. |
| first_indexed | 2024-03-08T20:35:07Z |
| format | Article |
| id | doaj.art-acbdc889d905489a867015affdeb4ce8 |
| institution | Directory Open Access Journal |
| issn | 2504-4990 |
| language | English |
| last_indexed | 2024-03-08T20:35:07Z |
| publishDate | 2023-11-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Machine Learning and Knowledge Extraction |
| spelling | doaj.art-acbdc889d905489a867015affdeb4ce82023-12-22T14:22:11ZengMDPI AGMachine Learning and Knowledge Extraction2504-49902023-11-01541660167910.3390/make5040082Proximal Policy Optimization-Based Reinforcement Learning and Hybrid Approaches to Explore the Cross Array Task Optimal SolutionSamuel Corecco0Giorgia Adorni1Luca Maria Gambardella2Faculty of Informatics, Università della Svizzera Italiana (USI), 6900 Lugano, SwitzerlandDalle Molle Institute for Artificial Intelligence (IDSIA), USI-SUPSI, 6900 Lugano, SwitzerlandDalle Molle Institute for Artificial Intelligence (IDSIA), USI-SUPSI, 6900 Lugano, SwitzerlandIn an era characterised by rapid technological advancement, the application of algorithmic approaches to address complex problems has become crucial across various disciplines. Within the realm of education, there is growing recognition of the pivotal role played by computational thinking (CT). This skill set has emerged as indispensable in our ever-evolving digital landscape, accompanied by an equal need for effective methods to assess and measure these skills. This research places its focus on the Cross Array Task (CAT), an educational activity designed within the Swiss educational system to assess students’ algorithmic skills. Its primary objective is to evaluate pupils’ ability to deconstruct complex problems into manageable steps and systematically formulate sequential strategies. The CAT has proven its effectiveness as an educational tool in tracking and monitoring the development of CT skills throughout compulsory education. Additionally, this task presents an enthralling avenue for algorithmic research, owing to its inherent complexity and the necessity to scrutinise the intricate interplay between different strategies and the structural aspects of this activity. This task, deeply rooted in logical reasoning and intricate problem solving, often poses a substantial challenge for human solvers striving for optimal solutions. Consequently, the exploration of computational power to unearth optimal solutions or uncover less intuitive strategies presents a captivating and promising endeavour. This paper explores two distinct algorithmic approaches to the CAT problem. The first approach combines clustering, random search, and move selection to find optimal solutions. The second approach employs reinforcement learning techniques focusing on the Proximal Policy Optimization (PPO) model. The findings of this research hold the potential to deepen our understanding of how machines can effectively tackle complex challenges like the CAT problem but also have broad implications, particularly in educational contexts, where these approaches can be seamlessly integrated into existing tools as a tutoring mechanism, offering assistance to students encountering difficulties. This can ultimately enhance students’ CT and problem-solving abilities, leading to an enriched educational experience.https://www.mdpi.com/2504-4990/5/4/82computational thinkingproblem-solving techniquesclusteringrandom searchreinforcement learningproximal policy optimization |
| spellingShingle | Samuel Corecco Giorgia Adorni Luca Maria Gambardella Proximal Policy Optimization-Based Reinforcement Learning and Hybrid Approaches to Explore the Cross Array Task Optimal Solution Machine Learning and Knowledge Extraction computational thinking problem-solving techniques clustering random search reinforcement learning proximal policy optimization |
| title | Proximal Policy Optimization-Based Reinforcement Learning and Hybrid Approaches to Explore the Cross Array Task Optimal Solution |
| title_full | Proximal Policy Optimization-Based Reinforcement Learning and Hybrid Approaches to Explore the Cross Array Task Optimal Solution |
| title_fullStr | Proximal Policy Optimization-Based Reinforcement Learning and Hybrid Approaches to Explore the Cross Array Task Optimal Solution |
| title_full_unstemmed | Proximal Policy Optimization-Based Reinforcement Learning and Hybrid Approaches to Explore the Cross Array Task Optimal Solution |
| title_short | Proximal Policy Optimization-Based Reinforcement Learning and Hybrid Approaches to Explore the Cross Array Task Optimal Solution |
| title_sort | proximal policy optimization based reinforcement learning and hybrid approaches to explore the cross array task optimal solution |
| topic | computational thinking problem-solving techniques clustering random search reinforcement learning proximal policy optimization |
| url | https://www.mdpi.com/2504-4990/5/4/82 |
| work_keys_str_mv | AT samuelcorecco proximalpolicyoptimizationbasedreinforcementlearningandhybridapproachestoexplorethecrossarraytaskoptimalsolution AT giorgiaadorni proximalpolicyoptimizationbasedreinforcementlearningandhybridapproachestoexplorethecrossarraytaskoptimalsolution AT lucamariagambardella proximalpolicyoptimizationbasedreinforcementlearningandhybridapproachestoexplorethecrossarraytaskoptimalsolution |