Towards Automatic Collaboration Analytics for Group Speech Data Using Learning Analytics
Collaboration is an important 21st Century skill. Co-located (or face-to-face) collaboration (CC) analytics gained momentum with the advent of sensor technology. Most of these works have used the audio modality to detect the quality of CC. The CC quality can be detected from simple indicators of col...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2021-05-01
|
| Series: | Sensors |
| Subjects: | |
| Online Access: | https://www.mdpi.com/1424-8220/21/9/3156 |
| _version_ | 1797535457809006592 |
|---|---|
| author | Sambit Praharaj Maren Scheffel Marcel Schmitz Marcus Specht Hendrik Drachsler |
| author_facet | Sambit Praharaj Maren Scheffel Marcel Schmitz Marcus Specht Hendrik Drachsler |
| author_sort | Sambit Praharaj |
| collection | DOAJ |
| description | Collaboration is an important 21st Century skill. Co-located (or face-to-face) collaboration (CC) analytics gained momentum with the advent of sensor technology. Most of these works have used the audio modality to detect the quality of CC. The CC quality can be detected from simple indicators of collaboration such as total speaking time or complex indicators like synchrony in the rise and fall of the average pitch. Most studies in the past focused on “how group members talk” (i.e., spectral, temporal features of audio like pitch) and not “what they talk”. The “what” of the conversations is more overt contrary to the “how” of the conversations. Very few studies studied “what” group members talk about, and these studies were lab based showing a representative overview of specific words as topic clusters instead of analysing the richness of the content of the conversations by understanding the linkage between these words. To overcome this, we made a starting step in this technical paper based on field trials to prototype a tool to move towards automatic collaboration analytics. We designed a technical setup to collect, process and visualize audio data automatically. The data collection took place while a board game was played among the university staff with pre-assigned roles to create awareness of the connection between learning analytics and learning design. We not only did a word-level analysis of the conversations, but also analysed the richness of these conversations by visualizing the strength of the linkage between these words and phrases interactively. In this visualization, we used a network graph to visualize turn taking exchange between different roles along with the word-level and phrase-level analysis. We also used centrality measures to understand the network graph further based on how much words have hold over the network of words and how influential are certain words. Finally, we found that this approach had certain limitations in terms of automation in speaker diarization (i.e., who spoke when) and text data pre-processing. Therefore, we concluded that even though the technical setup was partially automated, it is a way forward to understand the richness of the conversations between different roles and makes a significant step towards automatic collaboration analytics. |
| first_indexed | 2024-03-10T11:45:45Z |
| format | Article |
| id | doaj.art-e6334438d7e14de39b0cf677c572057e |
| institution | Directory Open Access Journal |
| issn | 1424-8220 |
| language | English |
| last_indexed | 2024-03-10T11:45:45Z |
| publishDate | 2021-05-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Sensors |
| spelling | doaj.art-e6334438d7e14de39b0cf677c572057e2023-11-21T18:10:31ZengMDPI AGSensors1424-82202021-05-01219315610.3390/s21093156Towards Automatic Collaboration Analytics for Group Speech Data Using Learning AnalyticsSambit Praharaj0Maren Scheffel1Marcel Schmitz2Marcus Specht3Hendrik Drachsler4Educational Science Faculty, Open University of the Netherlands, 6419 AT Heerlen, The NetherlandsInstitute of Education Science, Ruhr-Universität Bochum, 44801 Bochum, GermanyEducational Science Faculty, Open University of the Netherlands, 6419 AT Heerlen, The NetherlandsComputer Science Faculty, Delft University of Technology, 2628 CD Delft, The NetherlandsEducational Science Faculty, Open University of the Netherlands, 6419 AT Heerlen, The NetherlandsCollaboration is an important 21st Century skill. Co-located (or face-to-face) collaboration (CC) analytics gained momentum with the advent of sensor technology. Most of these works have used the audio modality to detect the quality of CC. The CC quality can be detected from simple indicators of collaboration such as total speaking time or complex indicators like synchrony in the rise and fall of the average pitch. Most studies in the past focused on “how group members talk” (i.e., spectral, temporal features of audio like pitch) and not “what they talk”. The “what” of the conversations is more overt contrary to the “how” of the conversations. Very few studies studied “what” group members talk about, and these studies were lab based showing a representative overview of specific words as topic clusters instead of analysing the richness of the content of the conversations by understanding the linkage between these words. To overcome this, we made a starting step in this technical paper based on field trials to prototype a tool to move towards automatic collaboration analytics. We designed a technical setup to collect, process and visualize audio data automatically. The data collection took place while a board game was played among the university staff with pre-assigned roles to create awareness of the connection between learning analytics and learning design. We not only did a word-level analysis of the conversations, but also analysed the richness of these conversations by visualizing the strength of the linkage between these words and phrases interactively. In this visualization, we used a network graph to visualize turn taking exchange between different roles along with the word-level and phrase-level analysis. We also used centrality measures to understand the network graph further based on how much words have hold over the network of words and how influential are certain words. Finally, we found that this approach had certain limitations in terms of automation in speaker diarization (i.e., who spoke when) and text data pre-processing. Therefore, we concluded that even though the technical setup was partially automated, it is a way forward to understand the richness of the conversations between different roles and makes a significant step towards automatic collaboration analytics.https://www.mdpi.com/1424-8220/21/9/3156collaborationcollaboration analyticsco-located collaboration analyticsgroup speech analyticsmultimodal learning analytics |
| spellingShingle | Sambit Praharaj Maren Scheffel Marcel Schmitz Marcus Specht Hendrik Drachsler Towards Automatic Collaboration Analytics for Group Speech Data Using Learning Analytics Sensors collaboration collaboration analytics co-located collaboration analytics group speech analytics multimodal learning analytics |
| title | Towards Automatic Collaboration Analytics for Group Speech Data Using Learning Analytics |
| title_full | Towards Automatic Collaboration Analytics for Group Speech Data Using Learning Analytics |
| title_fullStr | Towards Automatic Collaboration Analytics for Group Speech Data Using Learning Analytics |
| title_full_unstemmed | Towards Automatic Collaboration Analytics for Group Speech Data Using Learning Analytics |
| title_short | Towards Automatic Collaboration Analytics for Group Speech Data Using Learning Analytics |
| title_sort | towards automatic collaboration analytics for group speech data using learning analytics |
| topic | collaboration collaboration analytics co-located collaboration analytics group speech analytics multimodal learning analytics |
| url | https://www.mdpi.com/1424-8220/21/9/3156 |
| work_keys_str_mv | AT sambitpraharaj towardsautomaticcollaborationanalyticsforgroupspeechdatausinglearninganalytics AT marenscheffel towardsautomaticcollaborationanalyticsforgroupspeechdatausinglearninganalytics AT marcelschmitz towardsautomaticcollaborationanalyticsforgroupspeechdatausinglearninganalytics AT marcusspecht towardsautomaticcollaborationanalyticsforgroupspeechdatausinglearninganalytics AT hendrikdrachsler towardsautomaticcollaborationanalyticsforgroupspeechdatausinglearninganalytics |