AI and augmented reality for 3D Indian dance pose reconstruction cultural revival
Abstract This paper delves into the specialized domain of human action recognition, focusing on the Identification of Indian classical dance poses, specifically Bharatanatyam. Within the dance context, a “Karana” embodies a synchronized and harmonious movement encompassing body, hands, and feet, as...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Nature Portfolio
2024-04-01
|
| Series: | Scientific Reports |
| Online Access: | https://doi.org/10.1038/s41598-024-58680-w |
| _version_ | 1797219773225893888 |
|---|---|
| author | J. Jayanthi P. Uma Maheswari |
| author_facet | J. Jayanthi P. Uma Maheswari |
| author_sort | J. Jayanthi |
| collection | DOAJ |
| description | Abstract This paper delves into the specialized domain of human action recognition, focusing on the Identification of Indian classical dance poses, specifically Bharatanatyam. Within the dance context, a “Karana” embodies a synchronized and harmonious movement encompassing body, hands, and feet, as defined by the Natyashastra. The essence of Karana lies in the amalgamation of nritta hasta (hand movements), sthaana (body postures), and chaari (leg movements). Although numerous, Natyashastra codifies 108 karanas, showcased in the intricate stone carvings adorning the Nataraj temples of Chidambaram, where Lord Shiva’s association with these movements is depicted. Automating pose identification in Bharatanatyam poses challenges due to the vast array of variations, encompassing hand and body postures, mudras (hand gestures), facial expressions, and head gestures. To simplify this intricate task, this research employs image processing and automation techniques. The proposed methodology comprises four stages: acquisition and pre-processing of images involving skeletonization and Data Augmentation techniques, feature extraction from images, classification of dance poses using a deep learning network-based convolution neural network model (InceptionResNetV2), and visualization of 3D models through mesh creation from point clouds. The use of advanced technologies, such as the MediaPipe library for body key point detection and deep learning networks, streamlines the identification process. Data augmentation, a pivotal step, expands small datasets, enhancing the model’s accuracy. The convolution neural network model showcased its effectiveness in accurately recognizing intricate dance movements, paving the way for streamlined analysis and interpretation. This innovative approach not only simplifies the identification of Bharatanatyam poses but also sets a precedent for enhancing accessibility and efficiency for practitioners and researchers in the Indian classical dance. |
| first_indexed | 2024-04-24T12:38:58Z |
| format | Article |
| id | doaj.art-016a7a3a32ea4fb7a133e6da4a7c0ee5 |
| institution | Directory Open Access Journal |
| issn | 2045-2322 |
| language | English |
| last_indexed | 2024-04-24T12:38:58Z |
| publishDate | 2024-04-01 |
| publisher | Nature Portfolio |
| record_format | Article |
| series | Scientific Reports |
| spelling | doaj.art-016a7a3a32ea4fb7a133e6da4a7c0ee52024-04-07T11:17:52ZengNature PortfolioScientific Reports2045-23222024-04-0114111610.1038/s41598-024-58680-wAI and augmented reality for 3D Indian dance pose reconstruction cultural revivalJ. Jayanthi0P. Uma Maheswari1Deparment of Computer Science and Engineering, Anna UniversityDeparment of Computer Science and Engineering, Anna UniversityAbstract This paper delves into the specialized domain of human action recognition, focusing on the Identification of Indian classical dance poses, specifically Bharatanatyam. Within the dance context, a “Karana” embodies a synchronized and harmonious movement encompassing body, hands, and feet, as defined by the Natyashastra. The essence of Karana lies in the amalgamation of nritta hasta (hand movements), sthaana (body postures), and chaari (leg movements). Although numerous, Natyashastra codifies 108 karanas, showcased in the intricate stone carvings adorning the Nataraj temples of Chidambaram, where Lord Shiva’s association with these movements is depicted. Automating pose identification in Bharatanatyam poses challenges due to the vast array of variations, encompassing hand and body postures, mudras (hand gestures), facial expressions, and head gestures. To simplify this intricate task, this research employs image processing and automation techniques. The proposed methodology comprises four stages: acquisition and pre-processing of images involving skeletonization and Data Augmentation techniques, feature extraction from images, classification of dance poses using a deep learning network-based convolution neural network model (InceptionResNetV2), and visualization of 3D models through mesh creation from point clouds. The use of advanced technologies, such as the MediaPipe library for body key point detection and deep learning networks, streamlines the identification process. Data augmentation, a pivotal step, expands small datasets, enhancing the model’s accuracy. The convolution neural network model showcased its effectiveness in accurately recognizing intricate dance movements, paving the way for streamlined analysis and interpretation. This innovative approach not only simplifies the identification of Bharatanatyam poses but also sets a precedent for enhancing accessibility and efficiency for practitioners and researchers in the Indian classical dance.https://doi.org/10.1038/s41598-024-58680-w |
| spellingShingle | J. Jayanthi P. Uma Maheswari AI and augmented reality for 3D Indian dance pose reconstruction cultural revival Scientific Reports |
| title | AI and augmented reality for 3D Indian dance pose reconstruction cultural revival |
| title_full | AI and augmented reality for 3D Indian dance pose reconstruction cultural revival |
| title_fullStr | AI and augmented reality for 3D Indian dance pose reconstruction cultural revival |
| title_full_unstemmed | AI and augmented reality for 3D Indian dance pose reconstruction cultural revival |
| title_short | AI and augmented reality for 3D Indian dance pose reconstruction cultural revival |
| title_sort | ai and augmented reality for 3d indian dance pose reconstruction cultural revival |
| url | https://doi.org/10.1038/s41598-024-58680-w |
| work_keys_str_mv | AT jjayanthi aiandaugmentedrealityfor3dindiandanceposereconstructionculturalrevival AT pumamaheswari aiandaugmentedrealityfor3dindiandanceposereconstructionculturalrevival |