Comparative study on the effect of HSV Segmentation and ORB Features on Transfer Learning models for recognition of Bharatanatyam Asamyukta Mudras
Divisha Kilari, Dr. Krishna Kumar Singh · 2023
Bharatanatyam is a classical dance form that originated in the state of Tamil Nadu, India, and is widely recognized for its intricate hand gestures, body movements, facial expressions, and background music. It is a vibrant and colorful dance style that has been passed down from generation to generation, and its popularity has only grown over the years. One of the unique aspects of Bharatanatyam is its use of hand gestures, or mudras, which are essential in telling a story through the dance. These gestures are symbolic, and each mudra has a specific meaning. However, due to their complex nature, it can be challenging for the untrained eye to understand their significance. To address this issue, researchers have recently generated a dataset of Bharatanatyam hand gestures and explored ways to recognize them using transfer learning techniques. The dataset consists of 28 classes of single hand gestures used in Bharatanatyam to convey a story. In this study, four transfer learning models were used to classify the images into 24 different classes: VGG16, VGG19, MobileNet, and RESNET-50. Transfer learning is a machine learning technique that uses pre-trained models to accelerate the learning process for a new task. It involves using a model that has been trained on a large dataset, and then fine-tuning it to recognize a new set of images. The results of the study showed that deep learning algorithms achieved up to 74% accuracy in recognizing the hand gestures. This is a promising result, as it demonstrates that transfer learning techniques can be effective in recognizing Bharatanatyam hand gestures.The hand gestures were segmented using the HSV Model, which is a color space model that separates image color information into hue, saturation, and value components. Features were then extracted using the ORB Model, which is a feature extraction technique that detects and describes key points in an image. The study found that when hand mudras were segmented and extracted in this manner, the accuracy of hand gesture recognition improved. In particular, the ResNet- 50 model performed better than the other transfer models, VGG16, VGG19, and MobileNet. This study is the first attempt to generate a dataset of Bharatanatyam hand gestures and apply transfer learning techniques to recognize them. It highlights the potential of these techniques in preserving and promoting the rich cultural heritage of Indian classical dance. By making Bharatanatyam more accessible and understandable to a wider audience, this study could help to increase appreciation and understanding of this ancient art form. It could also lead to the development of tools and applications that make it easier for people to learn and perform Bharatanatyam. In conclusion, the use of transfer learning techniques in recognizing Bharatanatyam hand gestures is a promising development. It could have far-reaching implications for the preservation and promotion of Indian classical dance, and it could help to ensure that this beautiful art form continues to be enjoyed for generations to come.