Mediapipe and CNNs for Real-Time ASL Gesture Recognition

05/09/2023
by   Rupesh Kumar, et al.
0

This research paper describes a realtime system for identifying American Sign Language (ASL) movements that employs modern computer vision and machine learning approaches. The suggested method makes use of the Mediapipe library for feature extraction and a Convolutional Neural Network (CNN) for ASL gesture classification. The testing results show that the suggested system can detect all ASL alphabets with an accuracy of 99.95 in communication devices for people with hearing impairments. The proposed approach can also be applied to additional sign languages with similar hand motions, potentially increasing the quality of life for people with hearing loss. Overall, the study demonstrates the effectiveness of using Mediapipe and CNN for real-time sign language recognition, making a significant contribution to the field of computer vision and machine learning.

READ FULL TEXT

page 3

page 4

research
08/08/2014

Real-Time and Robust Method for Hand Gesture Recognition System Based on Cross-Correlation Coefficient

Hand gesture recognition possesses extensive applications in virtual rea...
research
10/20/2020

American Sign Language Identification Using Hand Trackpoint Analysis

Sign Language helps people with Speaking and Hearing Disabilities commun...
research
11/30/2018

Real Time Bangladeshi Sign Language Detection using Faster R-CNN

Bangladeshi Sign Language (BdSL) is a commonly used medium of communicat...
research
04/21/2020

Convolutional Neural Network Array for Sign Language Recognition using Wearable IMUs

Advancements in gesture recognition algorithms have led to a significant...
research
09/20/2021

Dynamic Gesture Recognition

The Human-Machine Interaction (HMI) research field is an important topic...
research
01/11/2021

A novel shape matching descriptor for real-time hand gesture recognition

The current state-of-the-art hand gesture recognition methodologies heav...
research
01/17/2019

Hand Sign to Bangla Speech: A Deep Learning in Vision based system for Recognizing Hand Sign Digits and Generating Bangla Speech

Recent advancements in the field of computer vision with the help of dee...

Please sign up or login with your details

Forgot password? Click here to reset