Optimization of Transfer Learning for Sign Language Recognition Targeting Mobile Platform

by   Dhruv Rathi, et al.

The target of this research is to experiment, iterate and recommend a system that is successful in recognition of American Sign Language (ASL). It is a challenging as well as an interesting problem that if solved will bring a leap in social and technological aspects alike. In this paper, we propose a real-time recognizer of ASL based on a mobile platform, so that it will have more accessibility and provides an ease of use. The technique implemented is Transfer Learning of new data of Hand gestures for alphabets in ASL to be modelled on various pre-trained high- end models and optimize the best model to run on a mobile platform considering the various limitations of the same during optimization. The data used consists of 27,455 images of 24 alphabets of ASL. The optimized model when ran over a memory-efficient mobile application, provides an accuracy of 95.03 recognition time of 2.42 seconds. This method ensures considerable discrimination in accuracy and recognition time than the previous research.


Recognizing multiclass Static Sign Language words for deaf and dumb people of Bangladesh based on transfer learning techniques

Sign language is a language used for communication of the deaf and dumb ...

Interpretation of Swedish Sign Language using Convolutional Neural Networks and Transfer Learning

The automatic interpretation of sign languages is a challenging task, as...

Sign Language Recognition System using TensorFlow Object Detection API

Communication is defined as the act of sharing or exchanging information...

A Topological derivative based image segmentation for sign language recognition system using isotropic filter

The need of sign language is increasing radically especially to hearing ...

Fast CRDNN: Towards on Site Training of Mobile Construction Machines

The CRDNN is a combined neural network that can increase the holistic ef...

A Novel Re-Targetable Application Development Platform for Healthcare Mobile Applications

The rapid enhancement of central power unit CPU performance enables the ...

Please sign up or login with your details

Forgot password? Click here to reset