Recognition for American Sign Language letters based on AutoML platform

Huaiyuan Gai; Jian Xie

doi:10.1117/12.2641065

13 October 2022 Recognition for American Sign Language letters based on AutoML platform

Huaiyuan Gai, Jian Xie

Proceedings Volume 12287, International Conference on Cloud Computing, Performance Computing, and Deep Learning (CCPCDL 2022); 122870B (2022) https://doi.org/10.1117/12.2641065
Event: International Conference on Cloud Computing, Performance Computing, and Deep Learning (CCPCDL 2022), 2022, Wuhan, China

Abstract

The advent of sign language has given the deaf a more accurate and convenient way to express themselves, but not everyone knows sign language. Hearing-impaired and deaf people still find it difficult to communicate with normal people without interpreters. Therefore, the application of computer vision technology to America Sign Language letter (ASL) recognition will greatly facilitate such silent communication. However, the development of ASL recognition programs requires engineers to have extensive knowledge of sign language, which is very difficult to achieve. To solve this limitation, our study applied automatic machine learning (AutoML) technology to ASL recognition based on the Google Cloud Platform (GCP). Firstly, we standardized the labels and augmented some of the images. Subsequently, the preprocessed data set was used to train the motion detection model. During training the model, we built and normalized the model to improve the accuracy of the model. Finally, the accuracy and recall rate of the proposed method achieved 99.5% and 92.7%, respectively. In addition, the model was also deployed to an Android system for testing.

Citation Download Citation

Huaiyuan Gai and Jian Xie "Recognition for American Sign Language letters based on AutoML platform", Proc. SPIE 12287, International Conference on Cloud Computing, Performance Computing, and Deep Learning (CCPCDL 2022), 122870B (13 October 2022); https://doi.org/10.1117/12.2641065

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available