Intelligent System for the Learning of Sign Language Based on Artificial Neural Networks

D. Rivas, Marcelo Alvarez V, J. Guanoluisa, M. Zapata, E. Garcés, M. Balseca, J. Perez, R. Granizo

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Sign language has become a form of communication for people who have some type of hearing impairment, in order to relate to the world around him and perform daily activities including education, work performance and personal development. In the knowledge society, the development of new Technologies for Information and Communication (TIC), they constitute a teaching tool that changes the conditions for learning and communication as the world is digitized. Therefore, the development of an Ecuadorian sign language learning system based on the use of a gesture sensor and an artificial neural network multilayer feed-forward, implementing the Backpropagation algorithm, which takes advantage of the parallel property of decreasing the time required by a processor to distinguish the existing relationship between given patterns, represents a solution for improving the teaching-learning process. The system consists of three main layers: The first is responsible for the acquisition of data through a gestural device; the second uses the library of the gesture sensor to perform the acquisition and storage of information of the hand and the position of the fingers. Finally, the output layer, once the training of the neuron is analyzed, generates the real-time recognition of sign language.

Original languageEnglish
Title of host publicationAugmented Reality, Virtual Reality, and Computer Graphics - 6th International Conference, AVR 2019, Proceedings
EditorsLucio Tommaso De Paolis, Patrick Bourdot
PublisherSpringer Verlag
Pages310-318
Number of pages9
ISBN (Print)9783030259983
DOIs
StatePublished - 2019
Event6th International Conference on Augmented Reality, Virtual Reality and Computer Graphics, SALENTO AVR 2019 - Santa Maria al Bagno, Italy
Duration: 24 Jun 201927 Jun 2019

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume11614 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference6th International Conference on Augmented Reality, Virtual Reality and Computer Graphics, SALENTO AVR 2019
Country/TerritoryItaly
CitySanta Maria al Bagno
Period24/06/1927/06/19

Bibliographical note

Publisher Copyright:
© 2019, Springer Nature Switzerland AG.

Keywords

  • Artificial neural networks
  • CSCL
  • Leap Motion
  • Pattern recognition

Cite this