Implementation of a robotic hand prototype controlled with AI and machine learning as a support for the teaching of basic operations (+/-), in elementary school children with hearing difficulties

Abstract

In the present investigation, the experiences and results obtained in Nariño Itinerant
TecnoAcademia are shared according to the development of a basic device that manipulates
the structure of an artificial hand, which has a human-machine interface that responds through
artificial intelligence (AI) and machine learning. focused on the relationship of children with
sign language for the inclusion of peers with hearing disabilities in an experimental and simple
way.
In the first instance, the apprentices of the Itinerant Nariño TecnoAcademia made a prototype,
which consisted of recreating the movements of the hand through AI, with the aim of obtaining
knowledge about robotics, science and technology. After this, the prototype is taken up again
and an improvement is provided in order to use its software and physical structure to teach
basic concepts of mathematics and sign language to elementary school students through
the inclusion of children with learning difficulties, through the use of artificial intelligence, its
operation is appreciated with the recognition of Colombian sign language gestures for five
numbers, the plus sign (+), the minus sign (-) and a sign to delete the operation. This reading is
shown on the screen and in turn performs the simulation on the artificial hand, facilitating the
acquisition of knowledge and its motivational interest