Kübra Terzi

The American Sign Language (ASL) plug-in for iOS is a project we created to help deaf people communicate online.

Since sign language has a different grammar, it is not possible to translate word for word into the spoken language. We have designed a plug-in that helps deaf people not only to write grammatically correct sentences, but also to convert written texts into animated signs.
We also have created a product video to show how the plug-in works.

The ASL plug-in replaces the normal keyboard to be able to use it for sign language. It records the signs using the tablet's camera and uses motion tracking to recognize the signs. Artificial intelligence (AI) is then used to create grammatically correct sentences from the recognized signs. In addition, the user can distinguish between formal speech and slang. Therefore, with the ASL plug-in, one can not only chat with friends, but also compose formal emails. Moreover, the user can delete the last gesture or jump to the next line by simple gestures.

Messages or emails received from others can be visualized as animated sign language videos with the help of AI text recognition. This way, written texts are translated into correct american sign language.