VocalSign

With the goal to make sign interpreter more accessible and affordable, we built this app called VocalSign which translates in real-time sign language into voice, text & image and more importantly, users can teach it by making 2 video examples per sign.

The app mainly consists of a sign language dictionary which contains all the signs it can recognize. Users enrich the dictionary by adding vocabulary, either words or phrases, and specify for each item, an image to display when signing, whether it uses one hand or two hands and whether it is a hand action or hand pose.

Then, the app asks its users to sign the added word or phrase twice. This process of learning makes the app capable of translating all sign languages including over 300 existing ones. When items are deleted from the dictionary, the app will forget them.

Moreover, we also integrated into the software a voice transcription service which supports over 30 languages. There are pre-made sign language vocalizers in the app so the user doesn't need to teach it from scratch and each user can enrich it with new records. Each user can delete inaccurate records, so that only the correct ones are in the dictionary.