UnderstandMyWorld

UnderstandMyWorld immerses you in written words to jump-start the comprehension of written English. This app serves two populations: It encourages pre-literate or partially-literate children to discover written language and learn to read, and helps literate, non-native English learners to experience spoken and written English in a natural, real-world context.

Both kinds of users can use their device’s camera and microphone to understand spoken words and read written language. Images captured by the camera are labeled and defined in both speech and writing. Players can also speak into their device to record their speech or ask questions. The app then presents the dictated words or answers to questions in both spoken and written form.

Using the required internet connection, the interface automatically provides exceedingly accurate image and speech recognition, all while preserving the participants’ anonymity. This application ensures safety for all ages of users, as indecent or offensive words will not be acknowledged in dictation or used in responses.

The application is designed to be intuitive and seamless to use. Intended to be held horizontally, the home screen displays statement, camera, and question icons on the bottom. The top icons show options for toggling selfies, flash, history, instructions, and settings. The instruction pages describe how to use the app.

When a picture is taken, it is named. The question mark (?) icon gives its definition. The next button (>) gives another name for the picture.

The speaker icon allows the user to say words aloud and have them repeated back.

The microphone icon allows users to ask questions and have them answered. Many types of questions can be asked, ranging from “Tell me about…”, “Define…” and “What is…”.

Not sure where to start? Try asking some starter questions, such as: Tell me about Sesame Street. Who is Ben Stiller? How many miles in 7 kilometers? What is the meaning of charming? Define global warming. What is the Tour de France? What is the time in Melbourne, Australia? What is 7 divided by 2? Question: 9 times 8?

The speech rate and size of the letters can be easily controlled on the settings page.

The history records the complete user’s history. This text can be copied and used in another analysis to measure your progress.

If you have any questions, suggestions, or questions, email dominic.massaro@gmail.com.