OUR ARTIFICIAL INTELLIGENCE

​

The Artificial Intelligence embedded within our product is called JOY.

Since, the targeted users of our product vary, that is, completely blind and low vision users JOY takes different forms for different users:

1. Vocal Interface: Since completely blind users cannot rely on touch and display, the AI interacts with the user through an audio output, and takes input through the mic.

2. Touch and Display: The partially blind users can now see the beautiful world around them using JoySight, through real time streaming and display it in Augmented Reality on the screen present in the lens of the spectacles. The AI takes the input, in this case, through a touch on the side touch-pads and also through a voice input.
   
                     This interface can also be used by Color blind users as well as Night blind users
   
   
    

How does JOY work?

For Completely blind users (Partially blind users can also use these):

​

1. Daily/Routine tasks: JOY will automatically remind them about their tasks through an Audio Output.

2. Navigation: Through the vocal interface the user can input the destination and JOY will guide them through audio outputs.
   
   
   
   
   
    

3. E-Banking:
   In case the user wants to transfer money from home: The user can through voice, input the name of the person he/she wants to transfer.
   Finally, the user can transfer the money using the Three Step Verification process.

   1. In case the user is in a shop, the user can easily scan the QR code of the payment method of the shop, using the Camera and Object Scanner, and transfer the money after Three Step Verification process.

4. Music: Music can be streamed by the users of JoySight. The input of the user is done through an audio input and the music will be streamed through the mono-speakers form any streaming apps downloaded in the glasses. If no such app is installed it’ll stream through partnered music company.
   
   
   
   
   
   
    

5. Security and Privacy: The glasses respect the privacy and ensures maximum security for its users. The user inputs such as any conversation the user has with another person, will not be saved or be recorded by the glasses. In case of the E-Banking feature, the user account details will be discarded, unless the user saves it, within 24 hours of the input.
   The glasses also warns the user of any stranger(If it does not recognize the face of this person) in the extreme proximity of the user during E-Banking. In case the user stores these details, it can only be accessed through the Two Step Verification

6. Face recognition: JOY has the ability to recognize the faces of the people present in the Friends, Following or the contact lists. JOY recognizes these faces by a pattern and grids it forms for itself in the pictures of the person and matches them when the camera encounters the person. The user has to store, through voice commands, the faces of the people he/she desires.

 

For Partially, Night and Color Blind Users:

1. Providing Sight:  

   1. Color Blindness: The AI, JOY, will stream all the objects around the user, from inputs from the Object Scanner and Camera, in real time. This will be displayed in the higher contrast of the deficient color of the user’s eye.

   2. Partial Blindness: Similar to color blindness, JOY, will stream in real time all the objects in the surrounding of the user, with inputs from the Object Scanner and the Camera. This display will a have a slight zoom in order to eliminate the black patches the user sees, due to the blindness and will be displayed in Augmented Reality

   3. Night Blindness:  A similar process of night blindness and color blindness is executed. Such a process happens in either dim light or in the night at a particular time set by the user. The display will have higher contrast and higher brightness and will be displayed in Augmented reality

2.  Security and Privacy: The features for the security and privacy of the user is similar to the completely blind users’ features.
    

3. E-Banking:

   1. In case the user wants to transfer money from home: The user can through touch and select option on the touch pad input the name of the person he/she wants to transfer. Finally, the user can transfer the money using the Three Step Verification process.

   2. In case the user is in a shop, the user can easily scan the QR code of the payment method of the shop, using the Camera and Object Scanner, and transfer the money after Three Step Verification process.

4. Navigation: The destination can be entered through an audio input or it can be selected through the touch pad. Once entered, our AI, JOY, will display the directions in augmented reality. The directions will be displayed with a set of arrows that will be displayed, like it is displayed on the road (On the glasses’ screen). The user has to follow it and Voila! Their destination is reached.

5. Music: Music can be streamed by the users of the Glasses. The input of the user is done through the touch-pad and the music will be streamed through the mono-speakers form any streaming apps downloaded in the glasses. If no such app is installed it’ll stream through YouTube.

6. Sightedness: We stream the near eye or far eye objects:

   1. Stream like a far hollow sphere so that the farsightedness people can see and zoom into far eye objects so that nearsightedness people can see

7. Movies and videos: The user can easily watch videos and movies. The user needs to input the type of video or the movie from the pre-selected set of movies or videos by simply touching and sliding on the touch-pad. If the user’s choice is not available, he/she must double tap the touch-pad and give a voice input to JOY. It will be streamed from the internet.

 

 

 

 

 

 

​