NavEye_V1 – Your AI Guide Beyond Sight

The NavEye V1 is a groundbreaking assistance technology designed to help people with visual impairments navigate more independently and interact better with their surroundings. This system boasts a range of features, including smart navigation, object recognition, optical character recognition for text reading, facial recognition, voice control, an SOS function, and an intelligent AI assistant.

Inspiration

Problem 1: –

For people with visual impairments, one of the challenges is identifying drugs when there’s no packaging designed specifically for them. Drug labels are usually small and not easily readable by touch, and instructions aren’t available in audio format either.

In many real-life situations, users rely on others or try to guess based on the shape and size of objects.

An analysis conducted on patients with visual impairment suggests that most face significant difficulties in managing medications. This was demonstrated by the participants' inability to accurately locate their drugs, missing doses, and even taking incorrect quantities of the medications. The majority lacked a proper system for managing their drugs.

Problem 2: –

Navigation happens to be among the greatest problems faced by visually impaired people. Lack of appropriate tactile guidance or audio assistance in both private and public areas such as offices, homes, and streets poses great problems when navigating. Even little things such as furniture pose significant problems and sometimes they step on objects and it gets broken.

Problem 3:-

It’s difficult to find items like keys, bottles, edible objects, or tools on a table without the ability to see. Many people with visual impairments rely on their memory or sense of touch to locate objects, but this isn’t very efficient.

AI-based object detection technologies are designed to help visually impaired individuals find their belongings by utilizing voice and camera functions.

Solution to all these problems = Naveye_v1

• Key FeaturesSmart Navigation – Helps users move safely by identifying paths and obstacles.
• Object Detection – Recognizes and identifies objects in the vicinity in real time.
• OCR Text Reading – Reads printed text, signs, labels, and documents aloud.
• Face Recognition & Learning – Identifies known individuals and can learn new faces.
• AI Assistant – Answers questions, provides information, and helps with daily tasks.
• SOS Emergency System – Sends alerts and emergency notifications when assistance is needed.
• Real-Time Audio Feedback – Provides spoken instructions and notifications via a speaker
• Portable & Battery Powered – Designed for everyday use with a compact and mobile form factor.
• Image translation – Extracts text from images and translates it into the user’s preferred language.

• Voice Translation – Translates spoken language in real time, enabling communication across different languages.

  
  How Each Mode Helps Visually Impaired Users
   

1. AI Mode

Features: -

1. Gemini 3.5 flash AI model support

2. Realtime conversation between user and AI

3. Supports over 100 languages

4. Translation via audio and image

Providing responses

1. Audio output via speaker

   Continuous Mode/Navigation Mode

Feature: –

1. Detects obstacles while walking.

2. Announces nearby objects.

3. Reads signs and text automatically.

4. Provides hands-free assistance.

5. Improves safety and independence.

Face Recognition Mode: –

Feature: –

1. Announces who is standing in front of them.  
Announces who’s present in front of them.

2. Distinguishes between known and unknown people.

3. Improves confidence in social interactions.

4. Supports secure identification in both public and private spaces.

How it works (practically):-

1. The user long-presses the “Add New Face” button.

2. The user says the name: Example = Kartik

3. The camera captures a sample.

4. The system extracts the name “Kartik” from the audio and saves the image with that name.

5. Later recognition Gemini 3.5 flash AI compares live faces with stored profiles

6. If the person is matched with a stored image, the speaker says the person's name [ kartik ]

SOS Emergency Mode :-

How it works (in practice):

1. The user presses the SOS button or issues a trigger command.

2.Camera captures some image

3.Sends alerts via email along with related images

4.Notifies emergency contacts instantly

5. Plays a loud alert sound or voice message [SOS Sent]

How it helps visually impaired users:-

1. Quick help in case of accidents or getting lost

2. Easy one-step emergency calling

3. Reduces reliance on others during crises

Image of components used: –

Step 1 (Cutting the female header pins):-

Trim the header pins to match the number of pins on the component.

Exampel：-

Step 2: (Placing and soldering the header pin)

Place all the pins there, and solder them onto the perf board.

Exampel:-   

Step 3 (placing other components and soldering all components)

Place other components (TP4056 and Mt3608 Buck converter and buttons)

Example:-  

Solder the component according to this circuit diagram

Step 4 ( placing all the main component)

Place all the main component on the circuit board 

Exampel:-

Now your circuit board is completed 

ESP32 S3 tiny firmware 

Install the ESP32 Board Package (Board Manager)

1. Open Arduino IDE → File → Preferences.
2. In Additional Boards Manager URLs, add:

https://raw.githubusercontent.com/espressif/arduino-esp32/gh-pages/package_esp32_index.json

1. Click OK.
2. Go to Tools → Board → Boards Manager….

3. Search “ESP32” and install esp32 by Espressif Systems (latest).

   

   

    

Tip: After install, restart Arduino IDE if the boards list doesn’t refresh.

1. Open the provided NaveEye_V1 sketch into Arduino IDE.
2. Go to Tools → Board → ESP32 → Waveshare ESP32-S3-Zero
3. Connect your ESP32-S3 to the PC with USB-C.
4. Under Tools → Port, choose the correct COM port.
5. Under Tools → USB CDC On Boot → Enable
6. IN code you have to put all wifi credentials and server ip which we show how to get it after 

7. 

    

   python server firmware

First we have to install thonny ide for server 

1. open https://thonny.org/ in your browser
2. then install it accroding to your operating system
3. then open thonny and import the Naveye_v1 server code 

4. and click on run it automatically download all the pip / libraries

   

5. In shell you will see server  copy ip and paste it in esp32s3 code
6. your server is ready 

ESP32CAM firmware

1. Open the provided NaveEye_V1 cam sketch into Arduino IDE.

2. Go to Tools → Board → ESP32 → Waveshare ESP32-CAM

   

3. Then click to upload
4. Now your Naveeye_v1 code part is done