Part 2) Smart Agentic Voice-Controlled Assistive Device

Published Jun 13, 2026
 50 hours to build
 Intermediate

A hands-free wearable that transforms any smartphone into an intelligent guide for the blind. Features: agentic memory to find lost objects, indoor navigation with turn verification, real-time obstacle alerts, text & food recognition, and scene description – all for under ₹600.

display image

Components Used

Arduino Uno R3
Main microcontroller board that reads distance data from ultrasonic sensors and activates the buzzer when an obstacle is detected within 50cm.
1
Description

For part 1 click here :- https://www.electronicwings.com/users/PrinceJha/projects/6571/smart-agentic-voice-controlled-assistive-device-for-the-visually-impaired

 

step 4:- Wiring Schematic

 

 

 

 

 

Pin Connection Table

 

ComponentVCCTRIGECHOGNDOther
Top Sensor5VD9D8GND-
Bottom Sensor5VD6D5GND-
Buzzer---GNDPositive (+) → D11

Top Sensor (HC-SR04):
 VCC  → 5V
 TRIG → D9
 ECHO → D8
 GND  → GND

Bottom Sensor (HC-SR04):
 VCC  → 5V
 TRIG → D6
 ECHO → D5
 GND  → GND

Buzzer (5V Active):
 Positive (+) → D11
 Negative (-) → GND

Power (OTG from Phone):
 OTG 5V  → VIN (or 5V pin)
 OTG GND → GND

 

Step 5:- Hardware Mounting on Outer Rectangle

"All electronic components are mounted on the outer rectangle. The inner rectangle (inside pouch) only provides structural support."

Component Placement Overview

 

ComponentPosition on Outer Rectangle
ArduinoCenter - secured with screws or double-sided tape
Top ultrasonic sensorUpper front - 0° straight forward
Bottom ultrasonic sensorLower front - 30° downward angle
BuzzerConnect to arduino
OTG cableSide - connects to phone
Battery/powerNot needed - powered by phone via OTG

 

Step 6 :- Upload Arduino Code

  • Step 6.1: Download & Install Arduino IDE
Arduino IDE website (arduino.cc)"Download Arduino IDE from official website"
 Select Windows/Mac/Linux version
 Installation completed

Step 6.2: Open the Code

 

#Action
1Download   from GitHub https://github.com/clod9344-cloud/Global_blind_device.git
2Open Arduino IDE
3File → Open → Select the .ino file
Tools → Board → Arduino Uno"Select Arduino Uno as board"
Tools → Port → COMx (Arduino)"Select correct COM port"
Click Upload button (→ icon)"Click Upload to flash code"
 "Done uploading" message appears

 

 

 

Block Quote:

✅ Success: "When 'Done uploading' appears and Serial Monitor shows distance readings, your Arduino is programmed correctly. The buzzer will sound differently for obstacles (3 short beeps) vs stairs (1 long beep)."

 Weight of the device 

*"The complete device weighs approximately 280 grams including the smartphone. Without phone, the hardware enclosure is under 100 grams. This lightweight design ensures comfortable all-day wear without neck strain."*
 

 

 

 

ConfigurationWeight
Hardware only (Arduino + sensors + enclosure)~80 grams
Hardware + Smartphone~280 grams

 

 

 

                                                          CONCLUSION

What We Built

VisionAssist AI transforms a standard smartphone and ₹540 worth of components into a hands-free wearable for visually impaired users.

The 7 Core Features

 

#FeatureWhat It DoesInternet Needed?
1Obstacle DetectionUltrasonic sensors detect walls, steps, curbs. Buzzer sounds instantly.NO
2Traffic Light DetectionDual verification (AI + HSV color) tells user when safe to cross.PARTIAL (HSV offline)
3Indoor NavigationDual-index system guides through corridors with pre-recorded routes.YES
4Find AnythingMemory check → camera search → 360° scan until object found.YES
5Analyze SceneAI describes everything in front: people, furniture, exits.YES
6Food DetectionCamera at plate identifies food items.YES
7Agentic MemoryRemembers object locations in local JSON. No API cost for repeat queries.YES

What Makes This Different

 

FeatureVisionAssistWhy It's Different
Indoor Navigation✅ Dual-index systemWorks in blurry corridors with pre-recorded routes
Find Anything✅ Search any object by nameNot limited to pre-trained objects. "Find my red charger" works
Agentic Memory✅ Removes API wasteRemembers object locations. Ask twice → answer from memory
Obstacle Detection✅ Ultrasonic + buzzerWorks offline. Instant alert without internet
Cost₹54099.8% cheaper than dedicated devices
Open SourceAnyone can build or modify

 

Honest Limitations

 

FeatureLimitation
Indoor NavigationWorks with pre-recorded routes only. Real-time SLAM is future work
Find AnythingRequires internet for AI vision to identify objects
Internet DependencyFeatures 2-6 need internet. Only obstacle detection and agentic memory work offline
Cloud CostGroq API cost varies by usage. Estimate ~$12-15/month for 1000 light users

Cost & Weight

 

MetricValue
Hardware cost (Arduino + sensors + buzzer)₹540
Weight with smartphone280 grams
Weight without smartphone~80 grams

Real-World Validation

"This should not just be a project. People like me actually need this."
— Visually impaired user

The Big Picture

VisionAssist AI proves assistive technology can be affordable. ₹540. 7 core features. Indoor navigation and Find Anything set it apart. Obstacle detection works offline. Open source. A step toward democratizing independence.

"Technology should lift people up, not price them out."

 


✅ Future Updates 

 

 

LimitationFuture FixEstimated Cost
Internet needed for AIOn-device TinyML (Edge Impulse or TensorFlow Lite)₹0 (software only)
Document stored on cloudLocal encrypted database (SQLite + AES)₹0
USB OTG cableBluetooth module (HC-05)₹500

 

 

"These three upgrades will make VisionAssist AI fully offline, secure, and wireless — while keeping total cost under ₹1,000."

NGO Deployment Plan

Cost Per User (Honest)

ItemCost
Hardware (one time)₹540
API per month₹50-200 (usage based)
Software₹0 (open source)
Self-hosted Month 7+₹15-30/user/month
OrCam comparison₹3,00,000
We save95-99%

Deployment Phases

PhaseUsersTimeTotal CostFunding
Pilot10Month 1-3₹9,900Rotary Club
Scale100Month 4-6₹2,34,000/yearTata Trusts / Infosys
Self-Hosted500+Month 7+₹3.3-4.5 lakh/yearADIP Scheme

Scale vs OrCam

UsersOur CostOrCam Cost
10₹9,900₹30 lakh
100₹2.34 lakh₹3 crore
28,500₹7 crore₹855 crore

Key Facts

PointStatus
Software✅ ₹0 open source
API cost✅ Real, included in all numbers
ADIP Scheme✅ ₹20,000/person/year already allocated
Volunteer support✅ 1 volunteer per 30 users
GitHub deployment✅ Any NGO can deploy independently

PART 1 LINK :- https://www.electronicwings.com/users/PrinceJha/projects/6571/smart-agentic-voice-controlled-assistive-device-for-the-visually-impaired
 

 

 

Codes

Downloads

Schematic_view_pdf Download

Institute / Organization

Jspm
Comments
Ad