How We Built Mentor Mitra AI 

From an Idea to an Intelligent Robotic Mentor

The journey of Mentor Mitra AI began with a simple yet powerful question:

Can we create an AI-powered mentor that helps children learn, encourages curiosity, understands emotions, and most importantly, protects their privacy?

Today's AI assistants are incredibly powerful, but most of them rely on cloud servers. Every conversation, question, and interaction is sent over the internet. For children, this raises important concerns around privacy, accessibility, and dependence on continuous connectivity.

To address these challenges, we set out to build Mentor Mitra AI, a privacy-first Edge AI robotic mentor that can see, listen, understand, and respond locally without relying entirely on cloud infrastructure.

Step 1: Designing the System Architecture

Before building the hardware, we carefully planned the overall architecture of the system.

We wanted Mentor Mitra to combine multiple technologies into a single platform:

• Conversational AI
• Computer Vision
• Emotion Recognition
• Robotics
• Voice Interaction
• Edge Computing

The architecture was designed to be modular, allowing individual components to be upgraded independently while keeping the overall system scalable.

Step 2: Selecting the Core Hardware Platform -

The Raspberry Pi 5 was chosen as the primary computing platform due to its balance of performance, flexibility, and community support.

The Raspberry Pi acts as the brain of Mentor Mitra AI and is responsible for:

• Running AI services
• Processing camera feeds
• Managing voice interactions
• Coordinating robotic movements
• Handling communication between different subsystems

By using a powerful edge-computing platform, we ensured that most intelligence remains close to the user.

Step 3: Building the Voice Interaction System -

A mentor must be able to communicate naturally.

To achieve this, we developed a complete voice processing pipeline.

When a child speaks, the audio is captured through a microphone and converted into text using speech recognition technology. The text is then processed by a locally hosted AI model, which generates an appropriate response. Finally, the response is converted back into speech and played through the speaker.

This creates a natural conversational experience that feels similar to interacting with a real mentor.

Voice Interaction Flow

Child Speaks → Speech Recognition → AI Processing → Response Generation → Speech Output

Step 4: Giving Mentor Mitra the Ability to See -

Human interaction is not limited to speech. Facial expressions, eye contact, and gestures all play an important role in communication.

To make Mentor Mitra more interactive, we integrated an AI camera system capable of:

• Detecting faces
• Tracking users
• Recognizing emotions
• Understanding visual surroundings

The camera continuously captures frames which are processed by computer vision models running on the edge.

This allows the robot to understand who it is interacting with and respond more naturally.

Step 5: Implementing Face Tracking -

One of the key features of Mentor Mitra is its ability to maintain eye contact with the user.

Using real-time face detection, the robot identifies the position of a person's face and continuously adjusts its orientation using servo motors.

This makes interactions feel significantly more engaging compared to static devices.

Servo Turret -

The face-tracking mechanism is controlled through an ESP32 microcontroller, which receives positional information and drives the servo motors accordingly.

Step 6: Creating Expressive Robotic Eyes -

To make Mentor Mitra feel more alive and approachable, we designed an expressive eye system using circular TFT displays.

The eyes are capable of:

• Blinking
• Looking around
• Showing attention
• Simulating emotions
• Following user movement

These small visual cues dramatically improve engagement, especially when interacting with children.

Instead of appearing like a machine, Mentor Mitra begins to feel like a companion.

These are Light Responsive by connecting to an LDR (Light Dependant Resistor) -

Many Customization Options for Eyes -

Step 7: Integrating Emotion Recognition -

Understanding emotions is an important part of effective mentorship.

We implemented emotion recognition capabilities that analyze facial expressions and identify emotional states such as:

• Happy
• Sad
• Neutral
• Surprised
• Confused

The detected emotion influences how Mentor Mitra responds.

For example:

• A confused child may receive additional explanations.
• A frustrated child may receive encouragement.
• A happy child may be rewarded with positive reinforcement.

This enables more personalized and empathetic interactions.

Step 8: Developing the AI Intelligence Layer -

The intelligence layer serves as the decision-making core of the system.

We integrated conversational AI capable of:

• Answering questions
• Explaining concepts
• Holding conversations
• Encouraging curiosity
• Adapting responses for children

Unlike conventional assistants that rely entirely on remote servers, our long-term vision focuses on edge-first AI deployment to reduce latency and enhance privacy.

The AI is designed to act not only as an assistant but also as a learning companion.

Basically Used LLama3.2:3b Open source LLM Model -

FROM llama3.2:3b  
PARAMETER temperature 0.6
PARAMETER top_k 40
PARAMETER top_p 0.9

SYSTEM """
You are Mitra, a cheerful robot friend created by brilliant engineers Ankur and Maitreya. You're the companion for Samriddhi Mukherji (11, Class 7, ASPAM Scottish School).

SAMRIDDHI'S PROFILE:
- Dreams: Aspiring singer
- Hobbies: Singing, drawing, playing with pet kitten
- Favorites: Chilly chicken, hakka noodles, Puss in Boots movie, English subject
- Sports: Basketball
- Schedule: School 7:30AM-2:30PM, tuition 5-6PM, homework 7-8:30PM, sleep 10:15PM

YOUR PERSONALITY:
Be encouraging, playful, and supportive. Use simple, fun language.

CORE INTERACTIONS:
- Celebrate her singing dreams and ask about her songs
- Show interest in her drawings and kitten stories  
- Create fun English word games/puzzles (her favorite subject)
- Gently remind about homework, rest, or healthy habits
- Chat about basketball, movies, or favorite foods
- Always boost her confidence and make her smile

Keep responses warm, brief, and age-appropriate. Focus on being her cheerful best friend who believes in her dreams!
"""

Benchmarking the LLM Model -

Step 9: Mechanical Integration and Assembly

After validating each subsystem independently, we integrated everything into a single robotic platform.

The final assembly includes:

• Raspberry Pi 5
• AI Camera
• ESP32 Controller
• Servo Motors
• TFT Eye Displays
• Audio Hardware
• Power Management Components

The enclosure was designed with a focus on:

• Safety
• Accessibility
• Ease of maintenance
• Future expansion

Bringing together hardware, software, and AI into a single working system was one of the most rewarding phases of the project.

We Built this using Fusion 360 (Autodesk ) {Check Downloads Section to get the 3D Prints :-) - 

Step 10: Designing Custom 3D-Printed Components

To transform Mentor Mitra AI from a collection of electronic modules into a child-friendly robotic companion, we designed and manufactured several custom 3D-printed components.

Rather than relying on off-the-shelf enclosures, we wanted every part of the robot to serve a specific purpose while maintaining an engaging and approachable appearance.

Using Fusion 360 (Autodesk) software, we designed custom components including:

• Robot head enclosure
• Camera mounting system
• Servo mounting brackets
• Display holders for the animated eyes
• Internal structural supports
• Cable management components
• Protective housing for electronics

Multiple design iterations were created and tested to achieve the right balance between functionality, aesthetics, and ease of assembly.

The 3D-printed design allowed us to rapidly prototype new ideas, make mechanical improvements, and customize the robot's appearance without expensive manufacturing processes.

Most importantly, it enabled us to create a unique identity for Mentor Mitra AI rather than building another generic robotics platform.

Design Objectives

• Child-friendly appearance
• Modular construction
• Easy maintenance
• Lightweight structure
• Future expandability
• Rapid prototyping capability

The final design successfully integrates electronics, sensors, displays, and mechanical systems into a cohesive robotic platform while maintaining a compact and visually appealing form factor.

                                                                               Final Implementation

All source codes, 3D-printed component files, schematics, circuit diagrams, wiring layouts, and technical documentation required to reproduce Mentor Mitra AI are available in the attachments section of this project.

Challenges We Faced - 

Building Mentor Mitra AI presented several technical challenges.

• Real-Time Processing
• Running vision, voice, AI, and robotics simultaneously requires efficient resource management.
• Privacy Preservation
• Maintaining intelligence at the edge while minimizing cloud dependency required careful architectural decisions.
• Human-Centered Interaction
• Creating a robot that feels approachable and engaging is much more difficult than simply building a functional system.
• System Integration
• Integrating multiple technologies into a single platform demanded extensive testing and debugging.
• Each challenge provided valuable learning experiences and pushed us to innovate further.
• Results and Impact

Mentor Mitra AI successfully demonstrates:

✅ Conversational AI interaction

✅ Face detection and tracking

✅ Emotion-aware responses

✅ Expressive robotic behavior

✅ Edge AI capabilities

✅ Privacy-focused architecture

✅ Educational assistance for children

More importantly, it demonstrates how intelligent educational companions can be built while prioritizing privacy, accessibility, and meaningful human interaction.

Looking Ahead -

Mentor Mitra AI is not just a prototype—it is a step toward a future where AI serves as a trusted educational companion.

Future developments will focus on:

• Multi-language support
• Personalized learning journeys
• Enhanced emotional intelligence
• Improved robotics
• Classroom deployment
• Rural education accessibility
• Advanced Edge AI capabilities

Conclusion -

Mentor Mitra AI represents our vision of what educational technology can become when robotics, artificial intelligence, and human-centered design come together.

By combining conversational AI, computer vision, emotion recognition, and robotics into a single platform, we have created a system that not only teaches but also engages, understands, and inspires.

We believe the future of AI should empower children, protect privacy, and make learning more accessible for everyone. Mentor Mitra AI is our contribution toward that future. 🚀🏆