Skip to content
mik07005Public

About

RAVONA – A modular AI desktop assistant powered by Gemini, Whisper, and ElevenLabs. Built with FastAPI and React with support for voice interaction, automation tools, long-term memory, and AI agents.

Resources

Stars

0 stars

Watchers

0 watching

Forks

Latest commit

 

History

24 Commits

Folders and files

NameName
Last commit message
Last commit date
 
 
 
 

Repository files navigation

🤖 RAVONA AI Assistant

RAVONA stands for:

Real-time Autonomous Virtual Operational Neural Assistant

RAVONA is a modular AI-powered desktop assistant designed to perform intelligent conversations, automate tasks, and assist users through voice, gestures, and text interaction.

At the heart of RAVONA is NOVA, the AI assistant that interacts naturally with users through voice commands and computer vision.


✨ Current Features

🎙️ Voice Assistant

  • Google Gemini integration
  • Wake word activation
  • Conversation mode
  • Sleep mode
  • Context-aware responses

🖐️ Gesture Control

  • Hand tracking using MediaPipe
  • Open Palm gesture detection
  • Navigation Mode
  • Next Window gesture
  • Previous Window gesture
  • Task View gesture
  • Gesture cooldown system

🖥️ Desktop Automation

  • Window navigation
  • Windows Task View integration

🚀 Planned Features

  • Voice interaction (Speech-to-Text + Text-to-Speech)
  • Modern desktop UI
  • Cursor control using hand gestures
  • File management and automation
  • Web search tools
  • Long-term memory system
  • AI agents for task planning
  • Knowledge retrieval (RAG)
  • Vision understanding
  • Smart desktop automation

🛠️ Tech Stack

Backend

  • Python
  • FastAPI
  • Google Gemini API

Computer Vision

  • OpenCV
  • MediaPipe

Automation

  • PyAutoGUI

Frontend (Planned)

  • React
  • Tailwind CSS
  • Electron / Tauri

AI Components

  • Gemini LLM
  • Whisper (Speech Recognition)
  • ElevenLabs (Voice Output)

📂 Project Structure

ravona/
│
├── backend/
│   ├── modules/
│   │   ├── gesture/
│   │   ├── voice/
│   │   └── ...
│   │
│   ├── app.py
│   └── test_gesture.py
│
├── frontend/        # Planned
│
└── README.md

📈 Current Progress

Module Status
Gemini Integration ✅ Complete
Wake Word ✅ Complete
Conversation Mode ✅ Complete
Sleep Mode ✅ Complete
Gesture Navigation ✅ Complete
Window Automation ✅ Complete
Cursor Control 🚧 In Progress
Vision Module 📅 Planned
Memory System 📅 Planned
Desktop UI 📅 Planned

🎯 Vision

RAVONA aims to evolve into a fully capable personal AI assistant capable of understanding voice, vision, gestures, and user intent while autonomously performing tasks across multiple systems.

NOVA serves as the intelligent interface between the user and the RAVONA platform, providing a natural, hands-free computing experience.


👨‍💻 Developer

Mohammed Intekhab Khan

B.Tech CSE (AI & ML)

VIT-AP University


⭐ If you like this project, consider giving it a star on GitHub!

About

RAVONA – A modular AI desktop assistant powered by Gemini, Whisper, and ElevenLabs. Built with FastAPI and React with support for voice interaction, automation tools, long-term memory, and AI agents.

Resources

Stars

0 stars

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages