RAVONA stands for:
Real-time Autonomous Virtual Operational Neural Assistant
RAVONA is a modular AI-powered desktop assistant designed to perform intelligent conversations, automate tasks, and assist users through voice, gestures, and text interaction.
At the heart of RAVONA is NOVA, the AI assistant that interacts naturally with users through voice commands and computer vision.
- Google Gemini integration
- Wake word activation
- Conversation mode
- Sleep mode
- Context-aware responses
- Hand tracking using MediaPipe
- Open Palm gesture detection
- Navigation Mode
- Next Window gesture
- Previous Window gesture
- Task View gesture
- Gesture cooldown system
- Window navigation
- Windows Task View integration
- Voice interaction (Speech-to-Text + Text-to-Speech)
- Modern desktop UI
- Cursor control using hand gestures
- File management and automation
- Web search tools
- Long-term memory system
- AI agents for task planning
- Knowledge retrieval (RAG)
- Vision understanding
- Smart desktop automation
- Python
- FastAPI
- Google Gemini API
- OpenCV
- MediaPipe
- PyAutoGUI
- React
- Tailwind CSS
- Electron / Tauri
- Gemini LLM
- Whisper (Speech Recognition)
- ElevenLabs (Voice Output)
ravona/
│
├── backend/
│ ├── modules/
│ │ ├── gesture/
│ │ ├── voice/
│ │ └── ...
│ │
│ ├── app.py
│ └── test_gesture.py
│
├── frontend/ # Planned
│
└── README.md
| Module | Status |
|---|---|
| Gemini Integration | ✅ Complete |
| Wake Word | ✅ Complete |
| Conversation Mode | ✅ Complete |
| Sleep Mode | ✅ Complete |
| Gesture Navigation | ✅ Complete |
| Window Automation | ✅ Complete |
| Cursor Control | 🚧 In Progress |
| Vision Module | 📅 Planned |
| Memory System | 📅 Planned |
| Desktop UI | 📅 Planned |
RAVONA aims to evolve into a fully capable personal AI assistant capable of understanding voice, vision, gestures, and user intent while autonomously performing tasks across multiple systems.
NOVA serves as the intelligent interface between the user and the RAVONA platform, providing a natural, hands-free computing experience.
Mohammed Intekhab Khan
B.Tech CSE (AI & ML)
VIT-AP University
⭐ If you like this project, consider giving it a star on GitHub!