Skip to content
ShaDevProPublic

About

πŸš€ Sovereign, ultra-lightweight (~9 MB) AI Workstation for Windows. Run local LLMs, SDXL Cinema art, Excel analyzer, Course studio & Whisper voice 100% offline.

Resources

Stars

0 stars

Watchers

0 watching

Forks

Repository files navigation

AiWidget Logo

AiWidget

πŸš€ The Sovereign, Ultra-Lightweight (~9 MB) AI Workstation for Windows

Run local LLMs, generate photorealistic Cinema SDXL art, analyze complex spreadsheets, build interactive courses, snip screens, and chat by voice β€” Local-First by default, Air-Gapped capable, with Zero silent network calls.


License: AGPL v3 Tauri Rust TypeScript RAM Usage Privacy Platform i18n


🌐 Official Website β€’ πŸ“¦ Download v1.1.0 β€’ ✨ Feature Tour β€’ πŸ“Š Benchmarks β€’ πŸ› οΈ Developer Guide β€’ 🏒 Enterprise PRO β€’ 🀝 Contributing


πŸ“– Repository Scope & Open-Core Model

Welcome to the official open-source repository of AiWidget!

This repository contains the complete client workspace:

  • πŸ’» 100% Frontend Source Code (src/): High-performance reactive TypeScript 5.4, Vite, Web Audio, $\KaTeX$ math engine, Mermaid.js diagramming, DOM sanitization, and floating widget shells.
  • πŸ¦€ 100% Embedded Native Rust Engine (src-tauri/): High-speed C++ sd.cpp diffusion wrapper, Whisper.cpp speech recognition, neural text-to-speech, in-memory streaming Excel/PDF RAG parsers, encrypted SQLite database, and mutual cryptographic transport.

Anyone in the worldwide developer community can clone this repository, run npm run tauri:dev, inspect the code, add new AI engines, translate into new languages, optimize performance, and compile standalone binaries.

flowchart LR
    subgraph OpenSource ["🌐 Public Repository (This Repo - GNU AGPLv3)"]
        UI["TypeScript Frontend (src/)"]
        RUST["Embedded Native Rust Engine (src-tauri/)"]
        ENG["Local AI Engines (Ollama, SD.cpp, Whisper, SQLite)"]
        UI <--> RUST <--> ENG
    end

    subgraph PrivateHub ["🏒 Private Enterprise Infrastructure"]
        SERVER["On-Premise Multi-User Server (Central GPU Pool)"]
        LICENSE["HMAC License & Telemetry Console"]
    end

    RUST -.->|"Mutual Signed Cryptographic Protocol"| SERVER
Loading

⚑ The Manifesto: Why We Built AiWidget

Today, developers, professionals, and privacy-conscious users face two frustrating compromises:

  1. Cloud AI Privacy Risks (Microsoft Copilot, ChatGPT Desktop): Every prompt, proprietary source code snippet, financial spreadsheet (.xlsx), medical record, and screen snip is transmitted to third-party cloud servers. For regulated industries (lawyers, CPAs, doctors, defense, engineering), this violates GDPR, HIPAA, and legal client privilege.
  2. Bloated Electron Wrappers: Traditional open-source desktop clients consume 500 MB to 1 GB of RAM just to display a chat window, take up hundreds of megabytes on disk, and lack integrated image studios, document parsers, or course generators.

🌟 The AiWidget Breakthrough

Engineered natively in Rust & Tauri, AiWidget delivers a complete multimodal AI workstation in a discreet floating desktop widget:

  • πŸͺΆ Featherweight Footprint: 9.03 MB installer size, < 80 MB resident RAM footprint.
  • πŸ›‘οΈ Zero-Knowledge Air-Gapped Privacy: All LLM inference, OCR parsing, and database queries run 100% on your machine.
  • 🧩 True Multimodal Independence: Local LLMs, Cinema SDXL photorealistic rendering, spreadsheet financial extraction, course generation, screen snipping, and Whisper voice interaction β€” unified in one lightweight native app.

πŸ“Š Market Benchmarks

Capability AiWidget LM Studio Jan.ai AnythingLLM Microsoft Copilot
Form Factor 🟒 Floating Widget / Bar / Popup πŸ”΄ Full Window πŸ”΄ Full Window 🟑 Partial Overlay 🟒 Edge Sidebar
Installer Size 🟒 9.03 MB πŸ”΄ ~350 MB πŸ”΄ ~160 MB πŸ”΄ ~380 MB πŸ”΄ Heavy Webview
RAM Consumption 🟒 < 80 MB 🟑 ~400 MB πŸ”΄ ~450 MB πŸ”΄ ~550 MB πŸ”΄ Cloud / Webview
Data Sovereignty 🟒 100% Local (Air-Gapped) 🟒 100% Local 🟒 100% Local 🟒 100% Local πŸ”΄ Cloud Tracking
Cinema SDXL Studio (6.6 GB) 🟒 Built-in + CPU VAE Tiling πŸ”΄ No πŸ”΄ No πŸ”΄ No 🟑 Cloud DALL-E (Paid)
Fast SD 1.5 Studio (1.5 GB) 🟒 Built-in (15s renders) πŸ”΄ No πŸ”΄ No πŸ”΄ No πŸ”΄ No
Spreadsheet Intelligence (.xlsx) 🟒 Native Extraction & Sums πŸ”΄ No πŸ”΄ No 🟑 Text only 🟑 Cloud limited
Course & Training Studio 🟒 Curriculum, Quiz, Word (.docx) πŸ”΄ No πŸ”΄ No πŸ”΄ No πŸ”΄ No
1-Click Screen Snipper 🟒 Ctrl+Shift+S + OCR πŸ”΄ No πŸ”΄ No πŸ”΄ No 🟒 Cloud Vision
Whisper Voice + Neural TTS 🟒 Continuous Loop πŸ”΄ No πŸ”΄ No πŸ”΄ No 🟒 Cloud
Anti-Hallucination Web Router 🟒 Auto-Trigger on Demand πŸ”΄ No πŸ”΄ No 🟑 Paid API Key 🟒 Bing Cloud
Interactive Mermaid & LaTeX 🟒 Zoom, Fullscreen & Export 🟑 Basic code πŸ”΄ Raw text 🟑 Basic 🟑 Basic
Enterprise Server & Quotas 🟒 On-Premise Ready πŸ”΄ No πŸ”΄ No 🟑 Basic πŸ”΄ 30$/user/month

🧠 Local Model Agnosticism & Open-Source Transparency

AiWidget is fundamentally local-first, privacy-driven, and model-agnostic:

  • 🧩 Universal Local Model Support: It natively connects to any local LLM runtime via Ollama, Llama.cpp, and local GGUF models (including Qwen 2.5, Llama 3.3, Mistral, DeepSeek-R1, Gemma, and Phi-3).
  • ⚑ Hardware-Proportional Intelligence: The analytical depth, reasoning power, and token speed scale directly with your chosen local model and hardware (from lightweight 3B/7B models on standard laptops to 14B/32B/70B models on high-performance GPU workstations).
  • πŸ” 100% Open-Source & Auditable Integrity: No mandatory cloud subscriptions, no black-box API dependencies, and no hidden tracking. 100% of the desktop client source code (TypeScript + Rust) is available in this repository under the GNU AGPLv3 for full community audit and verification.

✨ Deep Feature Tour

flowchart TD
    subgraph Core ["AiWidget All-In-One Local Hub"]
        LLM["🧠 Local LLMs (Ollama / Llama.cpp)"]
        SD["🎨 Cinema SDXL + SD 1.5 Image Studio"]
        RAG["πŸ“Š Excel & PDF Financial Analyzer"]
        CRS["πŸŽ“ Interactive Course & Quiz Studio"]
        SNP["πŸ“Έ 1-Click Screen Snipper (Ctrl+Shift+S)"]
        VCE["πŸŽ™οΈ Whisper Voice Chat & Neural TTS"]
        WEB["🌐 On-Demand Anti-Hallucination Web Router"]
        SEC["πŸ” Multi-Profile Encrypted SQLite"]
    end
Loading

🎨 1. Dual-Engine Local Image Studio (Cinema SDXL & Fast SD 1.5)

Forget setting up complex 30 GB Python environments or paying monthly cloud subscriptions. AiWidget embeds a high-performance C++ (sd.cpp) diffusion pipeline directly in Rust:

  • 🎬 Cinema SDXL β€” Juggernaut XL v8 (6.6 GB):
    • Generates hyper-photorealistic 1024x1024 cinema-quality artwork, character portraits, product concepts, and architectural visualizations.
    • Automated Prompt Translation & Expansion: Type prompts in French or Arabic; AiWidget automatically translates and optimizes them into specialized Stable Diffusion positive and negative conditioning tokens (inspired by Fooocus-style cinematic presets).
    • Built-in Cinematic Styles: Photorealistic 8K, Masterpiece, Cinematic Lighting, Hyper-Detailed Skin Texture, and Anime/Digital Art presets.
  • ⚑ Rapid SD 1.5 (1.5 GB):
    • Ultra-fast generation (15–20 seconds) engineered for standard consumer laptops, older GPUs, and quick ideation.
  • πŸ›‘οΈ Smart CPU VAE Tiling Fallback (Zero OOM Crashes):
    • Traditional SDXL software crashes with CUDA Out-Of-Memory on 4 GB or 6 GB VRAM GPUs during the heavy VAE decode step.
    • AiWidget automatically detects low VRAM thresholds and offloads VAE tiling computation to system RAM, guaranteeing successful renders without crashes.
  • πŸ–ΌοΈ Interactive Image Gallery: Fullscreen modal view, instant PNG save, copy to clipboard, and generation metadata inspection (seed, steps, CFG, sampler).

πŸŽ“ 2. Interactive Course & Education Studio

A dedicated pedagogical engine designed for teachers, corporate instructors, university students, and self-learners:

  • πŸ“š Complete Curriculum Structuring: Generates structured courses tailored to any difficulty level (Beginner, Intermediate, Advanced), including learning objectives, prerequisite summaries, and module breakdowns.
  • πŸ’‘ Step-by-Step Lessons with Real-World Analogies: Breaks down abstract technical, legal, scientific, or business topics into digestible lessons illustrated with practical case studies.
  • πŸ“ Interactive Quizzes & MCQs: Automatically embeds multiple-choice questions with detailed answer keys, feedback explanations, and scoring mechanisms.
  • πŸ“„ Universal 1-Click Export:
    • Export directly to formatted Microsoft Word (.docx) with custom heading hierarchies, callout boxes, and styled tables.
    • Export to clean Markdown (.md) for seamless integration into Obsidian, Notion, or GitHub.

🌐 3. On-Demand Anti-Hallucination Web Router (Strictly User-Controlled)

Reduce hallucinations when fresh factual knowledge is required, while strictly preserving your privacy:

  • πŸ”’ Local-First by Default β€” Zero Silent Network Requests:
    • All core intelligence, LLM inference, image generation, voice chat, and document RAG run 100% locally on your device.
    • Internet access is never activated silently.
  • πŸ€– Smart Intent Detection & Explicit Permission Gate:
    • When you ask a question requiring live or time-sensitive data (e.g., "What will the weather be tomorrow in New York?", "Latest stock market indices", or "Recent software releases"), AiWidget automatically detects the intent.
    • Instead of quietly calling the network, AiWidget displays an explicit confirmation gate:
      🌐 This question requires live web information. Allow AiWidget to search the web? [Allow] [Deny]
    • You can also explicitly toggle the 🌐 Web mode button in the chat input bar whenever you want web grounding enabled.
  • πŸ” Real-Time Web Scraping & Fact Extraction:
    • When authorized, AiWidget queries public search engines in the background without transmitting user identities.
    • It strips HTML bloat, extracts relevant factual content, and injects retrieved web context into the LLM prompt.
  • πŸ”— Clickable Source Citations:
    • Web-grounded responses include direct, clickable source URLs so you can verify the information directly from the cited sources.
  • πŸ›‘οΈ Air-Gapped Capable:
    • In strictly air-gapped or high-security corporate environments, Web Search can remain permanently disabled with zero impact on local LLM, SDXL, or document analysis features.

πŸ“Š 4. Financial Spreadsheet & Document Intelligence (.xlsx / .pdf / .docx)

  • πŸ“ˆ In-Memory Streaming XLSX & CSV Parser:
    • Drag-and-drop spreadsheets, budget exports, or client estimates.
    • Automatically reconstructs tabular columns, identifies currency rows, calculates sub-totals, tax amounts, and flags discrepancies.
  • πŸ“‘ Universal PDF & DOCX Extraction:
    • Summarize multi-page legal contracts, research whitepapers, and invoices with zero cloud exposure.
  • πŸ” OCR Image Extraction:
    • Scanned invoices, receipts, and photos of paper documents are processed through our local OCR engine to extract editable text and numbers.

πŸ“Έ 5. Screen Snipper & Visual Debugging in 1 Clic

  • ⚑ Global Shortcut (Ctrl + Shift + S) & Toolbar Camera Button [πŸ“Έ]:
    • Instantly snip any open window, software error code, compiler log, or web dashboard.
  • πŸ“‹ Native Clipboard Integration:
    • Use standard Windows Win + Shift + S to grab an area, then press Ctrl + V directly in AiWidget: the image thumbnail attaches automatically.
  • πŸ‘οΈ Visual OCR & Multimodal Analysis:
    • Prompts like "Explain this stack trace", "Translate this screenshot", or "Extract this table into Markdown" work immediately with local models.

πŸŽ™οΈ 6. Whisper Voice Chat & Neural Speech Synthesis

  • 🎀 Whisper.cpp Integration: High-accuracy local speech-to-text supporting multiple accents and languages.
  • πŸ—£οΈ Neural Text-to-Speech: Crystal-clear male and female natural voices for English, French, and Arabic.
  • πŸ”„ Continuous Hands-Free Conversation Mode: Speak naturally to your assistant, listen to its vocalized answer, and have it automatically resume listening for your follow-up questions.

πŸ“ 7. Interactive LaTeX Math & Mermaid Diagrams

  • πŸ“ $\KaTeX$ Mathematical Engine: Render complex mathematical formulas, physics equations, matrices, and statistical distributions with crisp vector rendering.
  • πŸ“Š Mermaid.js Flowchart Engine: Visualizes flowcharts, architecture diagrams, sequence maps, class structures, and Gantt timelines with one-click full-screen expansion and PNG export.

πŸ” 8. Multi-Profile Isolation & SQLite Encryption

  • πŸ‘₯ Isolated Workspaces: Create independent user profiles (e.g., Personal, Work, Client X) with dedicated conversation histories, custom system prompts, and individual master passwords.
  • πŸ”’ Encrypted Local Storage: SQLite databases are stored under %LOCALAPPDATA%\aiwidget protected with local cryptographic encryption.

πŸš€ Download & Installation

πŸ“¦ Windows Binaries (v1.1.0)

Download the official signed releases from our Releases Page:

Package Format Size Target Environment
AI-Widget-Setup.exe Installer 9.03 MB Standard Windows NSIS installer with Start Menu shortcuts & auto-update daemon.
AI-Widget-Setup.msi MSI 11.01 MB Enterprise Windows Installer for automated Active Directory / GPO fleet deployment.
AI-Widget-Portable.exe Portable 21.55 MB Zero-installation standalone executable. Ideal for USB drives and air-gapped computers.

πŸ› οΈ Developer & Contributor Guide

πŸ’» Prerequisites

To build and develop AiWidget locally, ensure you have:


πŸš€ Quick Start (Live Hot-Reload Development)

# 1. Clone the repository
git clone https://github.com/ShaDevPro/AiWidget.git
cd AiWidget

# 2. Install frontend dependencies
npm install

# 3. Launch live hot-reload development mode
npm run tauri:dev

πŸ“¦ Production Build Pipeline

# Compile frontend + Tauri binaries (Setup.exe, Setup.msi, Portable.exe)
npm run release:build

The resulting optimized binaries will be placed in the release/ directory.


πŸ“ Project Architecture & Directory Map

AiWidget/
β”œβ”€β”€ src/                          # πŸ’» Full Frontend (TypeScript + Vite)
β”‚   β”œβ”€β”€ modules/
β”‚   β”‚   β”œβ”€β”€ chat/                 # Streaming LLM chat controller & message renderer
β”‚   β”‚   β”œβ”€β”€ image/                # Cinema SDXL & Fast SD 1.5 Image Studio
β”‚   β”‚   β”œβ”€β”€ course/               # Interactive Course & Quiz Studio Engine
β”‚   β”‚   β”œβ”€β”€ snipper/              # ScreenSnipper (Ctrl+Shift+S screenshot tool)
β”‚   β”‚   β”œβ”€β”€ document/             # In-Memory Streaming Excel (.xlsx) & PDF parser
β”‚   β”‚   β”œβ”€β”€ voice/                # Whisper & Neural TTS Controller
β”‚   β”‚   β”œβ”€β”€ markdown/             # KaTeX math & Mermaid diagram renderers
β”‚   β”‚   β”œβ”€β”€ license/              # Enterprise server connection adapter
β”‚   β”‚   β”œβ”€β”€ telemetry/            # Privacy-compliant anonymous metrics pinger
β”‚   β”‚   └── shell/                # Widget UI Shell (Bubble, Compact, Expanded)
β”‚   β”œβ”€β”€ styles/                   # Modular Fluent Design CSS sheets
β”‚   └── i18n/                     # Multilingual dictionaries (FR, EN, AR RTL)
β”‚
β”œβ”€β”€ src-tauri/                    # πŸ¦€ Embedded Native Rust Backend Engine
β”‚   β”œβ”€β”€ src/
β”‚   β”‚   β”œβ”€β”€ sd_engine.rs          # SD.cpp C++ diffusion wrapper (SDXL + CPU VAE)
β”‚   β”‚   β”œβ”€β”€ tts_engine.rs         # Neural TTS speech synthesizer
β”‚   β”‚   β”œβ”€β”€ whisper_engine.rs     # Whisper.cpp speech-to-text pipeline
β”‚   β”‚   β”œβ”€β”€ llama_engine.rs       # Embedded Llama.cpp & Ollama IPC bridge
β”‚   β”‚   β”œβ”€β”€ web_search.rs         # Anti-hallucination web query router
β”‚   β”‚   β”œβ”€β”€ db.rs                 # Local encrypted SQLite database engine
β”‚   β”‚   β”œβ”€β”€ security_engine.rs    # Local hardware attestation & anti-tamper security engine
β”‚   β”‚   └── commands/             # Tauri IPC Command Bridge (Async Handlers)
β”‚   β”œβ”€β”€ Cargo.toml                # Rust dependencies & metadata
β”‚   └── tauri.conf.json           # Tauri window & bundle configuration
β”‚
└── website/                      # 🌐 Public Showcase Website (GitHub Pages)

⚑ Available NPM Scripts

Command Description
npm run tauri:dev Starts Vite dev server and launches the native Tauri desktop window with live hot-reload.
npm run build Compiles and type-checks the TypeScript frontend (tsc && vite build).
npm run tauri:build Compiles the optimized native Windows Rust desktop executable.
npm run release:build Complete build: bundles frontend + builds Windows NSIS Installer, Enterprise MSI & Portable packages.

🌍 Multilingual Support & RTL

AiWidget natively supports comprehensive bidirectional internationalization:

  • πŸ‡¬πŸ‡§ English: Complete UI, prompt templates, and documentation.
  • πŸ‡«πŸ‡· FranΓ§ais: Interface complΓ¨te, prompts pΓ©dagogiques et analyse de documents adaptΓ©e.
  • πŸ‡ΈπŸ‡¦ Ψ§Ω„ΨΉΨ±Ψ¨ΩŠΨ©: Full Right-To-Left (RTL) typography, Arabic fonts, and custom Arabic LLM system directives.

Want to add a new language? Simply add a new locale file in src/i18n/locales/ and submit a Pull Request!


🏒 Enterprise PRO & On-Premise Server

While the AiWidget Desktop Client is 100% free and open-source under the GNU AGPLv3, we offer an on-premise infrastructure for enterprises requiring centralized data sovereignty:

πŸ‘‘ AiWidget PRO Enterprise Features:

  • 🏒 Centralized GPU Pooling: Connect 50 to 500 employee desktops to a central On-Premise GPU server without requiring discrete GPUs on client PCs.
  • πŸ‘₯ Department Quota Governance: Set fine-grained daily token limits for Engineering, Legal, and HR departments.
  • πŸ” Active Directory & GPO Policy Lock: Enforce mandatory server endpoints and compliance rules across enterprise fleets.
  • πŸ›‘οΈ Hardware-Locked HMAC Signature Licensing: Completely air-gapped license management with zero external cloud dependencies.

πŸ“§ Commercial & Enterprise Inquiries: s.h.a.dev.pro@gmail.com
🌐 Website & Portal: https://shadevpro.github.io/AiWidget-Site/


🀝 How to Contribute

We warmly welcome contributions from developers worldwide! Whether you want to optimize performance, add Linux/macOS support, translate the app into new languages, or introduce new document parsers:

  1. Fork the repository: https://github.com/ShaDevPro/AiWidget
  2. Create your feature branch (git checkout -b feature/AmazingFeature)
  3. Commit your changes (git commit -m "feat: Add AmazingFeature")
  4. Push to the branch (git push origin feature/AmazingFeature)
  5. Open a Pull Request

πŸ“œ License

This project is licensed under the GNU Affero General Public License v3.0 (AGPLv3).
See the LICENSE file for details.


Built with ❀️ for privacy, performance, and the global developer community by ShaDevPro.

⭐ If you find AiWidget valuable, please consider starring this repository on GitHub! ⭐

About

πŸš€ Sovereign, ultra-lightweight (~9 MB) AI Workstation for Windows. Run local LLMs, SDXL Cinema art, Excel analyzer, Course studio & Whisper voice 100% offline.

Resources

Stars

0 stars

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages