Move. Grab. Zoom. Your PC follows.
Private by design. Everything runs on your devices. Nothing goes to the cloud.
The idea · Get started · Gestures · How it works · Privacy · Docs
Sometimes there's no room for a mouse: a cramped desk, a plane tray table, a laptop on your knees. But your phone is already in your pocket, and it has a camera. Stand it next to your laptop, raise your hand, and the cursor follows.
Move your hand and the cursor follows. Close it to hold a button.
| Gesture | What happens |
|---|---|
| Move one open hand | The cursor moves |
| Fingers close together | Slow, precise cursor |
| Fingers spread wide | Fast cursor |
| Hold a right fist | Right mouse button, held until you open your hand |
| Hold a left fist | Left mouse button, held until you open your hand. Move it to drag or draw. |
| Two hands apart / together | Zoom in / out |
| Left open hand, right hand in view | Scroll |
Opening your hand, leaving the camera's view, stopping control or disconnecting always releases the button.
The phone does all of the vision work with CameraX and MediaPipe. Windows only receives small, versioned control messages for cursor, click, scroll, zoom and status. These travel over TLS, pinned to the certificate you scanned. More in Architecture and Protocol v1.
You'll need Windows 10 or 11 with the .NET 10 SDK, the Android SDK 37 with JDK 17 or newer (Android Studio includes both), and a phone running Android 7 or later with USB debugging on and adb in your PATH.
Connect your phone, then run:
.\scripts\setup-demo.ps1This command builds and tests both apps, installs the APK, opens a USB tunnel on port 39827, starts the Windows agent and launches GestureLink on your phone. For later starts, add -SkipBuild.
- Pair. Scan the QR code on your PC. That's it. Known phones reconnect automatically.
- Start. Keep GestureLink open on your phone and tap START.
- Stop. Leave the app or tap stop. Any input that's held is released instantly.
Use your local network instead of USB
The USB tunnel is a fallback for networks that isolate devices, such as guest Wi‑Fi. On a private network, put both devices on the same LAN and start the agent directly:
dotnet run --project .\windows\GestureLink.Windows.AppWindows listens on TCP 39827 with TLS 1.2 or newer. Android pins the exact certificate fingerprint from the QR code.
Build each app on its own
Android
cd android
.\gradlew.bat testDebugUnitTest lintDebug assembleDebug
adb install -r .\app\build\outputs\apk\debug\app-debug.apkWindows
.\scripts\build-windows.ps1
.\scripts\publish-windows.ps1The portable build is written to artifacts/windows-win-x64. Smart App Control blocks freshly built unsigned executables. setup-demo.ps1 works around this with the permitted .NET test host and leaves Windows security on. Releases you distribute should be code-signed.
Your camera feed stays on your phone. Here's what GestureLink does to keep it that way:
- No cloud. No account, no external server.
- No recording. Camera frames are never saved or uploaded. The microphone is never used.
- Secure pairing. Credentials are kept in Android Keystore. Windows stores only a hashed verifier.
- Strict messages. Length-bounded, versioned JSON over certificate-pinned TLS.
- Fail-safe input. Held input is released when you stop, disconnect, background the app, exit, or the connection times out.
- Knows its limits. It never tries to control UAC, the login screen or apps running with higher privileges.
More in Security.
Tested on a Xiaomi 25010PN30G running Android 16:
| ✓ | Secure QR pairing and automatic reconnect |
| ✓ | USB connection over TLS |
| ✓ | Portrait and landscape |
| ✓ | Real Windows cursor movement |
| ✓ | 12 Android and 13 Windows tests passing |
Still to test on more hardware: click and zoom tuning, multiple monitors and display scaling, long sessions under heat, Android 7–17, and both Windows 10 and 11.
android/ |
Kotlin, Jetpack Compose, CameraX, MediaPipe |
windows/ |
.NET 10 WPF agent, protocol server, Win32 input |
protocol/ |
Protocol v1, JSON schema, shared test fixtures |
docs/ |
Architecture, calibration, security, testing, troubleshooting |
scripts/ |
Build, publish, verify, demo setup |
Product naming lives in one place on each platform: Android AppConfig/BuildConfig and Windows ProductInfo. The README artwork comes from docs/assets/generate.py.
GestureLink went from sketch to working demo in a single 3‑hour Cursor hackathon, and it won. 🏆

