An open-source Windows tool that reads a selected screen region, converts visible motion into realtime TCode, and sends it to a device over USB or BLE. Preview the output without hardware, or record/export .funscript positions.
Practical results on real hardware: on 2026-11-12, the maintainer reported USB (USB-C) and BLE use, with useful results from dance analysis in L0/Six Axis and Hybrid Analysis in L0. See the dated hardware-use report for the reported scope.
Adults only. This project is intended for adults. Minors are prohibited.
Latest release: 2.1.1.
- Windows portable ZIP: extract the complete folder, then double-click Start.cmd or SR6-OSR6-Realtime-Screen-TCode.exe. Python is bundled; keep
_internalbeside the exe. - Matching Source ZIP or v2.1.1 source tag: use Python 3.10+ and the source Start.cmd. Startup guide.
Source version note: the default main branch retains the older 1.1.2 program source. Use the v2.1.1 tag/Source ZIP for the latest release's matching source. Current documentation and ongoing source work are on 2.0.0-beta. Extract the complete Windows package before running it; the separate Start.cmd attachment requires that folder.
- Open Start.cmd, select Log only, and inspect Output Monitor without sending device commands.
- Choose an analysis mode and screen region. Use RTM Pose 2D for dance-oriented pose analysis or Hybrid Analysis for image motion; inspect Analysis Preview and the resulting curve.
- Check saved travel limits, axis directions and a modest output range, then choose the intended USB serial/BLE connection and start device output. Use clear, well-lit material for Six Axis; otherwise begin with L0 Only.
- RTM Pose 2D: dance-oriented L0/Six Axis analysis, in-app model download, optional GPU acceleration and CPU fallback.
- Hybrid Analysis: image-motion analysis; v2 is the default.
- Full/Half Travel: uses confirmed image reciprocation to select full, half or quarter L0 travel, with limited rhythm adaptation.
- Output Monitor and Show Preview: display final live TCode after output travel, inversion, coupling, limits and speed handling. Recording/export to
.funscriptis also available; normalized script positions and final live TCode are distinct. - Output controls: per-axis limits, travel scaling, presets, smoothing and saved preferences. Analysis Preview shows image evidence; the separate Pose Preview Lab is visual-only and does not drive a device.
- Optional v2 models, off by default: download/select ViTTrack or NeuFlow in the application. ViTTrack supports CPU; NeuFlow needs NVIDIA CUDA and does not support DirectML. Models and optional GPU runtimes are not bundled.
- Screen capture and analysis run locally; the application does not upload screen frames. Every feature and its scope.
Practical results are reported for the scenarios above, not every device, firmware or video. Image scale/contact candidates do not measure true depth or establish physical contact. Robot joint mapping, inverse kinematics, collision detection and physical feedback remain unverified; the simulator displays commands rather than hardware feedback. The hardware-use report is later user feedback, separate from the original automated release checks.
These retained 1.0/1.1.2-era demos are not new 2.1.1 benchmarks or evidence of the current real-device test scope.
Hybrid L0 / Six Axis — available since v1.0.0. Recorded test hardware: Intel Ultra 9 CPU; GPU disabled/not used for this analysis.
RTM Pose 2D — v1.1.2 demos. Recorded hardware: Intel Ultra 9 CPU; the GPU demo enables NVIDIA GeForce RTX 4090 Laptop GPU acceleration, while the CPU demo has GPU acceleration off.
Dance footage in the RTM Pose demos: Bilibili BV1UvtE6uEkD. For infringement concerns, contact lexzeonstudio@gmail.com for removal.
Startup · Feature guide · Architecture · AI/developer handoff · 2.1.1 release changes · Validation and recorded UI issue.
Developed with AI assistance and iterated through real-device use, regression testing and community feedback. The independent Lab remains a developer preview. Historical validation records, tags and release packages are retained.
Use usb-screen-stream to mirror a USB-connected phone/device screen to the PC, then select that window here for screen analysis.
Thanks to DK, 机械纪元, and “电话机” for guidance, volunteer testing and suggestions. The project learned from public work including FunGen, PoseFunscripter and nb-3d-simulator. See Contributing, LICENSE, third-party notices and open-source notice.
Contact for suggestions, collaboration or corrections: lexzeonstudio@gmail.com.
这是一个开源 Windows 实时读屏输出工具：读取框选的屏幕区域，将画面运动转换为 TCode，通过 USB 或 BLE 发送给设备。也可以先不连接硬件预览，或者录制／导出 .funscript 位置脚本。
实机已获得可应用效果：维护者于 2026-11-12 反馈，使用过 USB（USB-C）与 BLE 连接，舞蹈识别的 L0／六轴、混合分析的 L0 均有可应用效果。具体范围见实机使用记录。
成年人使用提示：本项目面向成年人使用，未成年禁止入内。
最新发布版：2.1.1。
- Windows 便携 ZIP：完整解压后，双击 Start.cmd 或 SR6-OSR6-Realtime-Screen-TCode.exe。自带 Python，保留 exe 旁边的
_internal。 - 配套 Source ZIP 或 v2.1.1 源码标签：准备 Python 3.10+，使用源码内的 Start.cmd；见启动说明。
源码版本说明：默认 main 保留旧版 1.1.2 程序源码；获取最新发布版的配套源码，请用 v2.1.1 标签／Source ZIP。当前文档与后续源码工作位于 2.0.0-beta。运行前请完整解压 Windows 包，单独的 Start.cmd 附件需要配合完整目录。
- 打开 Start.cmd，先选择 Log only，在输出监视中检查结果，不发送设备指令。
- 选择分析方式和屏幕区域。舞蹈姿态可选 RTM Pose 2D，画面运动可选混合分析；结合分析预览和输出曲线查看效果。
- 核对保存的行程上下限、轴向与较小输出范围，再选择目标 USB 串口／BLE 连接并开始设备输出。六轴优先使用光线好、主体清晰的素材，否则先用 L0 Only。
- RTM Pose 2D：面向舞蹈姿态的 L0／六轴分析，支持软件内下载模型、可选 GPU 加速及 CPU 回退。
- 混合分析：分析画面运动，默认使用 v2。
- 全／半行程：根据已确认的画面往复，选择全、半或 1/4 的 L0 行程，并有限度地适应节奏。
- 输出监视与显示预览：展示经过行程、反向、联动、上下限和限速处理后的最终实时 TCode；也支持录制／导出
.funscript，归一化脚本位置与最终实时 TCode 有区别。 - 输出调节：独立轴上下限、行程倍率、预设、平滑与设置保存。分析预览显示画面证据，独立 Pose Preview Lab 只做视觉预览，不驱动设备。
- 可选 v2 模型默认关闭：软件内下载／选择 ViTTrack 或 NeuFlow。ViTTrack 可用 CPU；NeuFlow 要求 NVIDIA CUDA，不支持 DirectML。模型与可选 GPU 库不随包分发。
- 屏幕采集和分析在本机完成，软件不会上传画面。全部用途与边界见逐项功能说明。
实用效果对应上方已反馈场景，不代表每种设备、固件或视频都适用。画面尺度／接触候选不等于真实深度或实际接触；机械臂关节映射、逆运动学、碰撞检测和真实位置反馈仍未验证，模拟器显示指令而非硬件反馈。实机使用记录属于后续使用反馈，与原自动化发布检查分开记录。
以下保留的 1.0／1.1.2 时期演示不是 2.1.1 新跑分，也不代表本次实机测试范围。
混合分析 L0／六轴——v1.0.0 起支持。 原演示测试硬件：Intel Ultra 9 CPU，GPU 关闭／此分析未使用 GPU。
L0 示例 1 · L0 示例 2 · L0 示例 3 · 六轴示例
RTM Pose 2D——v1.1.2 演示。 原测试硬件：Intel Ultra 9 CPU；GPU 演示开启 NVIDIA GeForce RTX 4090 Laptop GPU 加速，CPU 演示关闭 GPU 加速。
RTM Pose GPU 演示 · RTM Pose CPU 演示
RTM Pose 演示舞蹈素材来源：Bilibili BV1UvtE6uEkD。如有侵权请联系 lexzeonstudio@gmail.com 删除。
启动说明 · 功能指南 · 程序结构 · AI／开发者接手指南 · 2.1.1 发布改动 · 验证与已有界面问题记录。
本项目采用 AI 辅助开发，结合实机使用、回归测试和社区反馈持续改进。独立 Lab 仍是开发预览；历史验证记录、标签和发布包保留。
可使用 usb-screen-stream 将 USB 连接的手机／设备画面投到电脑，再在本工具中框选该窗口分析。
感谢 DK、机械纪元和**“电话机”**提供指导、志愿测试与建议；本项目参考和学习了 FunGen、PoseFunscripter、nb-3d-simulator 等公开项目。见贡献说明、许可证、第三方声明和开源说明。
建议、合作或纠正请联系：lexzeonstudio@gmail.com。