Repository navigation
Open
Labels
Description
Part of #886. For @alexermolovich — please comment here so you can be assigned.
Scope (milestone 1)
backend="isaacsim"starts Isaac Sim viaSimulationApp, with a basic scene (camera, lighting)add(robot)for URDF-backed robots, converted to USD with Isaac's URDF importeradd()returns a handle that owns its ownq, so several instances of one model work- Desktop only, Isaac Sim 6.2, optional
isaacsimextra with a lazy import;import roboticstoolboxmust still work without it
Target
A URDF Panda from robot_descriptions:
panda.plot(panda.qr, backend="isaacsim")
traj = rtb.jtraj(panda.qz, panda.qr, 50)
panda.plot(traj.q, backend="isaacsim", dt=0.05)A screencast in Discussions → Show & Tell.
Out of scope for now
Notebooks, teach, ellipsoids, ETS/DH robots, physics-driven step.
Open questions (to settle before the PR is reviewed)
- Testing. Isaac Sim needs a GPU and isn't open licensed, so it can't run in CI. What's testable without it (mocked
SimulationApp, joint-mapping logic), and what's the manual checklist for the rest? - Dispatch. Blocked by Backend registry: single name → constructor dispatch #902 (backend registry). Register the backend there as
isaacsim. Once Backend registry: single name → constructor dispatch #902 is merged, you can also develop and test outside the RTB tree withregister_backend("isaacsim", ...). - Expanded URDF. Keeping the expanded XML (Xacro args, patches) changes RTB's URDF loading. Please do that as a separate, small PR first.
- Python versions. Isaac Sim targets 3.12, while RTB supports 3.10–3.14. The extra should install only where Isaac Sim does.
restart(). If Isaac Sim can't restart in-process, raise a clear error and say so in the docs, rather than half-supporting it.
Process
- One backend per PR. Open a draft PR early.
- Follow Connector/backend API polish: addable-object superclass, teach-panel promotion, getframe() #676 (protocol changes) and avoid relying on
Gripperdetails (Rethink how grippers are modeled, and pause gripper-related changes #884). - Say in the PR if an AI assistant helped (
AGENTS.md). - If there's been no activity for about four weeks, the backend goes back to "available" in Backends wanted: CoppeliaSim, Viser, Gazebo, MuJoCo and others (plan first) #886.
Generated by Claude Code
Reacted by alexyermolovych
Activity
alexermolovich commentedon Oct 25, 2026
Accepted
alexermolovich commentedon Oct 30, 2026
Working on this issue here PR
alexermolovich commentedon Nov 13, 2026
Hey @petercorke, I’ve added a basic smoke test that requires an NVIDIA GPU. The robot now loads successfully and is added to the scene with lighting. I’m currently working on adding more control through the code, but the basics are working now: Isaac Sim instance starts, scene is being setup correctly, and the robot works.