Skip to content

kickstart for scene reconstruction - #3279

Open
leshy wants to merge 12 commits into
mainfrom
ivan/feat/scene
Open

kickstart for scene reconstruction#3279
leshy wants to merge 12 commits into
mainfrom
ivan/feat/scene

Conversation

@leshy

@leshy leshy commented Jul 29, 2026

Copy link
Copy Markdown
Member

shows mem2 queries useful for manipulation

dimos/perception/memory/python tool_localize.py "coke can" --from 30 --duration 120 && dimos-viewer localize.rrd

2026-07-30_12-44

more info on next steps @ https://linear.app/dimensional/issue/DIM-1343/object-registration

@mintlify

mintlify Bot commented Jul 29, 2026

Copy link
Copy Markdown
Contributor

Preview deployment for your docs. Learn more about Mintlify Previews.

Project Status Preview Updated (UTC)
dimensional 🟢 Ready View Preview Jul 29, 2026, 10:30 PM

💡 Tip: Enable Workflows to automatically generate PRs for you.

@codecov

codecov Bot commented Jul 29, 2026

Copy link
Copy Markdown

Codecov Report

❌ Patch coverage is 17.94872% with 96 lines in your changes missing coverage. Please review.
✅ All tests successful. No failed tests found.

Files with missing lines Patch % Lines
...erception/detection/type/detection3d/pointcloud.py 11.47% 53 Missing and 1 partial ⚠️
dimos/models/segmentation/edge_tam.py 23.07% 40 Missing ⚠️
.../detection/type/detection3d/imageDetections3DPC.py 50.00% 2 Missing ⚠️
@@            Coverage Diff             @@
##             main    #3279      +/-   ##
==========================================
- Coverage   75.03%   74.98%   -0.05%     
==========================================
  Files        1135     1135              
  Lines      108631   108713      +82     
  Branches     9787     9801      +14     
==========================================
+ Hits        81507    81517      +10     
- Misses      24334    24405      +71     
- Partials     2790     2791       +1     
Flag Coverage Δ
OS-ubuntu-24.04-arm 68.78% <13.67%> (-0.04%) ⬇️
OS-ubuntu-latest 70.89% <13.67%> (-0.05%) ⬇️
Py-3.10 70.88% <13.67%> (-0.06%) ⬇️
Py-3.11 70.89% <13.67%> (-0.05%) ⬇️
Py-3.12 70.88% <13.67%> (-0.06%) ⬇️
Py-3.13 70.88% <13.67%> (-0.06%) ⬇️
Py-3.14 70.89% <13.67%> (-0.05%) ⬇️
Py-3.14t 70.89% <13.67%> (-0.05%) ⬇️
SelfHosted-Large 29.05% <13.67%> (-0.01%) ⬇️
SelfHosted-Linux 35.92% <17.94%> (-0.03%) ⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

Files with missing lines Coverage Δ
.../detection/type/detection3d/imageDetections3DPC.py 69.23% <50.00%> (-8.55%) ⬇️
dimos/models/segmentation/edge_tam.py 26.75% <23.07%> (-0.46%) ⬇️
...erception/detection/type/detection3d/pointcloud.py 46.61% <11.47%> (-31.02%) ⬇️
🚀 New features to boost your workflow:
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@leshy
leshy enabled auto-merge July 29, 2026 23:05
@leshy leshy changed the title Ivan/feat/scene kickstart for scene perception Jul 30, 2026
@leshy leshy changed the title kickstart for scene perception kickstart for scene reconstruction Jul 30, 2026

jhengyilin commented Jul 30, 2026

Copy link
Copy Markdown
Contributor

Calibrated recording validation (2026-07-29)

I added the calibrated xArm6 + RealSense D435i recording in commit abd7f22d. For this recording, the reproducible query is red marker.

uv run python -m dimos.perception.memory.tool_localize \
  "red marker" \
  --from 30 \
  --duration 120 \
  && uv run dimos-viewer localize.rrd

Dataset archive:

data/.lfs/xarm6_worldbelief_realsense_d435i_stationery_calibrated.tar.gz
sha256:05acc218484d7f2b8e4f1688962df90ef37a95f6dc02d5d0c15d308cfa47ed95
Screenshot from 2026-07-30 14-37-19

leshy and others added 10 commits July 30, 2026 16:15
This reverts commit ce2c71a, except for
dimos/models/embedding/dino.py, which is kept: DINOModel is a standalone
EmbeddingModel whose only dependencies (dimos.models.base,
dimos.models.embedding.base, dimos.msgs.sensor_msgs.Image) predate the
reverted commit.

Conflict in dimos/robot/all_blueprints.py resolved by keeping the
wrist-camera entry added after the merge; only the two world-belief
registry entries are removed.
… embed the requested windowand fix some rerun display issues
main's inline-heavy-imports sweep (#3272) dropped the module-level cv2 that
this method, added on this branch, was still using.
@github-actions github-actions Bot added the ready-to-merge Required CI checks have passed on this PR label Jul 31, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ready-to-merge Required CI checks have passed on this PR

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants