Part of #818 (Track B2, item 2). Status: ABSENT — only a follow-up bullet exists at docs/MESH_SEGMENTATION_STRATEGY.md:214 ("SAM-2 multiview zero-shot path (sam2seg) … (#818 B2 item 2)").
Zero-shot mesh segmentation by rendering the mesh from multiple views, segmenting each view with SAM 2, and back-projecting the 2D masks onto the mesh to vote per-face labels. Complements the trained per-category models (#1014) by handling categories no model was trained for, with no retrain.
Note the existing MeshDepthRenderer / MultiViewTextureBaker / ProjectionPainter stack already does multiview render + back-projection for textures, so the projection half has precedent to reuse rather than invent.
Acceptance
Sensible parts on a category outside the trained set, via GUI/CLI/MCP, with the existing Part vocabulary. Model license must clear the permissive-redistribution bar before any weights are shipped (SAM 2 licensing to be verified in the issue, not assumed).
Part of #818 (Track B2, item 2). Status: ABSENT — only a follow-up bullet exists at
docs/MESH_SEGMENTATION_STRATEGY.md:214("SAM-2 multiview zero-shot path (sam2seg) … (#818 B2 item 2)").Zero-shot mesh segmentation by rendering the mesh from multiple views, segmenting each view with SAM 2, and back-projecting the 2D masks onto the mesh to vote per-face labels. Complements the trained per-category models (#1014) by handling categories no model was trained for, with no retrain.
Note the existing
MeshDepthRenderer/MultiViewTextureBaker/ProjectionPainterstack already does multiview render + back-projection for textures, so the projection half has precedent to reuse rather than invent.Acceptance
Sensible parts on a category outside the trained set, via GUI/CLI/MCP, with the existing
Partvocabulary. Model license must clear the permissive-redistribution bar before any weights are shipped (SAM 2 licensing to be verified in the issue, not assumed).