Skip to content

Auto-detect dataset formats and expand samples - #1128

Open
suhanpark wants to merge 6 commits into
studio/runtime-reliabilityfrom
studio/dataset-autodetect
Open

suhanpark wants to merge 6 commits into
studio/runtime-reliabilityfrom
studio/dataset-autodetect

Conversation

@suhanpark

Copy link
Copy Markdown
Collaborator

Summary

Detect uploaded and sample dataset layouts, then configure the matching loader automatically.

Changes

  • add structural detection for MobileBrick, Tanks and Temples, Hilti, YFCC IMB, Argoverse, Olsson, AstroVision, COLMAP, and generic image collections
  • resolve detected paths relative to portable uploaded roots
  • expand the curated GitHub sample catalog from 3 to 9 scenes and correct the Crane Mast image count
  • add an Auto-detect (recommended) format option with a detection explanation in the UI
  • cover the detector, uploads, sample catalog, and runtime integration with tests

Why

GTSFM sample datasets use different directory layouts. Requiring users to know the exact loader and path arguments made the Studio workflow unnecessarily error-prone.

Validation

  • 47 focused visualization tests passed
  • staged React/TypeScript frontend build passed
  • git diff --check passed

Stack

Depends on #1127 and targets studio/runtime-reliability so this remains a focused, reviewable change.

Comment thread visualization/datasets.py Outdated
return [path.relative_to(root) for path in root.rglob("*") if path.is_file()]


def detect_dataset_format(root: Path) -> dict[str, Any]:

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

what is this for? I dont think we should depend on folder structure, and should pipe the config through which contains the name of the loader.

@akshay-krishnan
akshay-krishnan marked this pull request as ready for review September 1, 2026 18:51
@akshay-krishnan
akshay-krishnan added this pull request to stack #1146 September 18, 2026 17:18
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants