microsoft/synthetic-data
Generate synthetic training data using NVIDIA Cosmos world foundation models for SDG pipelines
npx skills add https://github.com/microsoft/physical-ai-toolchain --skill synthetic-data
Generate photorealistic training data using NVIDIA Cosmos world foundation models — Cosmos Transfer, Cosmos Predict, and Cosmos Reason.
The Synthetic Data domain provides SDG pipelines that transform simulation-rendered frames into photorealistic training data, predict future environment states, and curate output for training quality.
| Stage | Model | Purpose |
|-------|-------|---------|
| Transfer | Cosmos Transfer 2.5 | Convert Isaac Sim renders to photorealistic images |
| Predict | Cosmos Predict 2.5 | Generate future frame sequences from observations |
| Reason | Cosmos Reason 2 | Assess data quality and filter training samples |
SDG workflows can be submitted via OSMO or AzureML:
synthetic-data/workflows/osmo/synthetic-data/workflows/azureml/| File | Purpose |
|------|---------|
| synthetic-data/README.md | Domain overview and directory structure |
| synthetic-data/workflows/osmo/sdg-pipeline.yaml | End-to-end OSMO SDG pipeline |
| synthetic-data/cosmos/configs/README.md | Model configuration reference |
| synthetic-data/specifications/synthetic-data.specification.md | SDG pipeline specification |
| synthetic-data/specifications/cosmos-integration.specification.md | Cosmos model integration specification |
All NVIDIA Cosmos containers require:
| Variable | Value |
|----------|-------|
| ACCEPT_EULA | Y |
| PRIVACY_CONSENT | Y |
| NVIDIA_DRIVER_CAPABILITIES | all |
Each Cosmos model stage requires a minimum of 1x A100 (40 GB) GPU. H100 (80 GB) recommended for production workloads.
Take microsoft/synthetic-data from the repository into ~/.claude/skills for personal
use, or into .claude/skills inside a project.
The agent identifies a skill by the name field in its header. Two skills with the
same name cannot sit side by side — one of them will be ignored.