Fixture mode uses committed JSON. HuggingFace mode pulls Verified, Multilingual, and Multi-SWE-bench (ByteDance-Seed/Multi-SWE-bench, ~1632 instances).
ByteDance-Seed/Multi-SWE-bench
Requires sourced instances. Sets fixed depth + repo metrics + partitions.
Parent repository must already have fixed_module_depth.
fixed_module_depth
P1–P3 are offline. P4 needs model_outcomes JSON. P5 checks OpenRouter catalog.
Requires every instance to have metrics or a permanent setup_failure.
Requires locked prereg with JSON regression_spec and completed full-run coverage (unless allow_incomplete).
regression_spec
Requires study prereg lock. Prefer batch enqueue from Runs.