EVIDENCE_CONTRACT.md

# Evidence Contract

This project is intentionally audit-first. Every visible claim should point to a
local artifact that a reader can inspect before trusting the dashboard.

| Claim | Current evidence | Status | Boundary |
| --- | --- | --- | --- |
| The public Xperience-10M sample has been converted into aligned model windows. | `artifacts/episode_task_suite/windows.csv`, `artifacts/episode_task_suite/shared_windows.npz`, `artifacts/episode_task_suite/summary_report.json` | Verified for 5,821 frames and 1,161 windows | One public sample episode only |
| The current feature contract is explicit and reviewable. | `artifacts/episode_task_suite/feature_manifest.json`, `artifacts/episode_task_suite/available_modalities.json` | Verified for an 8,378-d feature vector | Audio is present in MP4 streams but not yet a feature block |
| The public sample modalities are inspectable without raw data redistribution. | `metrics/modality_atlas.json`, `assets/modalities/`, website modality atlas | Verified derived thumbnail atlas | Thumbnails are presentation/review assets, not a replacement for official raw data access |
| The 12 task heads are real scripts and artifacts, not presentation placeholders. | `scripts/episode_task_suite.py`, `artifacts/episode_task_suite/*/metrics.json`, `artifacts/episode_task_suite/*/predictions.*` | Verified for all 12 task definitions | Chronological single-episode split, not cross-episode generalization |
| Minimal and neural heads use the same task contracts. | `scripts/neural_task_models.py`, `artifacts/episode_task_suite/neural_mlp/`, `assets/task_architectures.png` | Verified for 12 minimal heads and 12 neural MLP heads | Small heads only; not a foundation model |
| Four Ropedia research directions are mapped honestly as direct, proxy, or diagnostic evidence. | `artifacts/episode_task_suite/research_directions/research_direction_taxonomy.json`, `metrics/research_directions.json` | Verified taxonomy | Some directions remain proxy-only |
| Four extra direction probes are coded and evaluated. | `artifacts/episode_task_suite/research_direction_extensions/research_direction_extension_results.json`, `metrics/research_direction_extensions.json` | Verified single-episode probes | Not full human modeling, neural rendering, intent modeling, or world modeling solutions |
| Qwen3-Omni infrastructure has passed technical smoke checks. | Companion GitHub repo: `results/omni_finetune/RUN_REPORT.md`, `results/omni_finetune/dataset_manifest.json`, `results/omni_finetune/metrics_eval.json` | Smoke-only evidence | One episode, 128 train windows; not a 32-episode pilot |
| The real 32-episode LoRA pilot is blocked on gated data access, not on repo presentation. | Companion GitHub repo: `results/omni_finetune/DATA_BLOCKER_REPORT.md`, `results/omni_finetune/A100_HF_RELAY_STATUS.md`, `results/omni_finetune/source_discovery.json` | Blocker documented | No 32-episode metric should be claimed until the gate passes |
| Historical `32ep` path strings are not treated as 32-episode results. | `scripts/validate_scope_claims.py`, `metrics/scope_claims_audit.json` | Verified pass | Classifies old run/path identifiers and fails if public presentation claims real 32-episode metrics |
| Prepared GitHub/Hugging Face mirrors carry matching critical files. | `scripts/validate_mirror_parity.py`, `metrics/mirror_parity.json` | Verified pass | Compares prepared data files, visual assets, website HTML, and validator scripts before upload; live URLs are checked after publishing |
| The public GitHub and Hugging Face bundles are publication-clean. | `scripts/validate_publication_package.py`, `metrics/publication_audit.json` | Verified pass | Checks public files, HF bundles, and public-card freshness; ignored local scratch outputs are excluded |
| The public website has checked local references. | `scripts/validate_website_integrity.py`, `metrics/website_integrity.json` | Verified pass | Checks local links, anchors, JSON data, and referenced images; external URLs are not fetched |
| The core proof artifacts are indexed and grouped for fast review. | `ARTIFACT_GUIDE.md`, `scripts/build_artifact_index.py`, `metrics/artifact_index.json` | Verified guide and index | Selective source-of-truth catalog, not a complete inventory of every output file |
| The public reproduction path is documented. | `REPRODUCIBILITY.md`, `metrics/reproducibility_matrix.json`, `notes/reproducibility_audit.md` | Verified documentation and prior exact-match audit | Publicly reproduces the single-episode pipeline, not the gated 32-episode Qwen3-Omni pilot |
| The project is externally citable and machine-readable. | `CITATION.cff`, `codemeta.json`, `metrics/project_manifest.json`, `LICENSE` | Verified metadata files | Code license does not override original Xperience-10M dataset terms |
| A first-time reviewer has an explicit audit path. | `metrics/reviewer_packet.json`, website reviewer section, README reviewer path | Verified reviewer packet | It guides inspection; it does not add new experimental claims |

## Review Order

1. Read `metrics/reviewer_packet.json` for the shortest audit path and proof
   boundary.
2. Read `ARTIFACT_GUIDE.md` and `metrics/artifact_index.json` to see grouped
   reviewer artifacts, indexed proof artifacts,
   sizes, and stable-file hashes.
3. Read `assets/task_suite_infographic.png` and
   `metrics/modality_atlas.json` for the high-level map and modality atlas.
4. Read `REPRODUCIBILITY.md` and `metrics/reproducibility_matrix.json` before
   rerunning the public pipeline.
5. Inspect `artifacts/episode_task_suite/summary_report.json` for the task and
   metric source of truth.
6. Inspect `artifacts/episode_task_suite/feature_manifest.json` to see which
   modalities enter the current feature vector.
7. Inspect `artifacts/episode_task_suite/neural_mlp/` to compare minimal and
   neural heads under the same splits.
8. Inspect `metrics/scope_claims_audit.json` before interpreting historical
   `32ep` strings in Qwen3-Omni smoke artifacts.
9. Inspect `metrics/mirror_parity.json` before assuming the GitHub and
   Hugging Face mirrors contain the same critical data, visual, HTML, and
   validator files.
10. Inspect the companion GitHub repo's
   `results/omni_finetune/DATA_BLOCKER_REPORT.md` before interpreting any
   Qwen3-Omni artifact.
11. Inspect `metrics/publication_audit.json` and
   `metrics/website_integrity.json` before publishing or sharing the project
   externally.
12. Inspect `CITATION.cff`, `codemeta.json`, and `LICENSE` before reusing or
   citing the project.