QUALITY_GATES.md

# Release Checks

This file is the release map for the Ropedia Xperience-10M Task Suite.

Current gate status: **pass**

A release is current when the automated reports pass and the live GitHub/Hugging Face mirrors are verified after publishing.

These checks cover public packaging, project status wording, mirror parity, and website integrity. Cross-episode model quality is measured by later held-out evaluation reports.

## Automated Checks

| Check | Command | Report | Current status | Needs attention when |
| --- | --- | --- | --- | --- |
| Multi-episode pilot status | `python scripts/validate_scope_claims.py` | `docs/data/scope_claims_audit.json` | `pass` | Historical 32ep setup/provenance strings are presented as completed 32-episode metrics. |
| Source alignment | `python scripts/validate_source_alignment.py` | `docs/data/source_alignment_audit.json` | `pass` | Official full-dataset facts, sample-card facts, API-listing notes, or project coverage are missing or inconsistent. |
| Website integrity | `python scripts/validate_website_integrity.py` | `docs/data/website_integrity.json` | `pass` | Local links, anchors, JSON bundles, or referenced image assets are missing or invalid. |
| Rendered website check | `python scripts/build_rendered_site_check.py --input /tmp/xperience_rendered_site_observations.json` | `docs/data/rendered_site_check.json` | `pass` | The local rendered site cannot load, switch tabs, deep-link to the walkthrough, update player controls, or stay console-clean. |
| Task surface integrity | `python scripts/validate_task_surface.py` | `docs/data/task_surface_integrity.json` | `pass` | Task cards expose raw artifact ids, human-readable task names drift, modality thumbnails are missing, or the interactive task player is not wired to the generated JSON. |
| Evaluation protocol | `python scripts/build_evaluation_protocol.py` | `docs/data/evaluation_protocol.json` | `pass` | Windowing, split policy, leakage controls, task metrics, or current limitations are not explicit. |
| Figure index | `python scripts/build_figure_index.py` | `docs/data/figure_index.json` | `pass` | Public figures, charts, or modality thumbnails are missing, unreadable, or lack source-script provenance. |
| Brand assets | `python scripts/build_brand_assets.py` | `docs/data/brand_assets.json` | `pass` | The generated logo system, favicon, social card, or app icons are missing or not reproducibly packaged. |
| Release-check manifest | `python scripts/build_quality_gates.py` | `docs/data/quality_gates.json` | `pass` | A public reader cannot see the current release state in one place. |
| Artifact index | `python scripts/build_artifact_index.py` | `docs/data/artifact_index.json` | `pass` | Project-critical evidence files are missing from the indexed artifact layer. |
| Public bundle contents | `python scripts/validate_publication_package.py` | `docs/data/publication_audit.json` | `pass` | Raw data, caches, heavy archives, token strings, missing required assets, or stale public-card figure references enter public bundles. |
| Public project surface | `python scripts/build_public_surface_qa.py` | `docs/data/public_surface_qa.json` | `pass` | Repo, website, or Hugging Face presentation loses SEO/social metadata, accessible tab semantics, source links, project-check links, or reader-facing copy consistency. |
| Prepared mirror parity | `python scripts/validate_mirror_parity.py` | `docs/data/mirror_parity.json` | `pass` | Prepared HF Space, artifact dataset, or model bundle diverges from the repo for critical files. |

## Post-Publish Checks

| Check | Evidence | Required result |
| --- | --- | --- |
| Live publication verifier | `python scripts/verify_live_publication.py` | live GitHub Pages, GitHub raw, HF Space, artifact dataset, and model mirrors match the current release assets |
| GitHub Pages deployment | `gh run list --repo ChaoYue0307/ropedia-xperience-10m-task-suite --limit 5` | latest pages-build-deployment run succeeds |
| Rendered browser check | `Browser/Playwright page identity, nonblank render, console health, and one local interaction` | no relevant console warnings/errors and target links work |

## Rerun Order

```bash
python scripts/validate_scope_claims.py
python scripts/validate_source_alignment.py
python scripts/build_evaluation_protocol.py
python scripts/build_brand_assets.py
python scripts/build_figure_index.py
python scripts/validate_website_integrity.py
python scripts/build_rendered_site_check.py --input /tmp/xperience_rendered_site_observations.json
python scripts/validate_task_surface.py
python scripts/build_quality_gates.py
python scripts/build_artifact_index.py
python scripts/validate_publication_package.py
python scripts/build_public_surface_qa.py
python scripts/validate_mirror_parity.py
```

After Hugging Face bundle sync, rerun `validate_publication_package.py` and `validate_mirror_parity.py` once more before upload.