ropedia-xperience-10m-task-baselines / results /omni_finetune /MULTI_EPISODE_ACCESS_STATUS.md
cy0307's picture
Publish Ropedia Xperience-10M task baseline cards
45c1706 verified
|
Raw
History Blame
2.53 kB

Multi-Episode Access Status

Current status: access to the gated full ropedia-ai/xperience-10m dataset is granted, and a metadata-only Hugging Face audit has been completed. A 128-episode metadata-balanced relay has started with chunked parallel transfer and overlapping batch prefetch, but the selected multi-episode data has not been fully staged, audited, trained, or evaluated yet.

This file records the public data-access status and pilot requirements. It does not include local-machine aliases, private paths, SSH hosts, or token locations.

Selection Plan

Item Value
Dataset ropedia-ai/xperience-10m
Minimum pilot gate 32 complete leaf episodes
Strategy stratified round-robin across top-level session UUIDs
Metadata-audited visible complete episodes 12,102
Metadata-audited complete sessions 802
Current selected relay 128 metadata-balanced episodes
Recommended split 96 train / 16 val / 16 test
Recommended estimated download 277.71 GiB excluding visualization.rrd
Representative 32-episode estimate ~70.5 GiB at median episode size
Smallest one-per-session 32-episode estimate 35.35 GiB
Excluded file visualization.rrd

Current Stage

The current Qwen3-Omni artifacts come from the locally available sample data. The held-out model-quality run starts after selected complete episodes are downloaded, transferred through the relay path, validated locally, audited for content balance, and preprocessed into train/val/test examples. The current relay uses chunked parallel file transfer and overlapping prefetch to reduce staging idle time; this is a data-staging improvement, not a model-quality result.

A real held-out pilot can be claimed only after:

  • selected valid episodes are available locally,
  • the manifest builder confirms complete held-out episode splits,
  • training finishes with recorded metadata and progress logs,
  • evaluation runs on held-out test episodes,
  • predictions, metrics, confusion matrices, and a run report are committed.

The reader-facing data access summary is:

results/omni_finetune/DATA_ACCESS_STATUS.md

The current metadata-only full dataset audit is:

results/omni_finetune/FULL_DATASET_METADATA_AUDIT.md

The current 128-episode metadata-balanced download plan is:

results/omni_finetune/XPERIENCE10M_128_EPISODE_SELECTION.md

The older machine-generated source discovery blocker remains a pre-access local staging record:

results/omni_finetune/DATA_BLOCKER_REPORT.md