Accepted evidence
Submit by email to gigabrainchallenge@163.com with your ZIP package and metadata JSON (max ZIP size: 200 MB).
Submission format
Zip your run package with the task/episode folder structure shown in the Submission section. Maximum ZIP file size is 200 MB.
Update cadence
Submissions ingest daily, verification weekly, leaderboard publish weekly (UTC).
Leaderboard
Hugging Face Static Space format using results.json.
Loading results.json...
| Rank | Team / Model | Composite | Success | Avg Return | Submitted | Status |
|---|
Submission
Step 1
Prepare videos, metadata JSON, and contact details.
Step 2
Email your ZIP package and metadata JSON to gigabrainchallenge@163.com with team/contact information.
Step 3
Ensure each ZIP attachment is 200 MB or less. We verify evidence and publish validated results in weekly leaderboard updates.
outputs/
--video_quality_eval/
--task1/
--episode_0.mp4
--...
--...
--evaluator_test/
--task1/
--episode_0.mp4
--...
--...
Submission JSON schema
{
"team_name": "Your Team Name",
"contact_email": "team@example.com",
"affiliation": "Example University",
"model_name": "Your Model Name",
"model_version": "v1.1",
"eval_setting": "Open-vocab tabletop; seed=5; 50 episodes",
"metrics": {
"composite_score": 89.3,
"success_rate": 83.0,
"avg_return": 71.2
},
"videos": [
{ "label": "long-horizon demo", "url": "https://huggingface.co/spaces/your-space/video1" }
],
"notes": "Any deviations from reference protocol."
}
Ranking updates and governance
- Ingest daily: new submissions are queued.
- Validate weekly: videos and metadata are checked.
- Publish weekly: rankings refresh after validation.
- Tie-break: composite score, then success rate, then earlier submission.