Buckets:
| license: apache-2.0 | |
| library_name: transformers | |
| pipeline_tag: image-text-to-text | |
| tags: | |
| - science | |
| - physics | |
| - vision-language | |
| - reasoning | |
| - olympiad | |
| <div align="center"> | |
| <h1 style="font-size: 2em; font-weight: bold;">P1-VL: Bridging Visual Perception and Scientific Reasoning in Physics Olympiads</h1> | |
| </div> | |
| <p align="center"> | |
| <a href="https://arxiv.org/abs/2602.09443"><b>📄 Paper</b></a> | | |
| <a href="https://github.com/PRIME-RL/P1-VL"><b>💻 Code</b></a> | | |
| <a href="https://prime-rl.github.io/P1-VL/"><b>🌐 Project Page</b></a> | | |
| <a href="https://phyarena.github.io/"><b>🏆 Leaderboard</b></a> | |
| </p> | |
| <p align="center"> | |
| <img src="hipho.png" style="width: 800px" align=center> | |
| </p> | |
| <p align="center"> | |
| <i>High-performance vision-language model for physics reasoning</i> | |
| </p> | |
| ## Model Description | |
| **P1-VL-30B-A3B** is the mid-size variant of the P1-VL series, a high-performance open-source vision-language model specialized in physics reasoning. Introduced in [P1-VL: Bridging Visual Perception and Scientific Reasoning in Physics Olympiads](https://huggingface.co/papers/2602.09443), it is built on *Qwen3-VL-30B-A3B-Thinking* and refined through multi-stage reinforcement learning on curated physics competition data. P1-VL-30B-A3B achieves impressive results while maintaining reasonable computational requirements, making it accessible for researchers working with physics problems that require visual understanding. | |
| ### Key Highlights | |
| - 🥇 **HiPhO Excellence**: Strong performance across 13 physics contests with exceptional efficiency | |
| - 📊 **FrontierScience-Olympiad**: Total score of 52.5/100, outperforming base model by significant margins | |
| - 🎯 **Multimodal Capability**: Effectively handles diagram-based physics problems requiring visual-to-logic alignment | |
| - 🚀 **STEM Generalization**: Consistent improvements over base model across math, and multimodal benchmarks | |
| ## Performance Benchmarks | |
| ### HiPhO Comprehensive Results | |
| <div align="center"> | |
| | Category | P1-VL-30B-A3B | Qwen3-VL-30B-A3B-Thinking | P1-30B-A3B | Qwen3-30B-A3B-Thinking-2507 | | |
| | :---------------: | :-----------: | :-----------------------: | :--------: | :-------------------------: | | |
| | **Overall Score** | **35.0** | 29.7 | 32.5 | 29.9 | | |
| | Gold Medals (🥇) | 9 | 8 | 8 | 6 | | |
| </div> | |
| ### FrontierScience-Olympiad Benchmark | |
| P1-VL-30B-A3B achieves significant gains over its base counterpart across all three scientific domains, demonstrating the effectiveness of multimodal training for scientific reasoning. | |
| <div align="center"> | |
| | Model | Biology/10 | Chemistry/40 | Physics/50 | Total/100 | | |
| | :--------------------------------: | :--------: | :----------: | :--------: | :-------: | | |
| | **P1-VL-30B-A3B** | 20.0 | 58.8 | 54.0 | 52.5 | | |
| | P1-30B-A3B | 15.0 | 61.9 | 56.3 | 54.4 | | |
| | Qwen3-VL-30B-A3B-Thinking | 18.8 | 49.4 | 43.5 | 43.4 | | |
| | Qwen3-30B-A3B-Thinking-2507 | 10.0 | 47.8 | 45.3 | 42.8 | | |
| </div> | |
| ### STEM Benchmarks | |
| Beyond physics reasoning, P1-VL-30B-A3B demonstrates strong generalization across multiple domains, consistently outperforming its base model Qwen3-VL-30B-A3B-Thinking on both text-only and multimodal benchmarks. | |
| <div align="center"> | |
| | Benchmark | P1-VL-30B-A3B | Qwen3-VL-30B-A3B-Thinking | | |
| | :-------------: | :-----------: | :--------------------------------: | | |
| | AIME24 | **90.4** | 90.0 | | |
| | AIME25 | **87.9** | 83.7 | | |
| | HMMT-Feb | **73.3** | 70.0 | | |
| | HMMT-Nov | **85.4** | 80.8 | | |
| | IMO-Answerbench | **65.3** | 60.3 | | |
| | AMOBench | **44.5** | 37.0 | | |
| | BeyondAIME | **65.9** | 63.8 | | |
| | Brumo | **89.2** | 83.8 | | |
| | CMICC | **79.1** | 73.4 | | |
| | GPQA | **76.5** | 73.1 | | |
| | LiveBench | **72.7** | 71.3 | | |
| | HLE | **13.4** | 12.3 | | |
| | MMMU | 73.6 | **74.8** | | |
| | MMMU-Pro | **63.4** | 62.3 | | |
| | EMMA-Mini | **64.8** | 61.4 | | |
| | MathVista-Mini | **79.4** | 79.2 | | |
| </div> | |
| ## Usage | |
| ```python | |
| from transformers import Qwen3VLMoeForConditionalGeneration, AutoProcessor | |
| from PIL import Image | |
| model_name = "PRIME-RL/P1-VL-30B-A3B" | |
| # Load model and processor | |
| model = Qwen3VLMoeForConditionalGeneration.from_pretrained( | |
| model_name, dtype="auto", device_map="auto" | |
| ) | |
| processor = AutoProcessor.from_pretrained(model_name) | |
| # Load diagram image | |
| image = Image.open("physics_diagram.png") | |
| # Physics problem with visual input | |
| messages = [ | |
| { | |
| "role": "user", | |
| "content": [ | |
| { | |
| "type": "image", | |
| "image": image, | |
| }, | |
| { | |
| "type": "text", | |
| "text": """Analyze this physics diagram and solve the problem: | |
| A block of mass m is placed on an inclined plane with angle θ. | |
| The coefficient of kinetic friction is μ. | |
| Calculate the acceleration of the block down the incline.""", | |
| }, | |
| ], | |
| } | |
| ] | |
| # Preparation for inference | |
| inputs = processor.apply_chat_template( | |
| messages, | |
| tokenize=True, | |
| add_generation_prompt=True, | |
| return_dict=True, | |
| return_tensors="pt" | |
| ) | |
| # Inference: Generation of the output | |
| generated_ids = model.generate(**inputs, max_new_tokens=8192) | |
| generated_ids_trimmed = [ | |
| out_ids[len(in_ids) :] for in_ids, out_ids in zip(inputs.input_ids, generated_ids) | |
| ] | |
| output_text = processor.batch_decode( | |
| generated_ids_trimmed, skip_special_tokens=True, clean_up_tokenization_spaces=False | |
| ) | |
| print(output_text[0]) | |
| ``` | |
| ## 🙏 Acknowledgements | |
| We are grateful to the open-source community for their invaluable contributions. Special thanks to: | |
| - **[Qwen3-VL](https://huggingface.co/collections/Qwen/qwen3-vl)** - for providing the foundational base models that powered our research | |
| - **[verl](https://github.com/volcengine/verl)** - for the versatile reinforcement learning framework that enabled our training pipeline | |
| - **[vLLM](https://github.com/vllm-project/vllm)** - for the efficient LLM serving and inference infrastructure | |
| - **[Megatron-LM](https://github.com/NVIDIA/Megatron-LM)** - for the large-scale model training framework | |
| ## Citation | |
| ```bibtex | |
| @misc{p1vl2025, | |
| title={P1-VL: Bridging Visual Perception and Scientific Reasoning in Physics Olympiads}, | |
| author={Yun Luo and Futing Wang and Qianjia Cheng and Fangchen Yu and Haodi Lei and Jianhao Yan and Chenxi Li and Jiacheng Chen and Yufeng Zhao and Haiyuan Wan and Yuchen Zhang and Shenghe Zheng and Junchi Yao and Qingyang Zhang and Haonan He and Wenxuan Zeng and Li Sheng and Chengxing Xie and Yuxin Zuo and Yizhuo Li and Yulun Wu and Rui Huang and Dongzhan Zhou and Kai Chen and Yu Qiao and Lei Bai and Yu Cheng and Ning Ding and Bowen Zhou and Peng Ye and Ganqu Cui}, | |
| year={2026}, | |
| url={https://arxiv.org/abs/2602.09443} | |
| } | |
| ``` |
Xet Storage Details
- Size:
- 7.58 kB
- Xet hash:
- 704fb791e23b52b16a62aaeefae01ec453599377a022110c2ba512c7cb584c12
·
Xet efficiently stores files, intelligently splitting them into unique chunks and accelerating uploads and downloads. More info.