Instructions to use Alibaba-Apsara/DASD-30B-A3B-Thinking-Preview with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Alibaba-Apsara/DASD-30B-A3B-Thinking-Preview with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="Alibaba-Apsara/DASD-30B-A3B-Thinking-Preview") messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("Alibaba-Apsara/DASD-30B-A3B-Thinking-Preview") model = AutoModelForCausalLM.from_pretrained("Alibaba-Apsara/DASD-30B-A3B-Thinking-Preview") messages = [ {"role": "user", "content": "Who are you?"}, ] inputs = tokenizer.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=40) print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use Alibaba-Apsara/DASD-30B-A3B-Thinking-Preview with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "Alibaba-Apsara/DASD-30B-A3B-Thinking-Preview" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Alibaba-Apsara/DASD-30B-A3B-Thinking-Preview", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/Alibaba-Apsara/DASD-30B-A3B-Thinking-Preview
- SGLang
How to use Alibaba-Apsara/DASD-30B-A3B-Thinking-Preview with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "Alibaba-Apsara/DASD-30B-A3B-Thinking-Preview" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Alibaba-Apsara/DASD-30B-A3B-Thinking-Preview", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "Alibaba-Apsara/DASD-30B-A3B-Thinking-Preview" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Alibaba-Apsara/DASD-30B-A3B-Thinking-Preview", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Docker Model Runner
How to use Alibaba-Apsara/DASD-30B-A3B-Thinking-Preview with Docker Model Runner:
docker model run hf.co/Alibaba-Apsara/DASD-30B-A3B-Thinking-Preview
File size: 6,236 Bytes
6c91f39 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 | ---
license: apache-2.0
pipeline_tag: text-generation
library_name: transformers
---
# <img src="assets/ali.webp" alt="Ali" style="height: 1.2em; vertical-align: middle; margin-right: 0.4em;"> Apsara-Reason: Distribution-Aligned Sequence Distillation Enabling Superior Long-CoT Reasoning
<!-- <p align="center">
<img src="assets/ali.webp" alt="Alibaba-Apsara" style="height: 1em; vertical-align: middle;"> <a href="https://huggingface.co/Alibaba-Apsara">Alibaba-Apsara</a>   |    📑 <a href="https://arxiv.org/abs/2506.xxxxx">Paper</a>    |    📂 <a href="https://apsara-reason.github.io">Data</a>   
</p> -->
[](https://github.com/D2I-ai/apsara-reason) 
<a href="https://arxiv.org/abs/2511.xx" target="_blank"><img src="https://img.shields.io/badge/Report(coming soon)-b5212f.svg?logo=arxiv" height="21px"></a>
[](https://huggingface.co/Alibaba-Apsara/Apsara-Reason-4B) 
[](https://www.modelscope.cn/models/Alibaba-Apsara/Apsara-Reason-4B) 
[](https://huggingface.co/Alibaba-Apsara/Alibaba-Apsara/Apsara-Reason-30B-A3B-Preview) 
[](https://www.modelscope.cn/models/Alibaba-Apsara/Apsara-Reason-30B-A3B-Preview) 
[](https://huggingface.co/datasets/Alibaba-Apsara/Apsara-Reason-v1-SFT) 
[](https://www.modelscope.cn/datasets/Alibaba-Apsara/Apsara-Reason-v1-SFT) 
## 🚀 Introduction
We release Apsara-Reason-30B-A3B-Preview, a highly capable 30B Mixture-of-Experts (MoE) language model specialized in long chain-of-thought (Long-CoT) reasoning across mathematics, code generation, and scientific reasoning. Apsara-Reason-30B-A3B-Preview is post-trained from **Qwen3-30B-A3B-Instruct-2507** (non-thinking student) and distilled from **gpt-oss-120b** (teacher) via our distribution-aligned sequence distillation pipeline.
> Note1: To demonstrate the scalability and efficiency of our data recipe, this preview model was trained only on the first-stage (Low-Temperature) dataset (~105K samples) derived from our 4B pipeline, without any re-curation or additional RL. Even with this lightweight recipe, it achieves excellent performance among open MoE models.
> Note2: This model (Apsara-Reason-30B-A3B-Preview) is a preliminary research artifact trained only on the first stage (Low-Temperature Sampling) of our pipeline to demonstrate the scalability of our data recipe. For the fully trained model and complete methodology, please refer to [Apsara-Reason-4B](https://huggingface.co/Alibaba-Apsara/Apsara-Reason-4B) and our Technical Report.
<div style="text-align: center;">
<img src="assets/size_30b_a3b-performance.png" alt="benchmark" style="width: 90%;">
</div>
---
## ⚡ Quick Start
```python
from transformers import AutoModelForCausalLM, AutoTokenizer
model_name = "Alibaba-Apsara/Apsara-Reason-30B-A3B-Preview"
tokenizer = AutoTokenizer.from_pretrained(model_name, trust_remote_code=True)
model = AutoModelForCausalLM.from_pretrained(
model_name,
torch_dtype="auto",
device_map="auto",
trust_remote_code=True,
)
prompt = "Natalia sold clips to 48 of her friends in April, and then she sold half as many clips in May. How many clips did Natalia sell altogether in April and May?"
messages = [
{"role": "system", "content": "You are a helpful assistant."},
{"role": "user", "content": prompt}
]
text = tokenizer.apply_chat_template(
messages,
tokenize=False,
add_generation_prompt=True,
)
model_inputs = tokenizer([text], return_tensors="pt").to(model.device)
generated_ids = model.generate(
**model_inputs,
max_new_tokens=81920,
)
output_ids = generated_ids[0][len(model_inputs.input_ids[0]):].tolist()
content = tokenizer.decode(output_ids, skip_special_tokens=True)
print(content)
```
> Note: We include the system prompt, as it was used during all training stages. To ensure consistent output quality, we recommend including the same system prompt during actual usage; otherwise, the model's responses may be affected.
For deployment, you can use sglang>=0.4.6.post1 or vllm>=0.8.5 or to create an OpenAI-compatible API endpoint:
- SGLang:
```
python -m sglang.launch_server --model-path Alibaba-Apsara/Apsara-Reason-30B-A3B-Preview --context-length 262144
```
- vLLM:
```
vllm serve Alibaba-Apsara/Apsara-Reason-30B-A3B-Preview --max-model-len 262144
```
## 💡Best Practices
To achieve optimal performance, we suggest using **Temperature=1.0, TopP=1.0**.
## 📜 Licence
The model weights are licensed under Apache 2.0 License.
## ⚠️ Limitation
While Apsara-Reason-30B-A3B-Preview demonstrates remarkable performance across mathematical, scientific, and coding benchmarks, **it is currently limited by the absence of tool integration and function calling capabilities.** Operating strictly within the text space, the model cannot interact with external interfaces such as code executors or APIs, which constrains its utility in agent-based workflows; however, future iterations aim to bridge this gap by integrating capabilities like knowledge retrieval and tool invocation to support more complex, interactive reasoning tasks.
## 📚 Citation
Apsara-Reason is developed by Alibaba Cloud, as part of our mission to advance open, efficient, and trustworthy reasoning systems. If you find this work useful in your research or applications, please cite our technical report (coming soon).
We welcome collaboration, feedback, and community contributions to push the boundaries of what small models can reason about—transparently and responsibly.
|