| --- |
| base_model: deepseek-ai/DeepSeek-R1-Distill-Qwen-32B |
| license: mit |
| pipeline_tag: text-generation |
| library_name: furiosa-llm |
| tags: |
| - furiosa-ai |
| --- |
| # Model Overview |
| - **Model Architecture:** Qwen2 |
| - **Input:** Text |
| - **Output:** Text |
| - **Model Optimizations:** |
| - **Context Length:** 32k tokens |
| - Maximum Prompt Length: 32768 tokens |
| - Maximum Generation Length: 32768 tokens |
| - **Intended Use Cases:** Intended for commercial and non-commercial use. Same as [deepseek-ai/DeepSeek-R1-Distill-Qwen-32B](https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Qwen-32B), this models is intended for assistant-like chat. |
| - **Release Date:** 08/26/2025 |
| - **Version:** v2025.3 |
| - **License(s):** [MIT License](https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Qwen-32B/blob/main/LICENSE) |
| - **Supported Inference Engine(s):** Furiosa LLM |
| - **Supported Hardware Compatibility:** FuriosaAI RNGD |
| - **Preferred Operating System(s):** Linux |
|
|
|
|
| ## Description: |
| This model is the pre-compiled version of the [deepseek-ai/DeepSeek-R1-Distill-Qwen-32B](https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Qwen-32B), |
| which is an auto-regressive language model that uses an optimized transformer architecture. |
|
|
| ## Usage |
|
|
| To run this model with [Furiosa-LLM](https://developer.furiosa.ai/latest/en/furiosa_llm/intro.html), |
| follow the example command below after |
| [installing Furiosa-LLM and its prerequisites](https://developer.furiosa.ai/latest/en/getting_started/furiosa_llm.html#installing-furiosa-llm). |
|
|
| ```sh |
| furiosa-llm serve furiosa-ai/DeepSeek-R1-Distill-Qwen-32B \ |
| --reasoning-parser deepseek_r1 |
| ``` |
|
|
