---
datasets:
- tatsu-lab/alpaca
base_model:
- Qwen/Qwen3-14B
pipeline_tag: text-generation
---
## Using Hardware

- CPU: AMD Ryzen Threadripper PRO 7995WX
- MB: GIGABYTE AI TOP TRX50
- GPU: RTX 5090*1
- RAM: RDIMM DDR5 5600 128GB*2

## Using Software

- CUDA version: 13.0
- CUDA driver version: 580.95.05
- pyTorch: 2.10.0+cu130
- transformers: 5.3.0
- llmcompressor: 0.10.0.1
- vllm: 0.17.1

## Backbone Model

[Qwen/Qwen3-14B](https://huggingface.co/Qwen/Qwen3-14B)

## Using Dataset

[tatsu-lab/alpaca](https://huggingface.co/datasets/tatsu-lab/alpaca) convert as chat template.


## Compare

| -- | origin model(BF16) | Quantization(This Model) |
| :--- | :---: | ---: |
| leaderboard_gpqa | --- | --- |
| VRAM Usage | 27.52 GiB | 9.9 GiB |