Qwen3-14B STEM Q&A (Merged)

This is the merged full model (LoRA weights merged into base model) for standalone use.

Author: Khadim Hussain

For the LoRA adapter version (smaller download), see: khadim-hussain/qwen3-14b-stem-qa

Usage

from transformers import AutoModelForCausalLM, AutoTokenizer

model = AutoModelForCausalLM.from_pretrained(
    "khadim-hussain/qwen3-14b-stem-qa-merged",
    torch_dtype="auto",
    device_map="auto",
)
tokenizer = AutoTokenizer.from_pretrained("khadim-hussain/qwen3-14b-stem-qa-merged")

prompt = "<|im_start|>user\nWhat is DNA?<|im_end|>\n<|im_start|>assistant\n"
inputs = tokenizer(prompt, return_tensors="pt").to(model.device)
outputs = model.generate(**inputs, max_new_tokens=256)
print(tokenizer.decode(outputs[0], skip_special_tokens=True))

Model Details

  • Base Model: Qwen/Qwen3-14B
  • Type: Merged (LoRA merged into base weights)
  • Size: ~28GB (bf16)
  • Training: QLoRA fine-tuning on STEM Q&A dataset

Training Metrics

Metric Value
Train Loss 0.461
Eval Loss 0.692
Training Examples 4,260
Evaluation Examples 474

Acknowledgments

License

Apache 2.0 (inherited from Qwen3)

Downloads last month
5
Safetensors
Model size
15B params
Tensor type
BF16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for khadim-hussain/qwen3-14b-stem-qa-merged

Finetuned
Qwen/Qwen3-14B
Finetuned
(318)
this model