SLLLC/canary-qwen-2.5b-quanto-8bit-safetensors-stt at 39161d5b18879ff824c7d8908647a52bcccf1f68

canary-qwen-2.5b-quanto-8bit-safetensors-stt

1.75 GB

Ctrl+K

Ctrl+K

1 contributor

History: 5 commits

SLLLC's picture

Add quantized artifact file: llm_quantization_map.json

39161d5 verified 3 months ago

docs
Add Canary-Qwen qint8 OpenWebUI STT deployment package 3 months ago
quantized_artifacts
Add quantized artifact file: llm_quantization_map.json 3 months ago
scripts
Add Canary-Qwen qint8 OpenWebUI STT deployment package 3 months ago
systemd
Add Canary-Qwen qint8 OpenWebUI STT deployment package 3 months ago
.gitattributes

1.52 kB
initial commit 3 months ago
NOTICE.md

384 Bytes
Add Canary-Qwen qint8 OpenWebUI STT deployment package 3 months ago
README.md

2.85 kB
Mark base model relation as quantized 3 months ago
SHA256SUMS.txt

1.55 kB
Mark base model relation as quantized 3 months ago
canary_qwen_stt_service.py

5.13 kB
Add Canary-Qwen qint8 OpenWebUI STT deployment package 3 months ago
canary_qwen_stt_service_8001.py

160 Bytes
Add Canary-Qwen qint8 OpenWebUI STT deployment package 3 months ago
requirements.txt

122 Bytes
Add Canary-Qwen qint8 OpenWebUI STT deployment package 3 months ago