Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets new
  • Docs
  • Enterprise
  • Pricing
    • Website
      • Tasks
      • HuggingChat
      • Collections
      • Languages
      • Organizations
    • Community
      • Blog
      • Posts
      • Daily Papers
      • Hardware
      • Learn
      • Discord
      • Forum
      • GitHub
    • Solutions
      • Team & Enterprise
      • Hugging Face PRO
      • Enterprise Support
      • Inference Providers
      • Inference Endpoints
      • Storage Buckets

  • Log In
  • Sign Up

SLLLC
/
canary-qwen-2.5b-quanto-8bit-safetensors-stt

Automatic Speech Recognition
Safetensors
English
speech-to-text
canary-qwen
nvidia
qwen
optimum-quanto
qint8
int8
open-webui
openai-compatible
rtx-5090
quanto
quantized
openwebui
1.7gb
audio-encoder-unquantized
llm-only-quant
asr-preserved
systemd
fastapi
webm-opus
browser-mic
quanto-qint8
qint8-safetensors
8-bit precision
8bit
Model card Files Files and versions
xet
Community
canary-qwen-2.5b-quanto-8bit-safetensors-stt
1.75 GB
Ctrl+K
Ctrl+K
  • 1 contributor
History: 14 commits
SLLLC's picture
SLLLC
Update checksums
e55784d verified 2 months ago
  • docs
    Add artifact size and ASR-preservation notes 2 months ago
  • quantized_artifacts
    Add quantized artifact file: artifact_manifest.json 2 months ago
  • scripts
    Add artifact size and ASR-preservation notes 2 months ago
  • systemd
    Add Canary-Qwen qint8 OpenWebUI STT deployment package 2 months ago
  • .gitattributes
    1.52 kB
    initial commit 2 months ago
  • NOTICE.md
    384 Bytes
    Add Canary-Qwen qint8 OpenWebUI STT deployment package 2 months ago
  • README.md
    4.89 kB
    Clarify smaller-than-BF16 VRAM value 2 months ago
  • RENAMED_FROM.md
    299 Bytes
    Add repository rename note 2 months ago
  • SAFETENSORS_ARTIFACT.md
    126 Bytes
    Add artifact size and ASR-preservation notes 2 months ago
  • SHA256SUMS.txt
    2.48 kB
    Update checksums 2 months ago
  • canary_qwen_stt_service.py
    5.13 kB
    Add Canary-Qwen qint8 OpenWebUI STT deployment package 2 months ago
  • canary_qwen_stt_service_8001.py
    160 Bytes
    Add Canary-Qwen qint8 OpenWebUI STT deployment package 2 months ago
  • requirements.txt
    122 Bytes
    Add Canary-Qwen qint8 OpenWebUI STT deployment package 2 months ago