OpenASR commited on
Commit
176446a
Β·
verified Β·
0 Parent(s):

publish whisper-tiny OpenASR packs

Browse files
.gitattributes ADDED
@@ -0,0 +1 @@
 
 
1
+ *.oasr filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,114 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ base_model: openai/whisper-tiny
4
+ pipeline_tag: automatic-speech-recognition
5
+ library_name: openasr
6
+ tags:
7
+ - automatic-speech-recognition
8
+ - speech-to-text
9
+ - openasr
10
+ - oasr
11
+ - whisper-tiny
12
+ ---
13
+
14
+ <div align="center">
15
+
16
+ # Whisper Tiny Β· OpenASR
17
+
18
+ **The smallest multilingual Whisper for fast local transcription**
19
+
20
+ [![License](https://img.shields.io/badge/license-Apache--2.0-2563eb.svg)](https://huggingface.co/openai/whisper-tiny/blob/main/README.md)
21
+ [![Format](https://img.shields.io/badge/format-.oasr-7c3aed.svg)](https://github.com/QuintinShaw/openasr)
22
+ [![Runtime](https://img.shields.io/badge/runtime-OpenASR-111827.svg)](https://openasr.org)
23
+ [![Base model](https://img.shields.io/badge/base-whisper--tiny-f59e0b.svg)](https://huggingface.co/openai/whisper-tiny)
24
+
25
+ Native speech-to-text in the **[OpenASR](https://github.com/QuintinShaw/openasr)** runtime β€”
26
+ engineered for peak performance on CPU & GPU, **no Python at inference time**.
27
+
28
+ </div>
29
+
30
+ ---
31
+
32
+ ## ✨ Highlights
33
+
34
+ - 🎧 **Multilingual ASR** β€” transcribes many languages and can translate speech to English
35
+ - ⚑ **39M parameters** β€” the smallest Whisper checkpoint, the fastest and lightest to run
36
+ - 🌐 **Weak-supervision scale** β€” trained with Whisper's 680k-hour labelled speech corpus
37
+ - πŸ¦€ **Native in OpenASR** β€” `.oasr` packs run with no Python at inference, engineered for peak performance on CPU & GPU
38
+
39
+ ## πŸš€ Quickstart
40
+
41
+ ```bash
42
+ # 1. Install the OpenASR CLI Β· https://openasr.org
43
+ # 2. Pull a build (pick a quant β€” see the table below)
44
+ openasr pull whisper-tiny:q8
45
+
46
+ # 3. Transcribe
47
+ openasr transcribe audio.wav --model whisper-tiny
48
+ ```
49
+
50
+ All builds for this model:
51
+
52
+ ```bash
53
+ openasr pull whisper-tiny:fp16
54
+ openasr pull whisper-tiny:q8
55
+ openasr pull whisper-tiny:q4
56
+ ```
57
+
58
+ ## πŸ“¦ Available builds
59
+
60
+ | Quant | File (`.oasr`) | Size | RAM peak | RTF Β· M1 CPU | RTF Β· M1 GPU | JFK Ξ”WER vs fp16 |
61
+ |:------|:---------------|-----:|---------:|-------------:|-------------:|-----------------:|
62
+ | fp16 | `whisper-tiny-fp16.oasr` | 79 MB | 321 MB | 0.04Γ— | 0.03Γ— | 0.0% |
63
+ | q8_0 | `whisper-tiny-q8_0.oasr` | 63 MB | 275 MB | 0.04Γ— | 0.03Γ— | 0.0% |
64
+ | q4_k | `whisper-tiny-q4_k.oasr` | 61 MB | 274 MB | 0.04Γ— | 0.03Γ— | 0.0% |
65
+
66
+ <sub>RTF = real-time factor on the fixed 11s JFK clip (**lower is faster**); RAM peak measured per pack
67
+ in an isolated subprocess. JFK Ξ”WER compares each quantized build's JFK transcript to this model's
68
+ fp16 JFK transcript, so it measures quantization drift rather than absolute recognition accuracy.
69
+ **q8_0** is the recommended default β€” near-reference quality at a fraction of the
70
+ footprint.</sub>
71
+
72
+ ## 🧠 About Whisper Tiny
73
+
74
+ Whisper Tiny is OpenAI's 39M-parameter multilingual Whisper checkpoint, the smallest member of
75
+ the Whisper family. It uses the standard Whisper encoder-decoder architecture for automatic
76
+ speech recognition and speech translation, trained with large-scale weak supervision on 680k
77
+ hours of labelled speech. The tiny model trades some accuracy for the lowest footprint and
78
+ fastest inference, which suits low-resource devices and latency-sensitive use. This OpenASR
79
+ repo repackages the original `openai/whisper-tiny` weights as `.oasr` packs that run natively
80
+ in the OpenASR runtime with no Python at inference time. For most users the q8_0 build is the
81
+ recommended default; q4_k is for the tightest memory budgets and fp16 is for verification or
82
+ maximum fidelity.
83
+
84
+ ## βš™οΈ How these packs were made
85
+
86
+ Converted from [openai/whisper-tiny](https://huggingface.co/openai/whisper-tiny) with the OpenASR importer:
87
+
88
+ ```bash
89
+ openasr model-pack import-whisper-local <src> <out>.oasr \
90
+ --package-id whisper-tiny --quantization {fp16,q8-0,q4-k}
91
+ ```
92
+
93
+ The `.oasr` container is GGUF-backed; packs use zero-copy mmap weight binding and graph
94
+ buffer reuse to keep peak memory low.
95
+
96
+ ## βš–οΈ License
97
+
98
+ These packs **inherit the upstream model's license: Apache-2.0**
99
+ ([source](https://huggingface.co/openai/whisper-tiny/blob/main/README.md)). OpenASR packaging retains the upstream copyright and
100
+ NOTICE; the only modifications are format conversion and quantization.
101
+
102
+ ## πŸ™ Acknowledgements
103
+
104
+ This pack is a redistribution of **Whisper Tiny**, released by **OpenAI**
105
+ ([openai/whisper-tiny](https://huggingface.co/openai/whisper-tiny)).
106
+ All credit for the original model, training recipe, and weights belongs to OpenAI. The
107
+ upstream Hugging Face model card declares Apache-2.0 licensing; OpenASR only converts the
108
+ weights into `.oasr` packages and adds quantized builds for local runtime use.
109
+
110
+ ## πŸ”— Links
111
+
112
+ - πŸ¦€ **OpenASR** β€” <https://github.com/QuintinShaw/openasr>
113
+ - 🌐 **Website** β€” <https://openasr.org>
114
+ - πŸ€— **Upstream model** β€” [openai/whisper-tiny](https://huggingface.co/openai/whisper-tiny)
whisper-tiny-fp16.oasr ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bc3f2c4c1f3e887d8e2e7f614febcdbd2bfe4acd325b104afe2d6c206f3ce60f
3
+ size 78793088
whisper-tiny-q4_k.oasr ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:79a947c5060fa981f29e1729ff349946f06dc689bdc02a1808dc8cabe705d853
3
+ size 60950912
whisper-tiny-q8_0.oasr ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:13346d7bd47d349ae9e35be5cc8595997be0c2d2a5bbe41b4e3ef1c60a98ca17
3
+ size 63310208