jiwook-mobilint commited on
Commit
f810329
·
verified ·
1 Parent(s): f70daa3

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +32 -14
README.md CHANGED
@@ -6,6 +6,7 @@ tags:
6
  - automatic-speech-recognition
7
  - ggml
8
  - mobilint
 
9
  language:
10
  - en
11
  - zh
@@ -22,35 +23,52 @@ language:
22
  library_name: whisper.cpp
23
  ---
24
 
25
- # whisper.cpp GGML Models for Mobilint NPU
26
 
27
- This repository provides GGML-format model files for use with [whisper.cpp-mblt](https://git.mobilint.com/algorithm-team/integration/whisper.cpp-mblt), the Mobilint NPU-accelerated fork of [whisper.cpp](https://github.com/ggml-org/whisper.cpp).
28
 
29
- ## Available Models
30
 
31
- | Model | File | Size | Parameters |
32
- |-------|------|------|------------|
33
- | whisper-small | `ggml-small.bin` | 466 MB | 244M |
 
 
34
 
35
  ## Usage
36
 
37
- The GGUF file provides the tokenizer vocabulary and embedding weights. For NPU inference, pair it with the MXQ files from [mobilint/whisper-small](https://huggingface.co/mobilint/whisper-small):
38
 
39
  ```bash
40
- # Auto-download from HuggingFace
41
- whisper-cli-mblt -hf mobilint/whisper-small -f audio.wav
42
-
43
- # Or manual paths
44
  whisper-cli-mblt \
45
  -m ggml-small.bin \
46
- --mxq-encoder whisper-small_encoder.mxq \
47
- --mxq-decoder whisper-small_decoder.mxq \
48
  -f audio.wav
 
 
 
49
  ```
50
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
51
  ## Related Repositories
52
 
53
- - **[mobilint/whisper-small](https://huggingface.co/mobilint/whisper-small)** — Encoder and decoder MXQ files for Mobilint NPU
54
  - **[ggerganov/whisper.cpp](https://huggingface.co/ggerganov/whisper.cpp)** — Upstream GGML models for CPU inference
55
 
56
  ## License
 
6
  - automatic-speech-recognition
7
  - ggml
8
  - mobilint
9
+ - npu
10
  language:
11
  - en
12
  - zh
 
23
  library_name: whisper.cpp
24
  ---
25
 
26
+ # whisper.cpp Models for Mobilint NPU
27
 
28
+ This repository provides all model files needed to run [whisper.cpp-mblt](https://git.mobilint.com/algorithm-team/integration/whisper.cpp-mblt), the Mobilint NPU-accelerated fork of [whisper.cpp](https://github.com/ggml-org/whisper.cpp).
29
 
30
+ ## Available Files
31
 
32
+ | Model | File | Size | Description |
33
+ |-------|------|------|-------------|
34
+ | whisper-small | `ggml-small.bin` | 466 MB | GGML model (tokenizer + weights for CPU fallback) |
35
+ | whisper-small | `ggml-small-encoder.mxq` | 93 MB | Mobilint NPU encoder |
36
+ | whisper-small | `ggml-small-decoder.mxq` | 159 MB | Mobilint NPU decoder |
37
 
38
  ## Usage
39
 
40
+ ### NPU Inference (Mobilint)
41
 
42
  ```bash
43
+ # Download all files and run
 
 
 
44
  whisper-cli-mblt \
45
  -m ggml-small.bin \
46
+ --mxq-encoder ggml-small-encoder.mxq \
47
+ --mxq-decoder ggml-small-decoder.mxq \
48
  -f audio.wav
49
+
50
+ # Or auto-download from HuggingFace
51
+ whisper-cli-mblt -hf mobilint/whisper-small -f audio.wav
52
  ```
53
 
54
+ ### CPU Inference (standard whisper.cpp)
55
+
56
+ The `ggml-small.bin` file is also compatible with standard whisper.cpp for CPU-only inference:
57
+
58
+ ```bash
59
+ whisper-cli -m ggml-small.bin -f audio.wav
60
+ ```
61
+
62
+ ## Model Details
63
+
64
+ - **Base model**: [openai/whisper-small](https://huggingface.co/openai/whisper-small) (244M parameters)
65
+ - **Languages**: 99 languages supported (English, Chinese, German, Spanish, Russian, Korean, French, Japanese, Portuguese, Turkish, Polish, and more)
66
+ - **Tasks**: Transcription and translation (to English)
67
+ - **NPU pipeline**: Audio → mel spectrogram (CPU) → encoder (NPU, global4) → decoder (NPU, single core, greedy) → text
68
+
69
  ## Related Repositories
70
 
71
+ - **[mobilint/whisper-small](https://huggingface.co/mobilint/whisper-small)** — Original Mobilint whisper-small model with config.json and tokenizer files
72
  - **[ggerganov/whisper.cpp](https://huggingface.co/ggerganov/whisper.cpp)** — Upstream GGML models for CPU inference
73
 
74
  ## License