Instructions to use mobilint/whisper.cpp with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Mobilint
How to use mobilint/whisper.cpp with Mobilint:
# pip install mblt-model-zoo from mblt_model_zoo.vision import MBLT_Engine model = MBLT_Engine( model_cls="whisper.cpp", model_type="DEFAULT", model_path="", core_mode="global8", ) try: image = model.preprocess("path/to/image.jpg") output = model(image) result = model.postprocess(output) finally: model.dispose() - Notebooks
- Google Colab
- Kaggle
Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
|
@@ -6,6 +6,7 @@ tags:
|
|
| 6 |
- automatic-speech-recognition
|
| 7 |
- ggml
|
| 8 |
- mobilint
|
|
|
|
| 9 |
language:
|
| 10 |
- en
|
| 11 |
- zh
|
|
@@ -22,35 +23,52 @@ language:
|
|
| 22 |
library_name: whisper.cpp
|
| 23 |
---
|
| 24 |
|
| 25 |
-
# whisper.cpp
|
| 26 |
|
| 27 |
-
This repository provides
|
| 28 |
|
| 29 |
-
## Available
|
| 30 |
|
| 31 |
-
| Model | File | Size |
|
| 32 |
-
|-------|------|------|------------|
|
| 33 |
-
| whisper-small | `ggml-small.bin` | 466 MB |
|
|
|
|
|
|
|
| 34 |
|
| 35 |
## Usage
|
| 36 |
|
| 37 |
-
|
| 38 |
|
| 39 |
```bash
|
| 40 |
-
#
|
| 41 |
-
whisper-cli-mblt -hf mobilint/whisper-small -f audio.wav
|
| 42 |
-
|
| 43 |
-
# Or manual paths
|
| 44 |
whisper-cli-mblt \
|
| 45 |
-m ggml-small.bin \
|
| 46 |
-
--mxq-encoder
|
| 47 |
-
--mxq-decoder
|
| 48 |
-f audio.wav
|
|
|
|
|
|
|
|
|
|
| 49 |
```
|
| 50 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 51 |
## Related Repositories
|
| 52 |
|
| 53 |
-
- **[mobilint/whisper-small](https://huggingface.co/mobilint/whisper-small)** —
|
| 54 |
- **[ggerganov/whisper.cpp](https://huggingface.co/ggerganov/whisper.cpp)** — Upstream GGML models for CPU inference
|
| 55 |
|
| 56 |
## License
|
|
|
|
| 6 |
- automatic-speech-recognition
|
| 7 |
- ggml
|
| 8 |
- mobilint
|
| 9 |
+
- npu
|
| 10 |
language:
|
| 11 |
- en
|
| 12 |
- zh
|
|
|
|
| 23 |
library_name: whisper.cpp
|
| 24 |
---
|
| 25 |
|
| 26 |
+
# whisper.cpp Models for Mobilint NPU
|
| 27 |
|
| 28 |
+
This repository provides all model files needed to run [whisper.cpp-mblt](https://git.mobilint.com/algorithm-team/integration/whisper.cpp-mblt), the Mobilint NPU-accelerated fork of [whisper.cpp](https://github.com/ggml-org/whisper.cpp).
|
| 29 |
|
| 30 |
+
## Available Files
|
| 31 |
|
| 32 |
+
| Model | File | Size | Description |
|
| 33 |
+
|-------|------|------|-------------|
|
| 34 |
+
| whisper-small | `ggml-small.bin` | 466 MB | GGML model (tokenizer + weights for CPU fallback) |
|
| 35 |
+
| whisper-small | `ggml-small-encoder.mxq` | 93 MB | Mobilint NPU encoder |
|
| 36 |
+
| whisper-small | `ggml-small-decoder.mxq` | 159 MB | Mobilint NPU decoder |
|
| 37 |
|
| 38 |
## Usage
|
| 39 |
|
| 40 |
+
### NPU Inference (Mobilint)
|
| 41 |
|
| 42 |
```bash
|
| 43 |
+
# Download all files and run
|
|
|
|
|
|
|
|
|
|
| 44 |
whisper-cli-mblt \
|
| 45 |
-m ggml-small.bin \
|
| 46 |
+
--mxq-encoder ggml-small-encoder.mxq \
|
| 47 |
+
--mxq-decoder ggml-small-decoder.mxq \
|
| 48 |
-f audio.wav
|
| 49 |
+
|
| 50 |
+
# Or auto-download from HuggingFace
|
| 51 |
+
whisper-cli-mblt -hf mobilint/whisper-small -f audio.wav
|
| 52 |
```
|
| 53 |
|
| 54 |
+
### CPU Inference (standard whisper.cpp)
|
| 55 |
+
|
| 56 |
+
The `ggml-small.bin` file is also compatible with standard whisper.cpp for CPU-only inference:
|
| 57 |
+
|
| 58 |
+
```bash
|
| 59 |
+
whisper-cli -m ggml-small.bin -f audio.wav
|
| 60 |
+
```
|
| 61 |
+
|
| 62 |
+
## Model Details
|
| 63 |
+
|
| 64 |
+
- **Base model**: [openai/whisper-small](https://huggingface.co/openai/whisper-small) (244M parameters)
|
| 65 |
+
- **Languages**: 99 languages supported (English, Chinese, German, Spanish, Russian, Korean, French, Japanese, Portuguese, Turkish, Polish, and more)
|
| 66 |
+
- **Tasks**: Transcription and translation (to English)
|
| 67 |
+
- **NPU pipeline**: Audio → mel spectrogram (CPU) → encoder (NPU, global4) → decoder (NPU, single core, greedy) → text
|
| 68 |
+
|
| 69 |
## Related Repositories
|
| 70 |
|
| 71 |
+
- **[mobilint/whisper-small](https://huggingface.co/mobilint/whisper-small)** — Original Mobilint whisper-small model with config.json and tokenizer files
|
| 72 |
- **[ggerganov/whisper.cpp](https://huggingface.co/ggerganov/whisper.cpp)** — Upstream GGML models for CPU inference
|
| 73 |
|
| 74 |
## License
|