Instructions to use ibm-granite/granite-4.0-1b-speech with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use ibm-granite/granite-4.0-1b-speech with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("automatic-speech-recognition", model="ibm-granite/granite-4.0-1b-speech")# Load model directly from transformers import AutoProcessor, AutoModelForMultimodalLM processor = AutoProcessor.from_pretrained("ibm-granite/granite-4.0-1b-speech") model = AutoModelForMultimodalLM.from_pretrained("ibm-granite/granite-4.0-1b-speech", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Update README.md
Browse files
README.md
CHANGED
|
@@ -105,7 +105,7 @@ new_tokens = model_outputs[0, num_input_tokens:].unsqueeze(0)
|
|
| 105 |
output_text = tokenizer.batch_decode(
|
| 106 |
new_tokens, add_special_tokens=False, skip_special_tokens=True
|
| 107 |
)
|
| 108 |
-
print(f"STT output = {output_text[0]
|
| 109 |
```
|
| 110 |
|
| 111 |
### Usage with `vLLM`
|
|
|
|
| 105 |
output_text = tokenizer.batch_decode(
|
| 106 |
new_tokens, add_special_tokens=False, skip_special_tokens=True
|
| 107 |
)
|
| 108 |
+
print(f"STT output = {output_text[0]}")
|
| 109 |
```
|
| 110 |
|
| 111 |
### Usage with `vLLM`
|