Instructions to use fixie-ai/ultravox-v0_5-llama-3_2-1b with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use fixie-ai/ultravox-v0_5-llama-3_2-1b with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("fixie-ai/ultravox-v0_5-llama-3_2-1b", trust_remote_code=True, dtype="auto") - Notebooks
- Google Colab
- Kaggle
fix: set `clean_up_tokenization_spaces` to `false`
#11 opened 2 months ago
by
maxsloef
GGUF Support
#6 opened 8 months ago
by
abhijithmallya
how to use this pipeline with tool calling?
#5 opened 9 months ago
by
gjz
Can we use the same transformer.pipeline for multiple async calls to the model
#4 opened about 1 year ago
by
awppatel
Model Output Corrupted After Recent Update to ultravox_model.py
👀 2
1
#3 opened about 1 year ago
by
frznkshn
Device set to dtype
2
#2 opened about 1 year ago
by
cdreetz