Instructions to use fixie-ai/ultravox-v0_4_1-llama-3_1-8b with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use fixie-ai/ultravox-v0_4_1-llama-3_1-8b with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("fixie-ai/ultravox-v0_4_1-llama-3_1-8b", trust_remote_code=True, device_map="auto") - Notebooks
- Google Colab
- Kaggle
ValueError: There is no module or parameter named 'multi_modal_projector.ln_mid' in UltravoxModel
#5 opened over 1 year ago
by
cheaptoner2016
invalid device string :"float32" while doing inference on colab machine
#4 opened over 1 year ago
by
SachinTelecmi
Update README.md
1
#2 opened over 1 year ago
by
reach-vb
The Inference Code is not working properly
3
#1 opened over 1 year ago
by
serdarcaglar