Instructions to use trillionlabs/Trillion-LLaVA-7B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use trillionlabs/Trillion-LLaVA-7B with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("visual-question-answering", model="trillionlabs/Trillion-LLaVA-7B")# Load model directly from transformers import AutoModelForCausalLM model = AutoModelForCausalLM.from_pretrained("trillionlabs/Trillion-LLaVA-7B", dtype="auto") - Notebooks
- Google Colab
- Kaggle
| { | |
| "attn_implementation": null, | |
| "bos_token_id": 0, | |
| "do_sample": true, | |
| "eos_token_id": 128001, | |
| "pad_token_id": 128004, | |
| "temperature": 0.6, | |
| "top_p": 0.9, | |
| "transformers_version": "4.51.3" | |
| } | |