Video-Text-to-Text
Transformers
Safetensors
English
qwen3_5
image-text-to-text
video
multimodal
video-captioning
temporal-grounding
qwen
text-generation
VLM
gptq
4-bit precision
quantized
custom_code
Instructions to use prasannaJagadesh/marlin-2B-GPTQ-4BITS with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use prasannaJagadesh/marlin-2B-GPTQ-4BITS with Transformers:
# Load model directly from transformers import AutoProcessor, AutoModelForMultimodalLM processor = AutoProcessor.from_pretrained("prasannaJagadesh/marlin-2B-GPTQ-4BITS", trust_remote_code=True) model = AutoModelForMultimodalLM.from_pretrained("prasannaJagadesh/marlin-2B-GPTQ-4BITS", trust_remote_code=True, device_map="auto") - Notebooks
- Google Colab
- Kaggle
| { | |
| "_from_model_config": true, | |
| "do_sample": true, | |
| "eos_token_id": [ | |
| 248044, | |
| 248046 | |
| ], | |
| "pad_token_id": 248044, | |
| "transformers_version": "5.12.1", | |
| "use_cache": true, | |
| "output_attentions": false, | |
| "output_hidden_states": false | |
| } | |