Instructions to use sachin/vit2distilgpt2 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use sachin/vit2distilgpt2 with Transformers:
# Use a pipeline as a high-level helper # Warning: Pipeline type "image-to-text" is no longer supported in transformers v5. # You must load the model directly (see below) or downgrade to v4.x with: # 'pip install "transformers<5.0.0' from transformers import pipeline pipe = pipeline("image-to-text", model="sachin/vit2distilgpt2")# Load model directly from transformers import AutoTokenizer, AutoModelForMultimodalLM tokenizer = AutoTokenizer.from_pretrained("sachin/vit2distilgpt2") model = AutoModelForMultimodalLM.from_pretrained("sachin/vit2distilgpt2", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Adding WandB results
Browse files
README.md
CHANGED
|
@@ -34,4 +34,8 @@ Note that the output sentence may be repeated, hence a post processing step may
|
|
| 34 |
|
| 35 |
## Bias Warning
|
| 36 |
This model may be biased due to dataset, lack of long training and the model itself. The following gender bias is an example.
|
| 37 |
-

|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 34 |
|
| 35 |
## Bias Warning
|
| 36 |
This model may be biased due to dataset, lack of long training and the model itself. The following gender bias is an example.
|
| 37 |
+

|
| 38 |
+
|
| 39 |
+
## Results
|
| 40 |
+
<iframe src="https://wandb.ai/sachinruk/Vit2GPT2/reports/Shared-panel-22-01-27-23-01-56--VmlldzoxNDkyMTM3?highlightShare" style="border:none;height:1024px;width:100%">
|
| 41 |
+
|