Instructions to use kinshuk-h/flan-t5-retacred-kg-direct-peft-qlora-bnb-w-context-large-finetuned with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use kinshuk-h/flan-t5-retacred-kg-direct-peft-qlora-bnb-w-context-large-finetuned with PEFT:
from peft import PeftModel from transformers import AutoModelForSeq2SeqLM base_model = AutoModelForSeq2SeqLM.from_pretrained("google/flan-t5-large") model = PeftModel.from_pretrained(base_model, "kinshuk-h/flan-t5-retacred-kg-direct-peft-qlora-bnb-w-context-large-finetuned") - Notebooks
- Google Colab
- Kaggle