Text Generation
PEFT
French
English
llama2
french
LLAMA7B
opensource
code
finance
text-generation-inference
legal
llama
lora
LLAMA2
Instructions to use Faradaylab/ARIA_7B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use Faradaylab/ARIA_7B with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("meta-llama/Llama-2-7b-chat-hf") model = PeftModel.from_pretrained(base_model, "Faradaylab/ARIA_7B") - Notebooks
- Google Colab
- Kaggle
Hello. Thank you for this cool model. Is it a qLora or something like that? Could you upload a full pytorch model, please?
#1
by NikolayKozloff - opened
...
Hello thank you for the message, we finetuned the model with peft and lora :) .We'll share more insights soon.