PEFT
Safetensors
mistral
alignment-handbook
Generated from Trainer
trl
sft
4-bit precision
bitsandbytes
Instructions to use erbacher/zephyr-7b-proimg-qlora-user with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use erbacher/zephyr-7b-proimg-qlora-user with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("HuggingFaceH4/zephyr-7b-beta") model = PeftModel.from_pretrained(base_model, "erbacher/zephyr-7b-proimg-qlora-user") - Notebooks
- Google Colab
- Kaggle
| { | |
| "epoch": 3.0, | |
| "eval_loss": 0.5821943879127502, | |
| "eval_runtime": 40.1257, | |
| "eval_samples": 200, | |
| "eval_samples_per_second": 1.346, | |
| "eval_steps_per_second": 0.174, | |
| "train_loss": 0.5003105528586733, | |
| "train_runtime": 13978.5586, | |
| "train_samples": 6807, | |
| "train_samples_per_second": 0.387, | |
| "train_steps_per_second": 0.049 | |
| } |