Instructions to use ArchSid/RHQE_gemma-2-9b_layer_-1 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use ArchSid/RHQE_gemma-2-9b_layer_-1 with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("google/gemma-2-9b-it") model = PeftModel.from_pretrained(base_model, "ArchSid/RHQE_gemma-2-9b_layer_-1") - Notebooks
- Google Colab
- Kaggle
| {"mean_regression": {"name": "mean_regression", "in_size": 3584, "num_outputs": 1, "layer_hook": -1, "hidden_size": 0, "num_layers": 1, "output_activation": "linear", "target": "mean_regression", "is_causal_lm": false, "pred_for_sequence": true, "is_regression": true, "output_bias": false, "loss_fct": "mse", "trainable": true, "loss_weight": 0.002, "ignore_pads": true, "block_gradients": false}} |