random-stuff
Collection
16 items • Updated
How to use MuXodious/gemma-4-26B-A4B-it-SOMPOA-heresy-Lora with PEFT:
from peft import PeftModel
from transformers import AutoModelForCausalLM
base_model = AutoModelForCausalLM.from_pretrained("google/gemma-4-26B-A4B-it")
model = PeftModel.from_pretrained(base_model, "MuXodious/gemma-4-26B-A4B-it-SOMPOA-heresy-Lora")This is a LoRA extracted from a language model. It was extracted using mergekit.
This LoRA adapter was extracted from MuXodious/gemma-4-26B-A4B-it-SOMPOA-heresy and uses google/gemma-4-26B-A4B-it as a base.
The following command was used to extract this LoRA adapter:
mergekit-extract-lora --model MuXodious/gemma-4-26B-A4B-it-SOMPOA-heresy --base-model google/gemma-4-26B-A4B-it --out-path ./26B-SOMPOA-lora --max-rank 128 --device cuda
Base model
google/gemma-4-26B-A4B