Instructions to use unsloth/gemma-4-E4B-it with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Inference
- Local Apps Settings
- Unsloth Studio
How to use unsloth/gemma-4-E4B-it with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for unsloth/gemma-4-E4B-it to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for unsloth/gemma-4-E4B-it to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for unsloth/gemma-4-E4B-it to start chatting
Load model with FastModel
pip install unsloth from unsloth import FastModel model, tokenizer = FastModel.from_pretrained( model_name="unsloth/gemma-4-E4B-it", max_seq_length=2048, )
What is the difference between this model and the original google/gemma-4-E4B-it?
Can you explain the difference between this model and the original one?
I see that they both have the same name. If there is no difference, what is the purpose of this repo?
Many thanks for considering my request.
Unsloth leverages custom-optimized kernels and algorithms designed to significantly reduce VRAM consumption and improve processing speed, making it particularly well-suited for fine-tuning and inference on consumer and prosumer hardware.
This is achieved through proprietary Triton kernels and optimizers that deliver these performance gains without any compromise to model accuracy.
In terms of accuracy, training with Unsloth yields equivalent results to training with Hugging Face. In some cases, accuracy may even be slightly improved, as Unsloth occasionally addresses bugs found in models or training pipelines. The key differentiators of Unsloth are its superior VRAM efficiency, increased training speed, inference speed, and the availability of comprehensive notebook tutorials to guide users through the process.
@CliffUnger , the SHA256 for this (Unsloth's) model.safetensors is the same as Google's official model.safetensors. unsloth/gemma-4-E4B-it/model.safetensors it the SAME EXACT FILE as google/gemma-4-E4B-it/model.safetensors. Why reupload Google's model unmodified and label it as "Finetuned"? Claiming this contains a "proprietary" component feels amount to plagiarism at worst or misleading at best; nothing about unsloth/gemma-4-E4B-it/model.safetensors contains any original work from Unsloth.
I'm sorry but nobody here assumed or labeled this model as Finetuned. This is NOT the finetuned model and Unsloth doesn't declare it as you say.
Unsloth's core value proposition is speed, they claim 2x faster training with significantly less memory usage. Their checkpoints often come pre-configured with:
- Custom kernels (written in Triton) that replace slower PyTorch operations
- Pre-patched attention mechanisms optimized for their training pipeline
- Memory-efficient implementations that reduce VRAM requirements
Many Unsloth checkpoints are pre-converted to work seamlessly with 4-bit quantization (via bitsandbytes) - and other quantizations, if you look the repository the have already quantized models, this is only the model with full precision.
So if you plan to finetune this model (or a quantized version of it) with Unsloth i think is better to choose their checkpoints, if not you can use also google checpoint (also with unsloth training).
Identical Weights ≠ Plagiarism (Under Open Licenses)
"Claiming this contains a "proprietary" component feels amount to plagiarism at worst or misleading at best;"
Gemma models are released under Google's Gemma Terms of Use, which explicitly permit redistribution and rehosting, provided the license terms are honored (attribution, no removal of restrictions, etc.).
If Unsloth is redistributing unmodified base weights, that is not inherently plagiarism in the legal or ethical sense—plagiarism refers to falsely claiming authorship of original creative or intellectual work, not rehosting a legally redistributable file. Even when the model.safetensors file itself is byte-identical, a repository typically adds value through different things:
Have you check the config files (config.json, tokenizer_config.json)? maybe those are pre-set for compatibility with Unsloth's training library
Have you look at the Quantization metadata for 4-bit/8-bit loading?