--- license: apache-2.0 base_model: - huihui-ai/Huihui-gemma-4-E2B-it-abliterated - google/gemma-4-E2B-it tags: - gemma - litert-lm - tflite - abliterated pipeline_tag: text-generation language: - en library_name: transformers model_type: gemma inference: false --- # Gemma-4-E2B-it-abliterated (LiteRT-LM) LiteRT-LM export of `huihui-ai/Huihui-gemma-4-E2B-it-abliterated` for on-device / edge inference workflows. ## Model File - `Gemma-4-E2B-it-abliterated.litertlm` ## Source - Base checkpoint: `huihui-ai/Huihui-gemma-4-E2B-it-abliterated` - Export pipeline: `safetensors-to-litertlm` ## Export Notes - Export format: `.litertlm` (LiteRT-LM bundle) - Quantization: INT8 profile (`dynamic_wi8_afp32`) - Intended runtime: `litert-lm` CLI / LiteRT-LM compatible apps ## Quick Start (CPU) ```bash litert-lm run ./Gemma-4-E2B-it-abliterated.litertlm --prompt "Hi" --backend cpu ``` ## Limitations - Behavior may differ from the original HF checkpoint due to conversion/quantization/runtime differences. - Some export profiles that reduce memory pressure can alter section topology and runtime behavior. ## Safety This model may generate unsafe or incorrect content. Evaluate carefully for your use case and apply application-level safeguards where needed. ## License Please follow the upstream license and usage terms of: - `huihui-ai/Huihui-gemma-4-E2B-it-abliterated` - underlying Gemma model family terms