Calandracas commited on
Commit
60d690e
·
verified ·
1 Parent(s): d0a6656

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +38 -12
README.md CHANGED
@@ -1,27 +1,53 @@
1
  ---
2
- license: agpl-3.0
 
3
  tags:
4
- - gemma
 
 
 
 
5
  - litertlm
6
  - android
 
 
 
 
 
 
7
  ---
8
 
9
  # gemma-4-E2B-it-qat-heretic-LiteRT
10
 
11
- Gemma 4 E2B converted to the LiteRT-LM (`.litertlm`) format for on-device
12
- inference with [LiteRT-LM](https://github.com/google-ai-edge/litert-lm) /
13
- the Free Slopdroid Android app.
 
 
14
 
15
- ## Source & method
16
 
 
 
17
  - **Source checkpoint:** `coder3101/gemma-4-E2B-it-qat-q4_0-unquantized-heretic`
18
- - **Quantization:** `mixed48` (Google gemma4 mixed 4/8-bit mobile scheme)
19
 
20
- Produced with the Free Slopdroid `convert_gemma4.py` converter (export ->
21
- quantize -> package), which runs the same three stages as the
22
- [Google docs](https://github.com/google-ai-edge/ai-edge-quantizer/tree/main).
 
 
 
 
 
 
 
 
 
 
 
23
 
24
  ## Usage
25
 
26
- Place `model.litertlm` under the app's models folder on the device and the
27
- app loads it automatically. See the Free Slopdroid README for details.
 
1
  ---
2
+ library_name: litertlm
3
+ license: apache-2.0
4
  tags:
5
+ - heretic
6
+ - uncensored
7
+ - decensored
8
+ - abliterated
9
+ - ara
10
  - litertlm
11
  - android
12
+ - on-device
13
+ - litert
14
+ pipeline_tag: any-to-any
15
+ base_model:
16
+ - google/gemma-4-E2B-it-qat-q4_0-unquantized
17
+ license_link: https://ai.google.dev/gemma/docs/gemma_4_license
18
  ---
19
 
20
  # gemma-4-E2B-it-qat-heretic-LiteRT
21
 
22
+ > [!NOTE]
23
+ > This is a **quantized / format-converted derivative** of an upstream
24
+ > checkpoint, repackaged into the LiteRT-LM (`.litertlm`) format for
25
+ > on-device inference. It is **not** a retrained or fine-tuned model — the
26
+ > weights are the upstream checkpoint's, reformatted for LiteRT-LM.
27
 
28
+ ## Model details
29
 
30
+ - **Format:** LiteRT-LM `.litertlm` (weights + tokenizer + graph in one file)
31
+ - **Runtime:** [LiteRT-LM](https://github.com/google-ai-edge/litert-lm) (XNNPACK CPU / OpenCL GPU)
32
  - **Source checkpoint:** `coder3101/gemma-4-E2B-it-qat-q4_0-unquantized-heretic`
33
+ - **Base model(s):**
34
 
35
+ - `google/gemma-4-E2B-it-qat-q4_0-unquantized`
36
+
37
+ - **Quantization:** `mixed48` (Google gemma4 mixed 4/8-bit mobile scheme (INT4 weights + INT8 projections))
38
+ - **License:** `apache-2.0` + [Gemma Terms of Use](https://ai.google.dev/gemma/docs/gemma_4_license)
39
+
40
+ ## How it was produced
41
+
42
+ Converted with `convert_gemma4.py`, which runs the same three stages described in the [Google ai-edge-quantizer docs](https://github.com/google-ai-edge/ai-edge-quantizer/tree/main):
43
+
44
+ 1. **Export** — HF checkpoint (PyTorch/safetensors) → float TFLite flatbuffer (via `litert-torch` `export_hf`)
45
+ 2. **Quantize** — float TFLite → quantized TFLite (via `ai-edge-quantizer` recipe `mixed48`)
46
+ 3. **Package** — quantized TFLite → `.litertlm` bundle (via `litert-torch` `litert_lm_builder`)
47
+
48
+ No weights were modified, retrained, or merged — only reformatted and quantized.
49
 
50
  ## Usage
51
 
52
+ Load `model.litertlm` with any LiteRT-LM runtime or client. Place it under your
53
+ app's models folder and the runtime loads it automatically.