Hugging Face's logo

litert-community
/
gemma-4-E2B-it-litert-lm

LiteRT-LM
Model card Files
xet
 Community
33
marissaw commited on
Commit
2fa50dd
·
verified ·
1 Parent(s): c8a411f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -70,8 +70,8 @@ It uses the Gemma quantization scheme that employs a mixture of 2bit, 4bit and 8
70
 
71
  | Device &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;| Backend | Prefill (tokens/sec) | Decode (tokens/sec) | <span style="white-space: nowrap;">Time-to-first</span>-token (sec) | Model size (MB) | CPU/GPU Memory (MB) |
72
  | :---- | :---- | :---- | :---- | :---- | :---- | :---- |
73
- | MacBook Pro M4 | CPU | 901 | 41.6 | 1.1 | 2583 | 736 |
74
- | MacBook Pro M4 | GPU | 7,835 | 160.2 | 0.1 | 2583 | 1623 |
75
 
76
  **IoT**
77
 
 
70
 
71
  | Device &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;| Backend | Prefill (tokens/sec) | Decode (tokens/sec) | <span style="white-space: nowrap;">Time-to-first</span>-token (sec) | Model size (MB) | CPU/GPU Memory (MB) |
72
  | :---- | :---- | :---- | :---- | :---- | :---- | :---- |
73
+ | MacBook Pro M4 Max | CPU | 901 | 41.6 | 1.1 | 2583 | 736 |
74
+ | MacBook Pro M4 Max | GPU | 7,835 | 160.2 | 0.1 | 2583 | 1623 |
75
 
76
  **IoT**
77