Hugging Face's logo

mavis-ai
/
Gemma4-12B-QAT-Q4

Image-Text-to-Text
MLX
Safetensors
gemma4_unified
gemma4
qat
q4
apple-silicon
conversational
4-bit precision
Model card Files
xet
 Community
mavis-ai commited on
Commit
72c5dd7
·
verified ·
1 Parent(s): f02306b

Update Gemma4 12B QAT Q4 MLX quantization

Browse files
Files changed (6) hide show
  1. README.md +5 -4
  2. config.json +28 -1148
  3. model-00001-of-00003.safetensors → model-00001-of-00002.safetensors +2 -2
  4. model-00002-of-00003.safetensors → model-00002-of-00002.safetensors +2 -2
  5. model-00003-of-00003.safetensors +0 -3
  6. model.safetensors.index.json +0 -0
README.md CHANGED
@@ -3,7 +3,7 @@ library_name: mlx
3
  license: apache-2.0
4
  license_link: https://ai.google.dev/gemma/docs/gemma_4_license
5
  pipeline_tag: image-text-to-text
6
- base_model: google/gemma-4-12B-it-qat-q4_0-gguf
7
  tags:
8
  - mlx
9
  - gemma4
@@ -16,7 +16,7 @@ tags:
16
 
17
  This repository provides an MLX-ready **QAT Q4** build of Google's Gemma 4 12B Unified instruction-tuned model for local inference on Apple Silicon Macs.
18
 
19
- Unlike a plain post-training 4-bit quantized checkpoint, this model is based on Google's **Quantization-Aware Training (QAT)** Q4 release. The goal is not only to reduce the storage and memory footprint, but also to preserve the model's practical judgment, instruction-following behavior, and reasoning stability under low-bit inference.
20
 
21
  **💡 Notice for Everyone**
22
  While this repository is hosted primarily as a dedicated engine source for our application ecosystem (**R.E.V.I.S.**), **you are completely free to download and use this model normally** for your own local MLX projects or workflows.
@@ -24,6 +24,7 @@ While this repository is hosted primarily as a dedicated engine source for our a
24
  For more details on the official source model, please refer to Google's Gemma 4 model pages:
25
 
26
  - [google/gemma-4-12B-it](https://huggingface.co/google/gemma-4-12B-it)
 
27
  - [google/gemma-4-12B-it-qat-q4_0-gguf](https://huggingface.co/google/gemma-4-12B-it-qat-q4_0-gguf)
28
 
29
  ## Why QAT Q4?
@@ -81,8 +82,8 @@ Gemma 4 12B Unified is designed as an encoder-free multimodal model. It is a pra
81
 
82
  ## License
83
 
84
- This model is a derivative of Google's Gemma 4 12B instruction-tuned QAT Q4 release, which is distributed by Google under the **Apache License 2.0**.
85
 
86
  This derivative is likewise distributed under the Apache License 2.0. A copy of the license is included in the `LICENSE` file in this repository, and can also be found at <https://www.apache.org/licenses/LICENSE-2.0>.
87
 
88
- **Modification notice:** This repository adapts the official Gemma 4 12B instruction-tuned QAT Q4 model for MLX-based local inference. No additional fine-tuning or architectural changes were applied by MAVIS.
 
3
  license: apache-2.0
4
  license_link: https://ai.google.dev/gemma/docs/gemma_4_license
5
  pipeline_tag: image-text-to-text
6
+ base_model: google/gemma-4-12B-it-qat-q4_0-unquantized
7
  tags:
8
  - mlx
9
  - gemma4
 
16
 
17
  This repository provides an MLX-ready **QAT Q4** build of Google's Gemma 4 12B Unified instruction-tuned model for local inference on Apple Silicon Macs.
18
 
19
+ Unlike a plain post-training 4-bit quantized checkpoint, this model is converted directly from Google's official **Quantization-Aware Training (QAT)** unquantized checkpoint. The quantization policy follows the official QAT Q4 GGUF layout in spirit: the language projections are stored as MLX affine Q4, token embeddings are stored as MLX affine Q6, and the multimodal projection components are kept in BF16. The goal is not only to reduce the storage and memory footprint, but also to preserve the model's practical judgment, instruction-following behavior, and reasoning stability under low-bit inference.
20
 
21
  **💡 Notice for Everyone**
22
  While this repository is hosted primarily as a dedicated engine source for our application ecosystem (**R.E.V.I.S.**), **you are completely free to download and use this model normally** for your own local MLX projects or workflows.
 
24
  For more details on the official source model, please refer to Google's Gemma 4 model pages:
25
 
26
  - [google/gemma-4-12B-it](https://huggingface.co/google/gemma-4-12B-it)
27
+ - [google/gemma-4-12B-it-qat-q4_0-unquantized](https://huggingface.co/google/gemma-4-12B-it-qat-q4_0-unquantized)
28
  - [google/gemma-4-12B-it-qat-q4_0-gguf](https://huggingface.co/google/gemma-4-12B-it-qat-q4_0-gguf)
29
 
30
  ## Why QAT Q4?
 
82
 
83
  ## License
84
 
85
+ This model is a derivative of Google's Gemma 4 12B instruction-tuned QAT release, which is distributed by Google under the **Apache License 2.0**.
86
 
87
  This derivative is likewise distributed under the Apache License 2.0. A copy of the license is included in the `LICENSE` file in this repository, and can also be found at <https://www.apache.org/licenses/LICENSE-2.0>.
88
 
89
+ **Modification notice:** This repository adapts the official Gemma 4 12B instruction-tuned QAT checkpoint for MLX-based local inference. No additional fine-tuning or architectural changes were applied by MAVIS.
config.json CHANGED
@@ -28,6 +28,7 @@
28
  "audio_token_id": 258881,
29
  "boa_token_id": 256000,
30
  "boi_token_id": 255999,
 
31
  "dtype": "bfloat16",
32
  "eoa_token_index": 258883,
33
  "eoi_token_id": 258882,
@@ -36,6 +37,24 @@
36
  106,
37
  50
38
  ],
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
39
  "image_token_id": 258880,
40
  "initializer_range": 0.02,
41
  "model_type": "gemma4_unified",
@@ -43,1164 +62,23 @@
43
  "group_size": 64,
44
  "bits": 4,
45
  "mode": "affine",
46
- "language_model.model.layers.0.mlp.gate_proj": {
47
- "group_size": 64,
48
- "bits": 8
49
- },
50
- "language_model.model.layers.0.mlp.down_proj": {
51
- "group_size": 64,
52
- "bits": 8
53
- },
54
- "language_model.model.layers.0.mlp.up_proj": {
55
- "group_size": 64,
56
- "bits": 8
57
- },
58
- "language_model.model.layers.1.mlp.gate_proj": {
59
- "group_size": 64,
60
- "bits": 8
61
- },
62
- "language_model.model.layers.1.mlp.down_proj": {
63
- "group_size": 64,
64
- "bits": 8
65
- },
66
- "language_model.model.layers.1.mlp.up_proj": {
67
- "group_size": 64,
68
- "bits": 8
69
- },
70
- "language_model.model.layers.2.mlp.gate_proj": {
71
- "group_size": 64,
72
- "bits": 8
73
- },
74
- "language_model.model.layers.2.mlp.down_proj": {
75
- "group_size": 64,
76
- "bits": 8
77
- },
78
- "language_model.model.layers.2.mlp.up_proj": {
79
- "group_size": 64,
80
- "bits": 8
81
- },
82
- "language_model.model.layers.3.mlp.gate_proj": {
83
- "group_size": 64,
84
- "bits": 8
85
- },
86
- "language_model.model.layers.3.mlp.down_proj": {
87
- "group_size": 64,
88
- "bits": 8
89
- },
90
- "language_model.model.layers.3.mlp.up_proj": {
91
- "group_size": 64,
92
- "bits": 8
93
- },
94
- "language_model.model.layers.4.mlp.gate_proj": {
95
- "group_size": 64,
96
- "bits": 8
97
- },
98
- "language_model.model.layers.4.mlp.down_proj": {
99
- "group_size": 64,
100
- "bits": 8
101
- },
102
- "language_model.model.layers.4.mlp.up_proj": {
103
- "group_size": 64,
104
- "bits": 8
105
- },
106
- "language_model.model.layers.5.mlp.gate_proj": {
107
- "group_size": 64,
108
- "bits": 8
109
- },
110
- "language_model.model.layers.5.mlp.down_proj": {
111
- "group_size": 64,
112
- "bits": 8
113
- },
114
- "language_model.model.layers.5.mlp.up_proj": {
115
- "group_size": 64,
116
- "bits": 8
117
- },
118
- "language_model.model.layers.6.mlp.gate_proj": {
119
- "group_size": 64,
120
- "bits": 8
121
- },
122
- "language_model.model.layers.6.mlp.down_proj": {
123
- "group_size": 64,
124
- "bits": 8
125
- },
126
- "language_model.model.layers.6.mlp.up_proj": {
127
- "group_size": 64,
128
- "bits": 8
129
- },
130
- "language_model.model.layers.7.mlp.gate_proj": {
131
- "group_size": 64,
132
- "bits": 8
133
- },
134
- "language_model.model.layers.7.mlp.down_proj": {
135
- "group_size": 64,
136
- "bits": 8
137
- },
138
- "language_model.model.layers.7.mlp.up_proj": {
139
- "group_size": 64,
140
- "bits": 8
141
- },
142
- "language_model.model.layers.8.mlp.gate_proj": {
143
- "group_size": 64,
144
- "bits": 8
145
- },
146
- "language_model.model.layers.8.mlp.down_proj": {
147
- "group_size": 64,
148
- "bits": 8
149
- },
150
- "language_model.model.layers.8.mlp.up_proj": {
151
- "group_size": 64,
152
- "bits": 8
153
- },
154
- "language_model.model.layers.9.mlp.gate_proj": {
155
- "group_size": 64,
156
- "bits": 8
157
- },
158
- "language_model.model.layers.9.mlp.down_proj": {
159
- "group_size": 64,
160
- "bits": 8
161
- },
162
- "language_model.model.layers.9.mlp.up_proj": {
163
- "group_size": 64,
164
- "bits": 8
165
- },
166
- "language_model.model.layers.10.mlp.gate_proj": {
167
- "group_size": 64,
168
- "bits": 8
169
- },
170
- "language_model.model.layers.10.mlp.down_proj": {
171
- "group_size": 64,
172
- "bits": 8
173
- },
174
- "language_model.model.layers.10.mlp.up_proj": {
175
- "group_size": 64,
176
- "bits": 8
177
- },
178
- "language_model.model.layers.11.mlp.gate_proj": {
179
- "group_size": 64,
180
- "bits": 8
181
- },
182
- "language_model.model.layers.11.mlp.down_proj": {
183
- "group_size": 64,
184
- "bits": 8
185
- },
186
- "language_model.model.layers.11.mlp.up_proj": {
187
- "group_size": 64,
188
- "bits": 8
189
- },
190
- "language_model.model.layers.12.mlp.gate_proj": {
191
- "group_size": 64,
192
- "bits": 8
193
- },
194
- "language_model.model.layers.12.mlp.down_proj": {
195
- "group_size": 64,
196
- "bits": 8
197
- },
198
- "language_model.model.layers.12.mlp.up_proj": {
199
- "group_size": 64,
200
- "bits": 8
201
- },
202
- "language_model.model.layers.13.mlp.gate_proj": {
203
- "group_size": 64,
204
- "bits": 8
205
- },
206
- "language_model.model.layers.13.mlp.down_proj": {
207
- "group_size": 64,
208
- "bits": 8
209
- },
210
- "language_model.model.layers.13.mlp.up_proj": {
211
- "group_size": 64,
212
- "bits": 8
213
- },
214
- "language_model.model.layers.14.mlp.gate_proj": {
215
- "group_size": 64,
216
- "bits": 8
217
- },
218
- "language_model.model.layers.14.mlp.down_proj": {
219
- "group_size": 64,
220
- "bits": 8
221
- },
222
- "language_model.model.layers.14.mlp.up_proj": {
223
- "group_size": 64,
224
- "bits": 8
225
- },
226
- "language_model.model.layers.15.mlp.gate_proj": {
227
- "group_size": 64,
228
- "bits": 8
229
- },
230
- "language_model.model.layers.15.mlp.down_proj": {
231
- "group_size": 64,
232
- "bits": 8
233
- },
234
- "language_model.model.layers.15.mlp.up_proj": {
235
- "group_size": 64,
236
- "bits": 8
237
- },
238
- "language_model.model.layers.16.mlp.gate_proj": {
239
- "group_size": 64,
240
- "bits": 8
241
- },
242
- "language_model.model.layers.16.mlp.down_proj": {
243
- "group_size": 64,
244
- "bits": 8
245
- },
246
- "language_model.model.layers.16.mlp.up_proj": {
247
- "group_size": 64,
248
- "bits": 8
249
- },
250
- "language_model.model.layers.17.mlp.gate_proj": {
251
- "group_size": 64,
252
- "bits": 8
253
- },
254
- "language_model.model.layers.17.mlp.down_proj": {
255
- "group_size": 64,
256
- "bits": 8
257
- },
258
- "language_model.model.layers.17.mlp.up_proj": {
259
- "group_size": 64,
260
- "bits": 8
261
- },
262
- "language_model.model.layers.18.mlp.gate_proj": {
263
- "group_size": 64,
264
- "bits": 8
265
- },
266
- "language_model.model.layers.18.mlp.down_proj": {
267
- "group_size": 64,
268
- "bits": 8
269
- },
270
- "language_model.model.layers.18.mlp.up_proj": {
271
- "group_size": 64,
272
- "bits": 8
273
- },
274
- "language_model.model.layers.19.mlp.gate_proj": {
275
- "group_size": 64,
276
- "bits": 8
277
- },
278
- "language_model.model.layers.19.mlp.down_proj": {
279
- "group_size": 64,
280
- "bits": 8
281
- },
282
- "language_model.model.layers.19.mlp.up_proj": {
283
- "group_size": 64,
284
- "bits": 8
285
- },
286
- "language_model.model.layers.20.mlp.gate_proj": {
287
- "group_size": 64,
288
- "bits": 8
289
- },
290
- "language_model.model.layers.20.mlp.down_proj": {
291
- "group_size": 64,
292
- "bits": 8
293
- },
294
- "language_model.model.layers.20.mlp.up_proj": {
295
- "group_size": 64,
296
- "bits": 8
297
- },
298
- "language_model.model.layers.21.mlp.gate_proj": {
299
- "group_size": 64,
300
- "bits": 8
301
- },
302
- "language_model.model.layers.21.mlp.down_proj": {
303
- "group_size": 64,
304
- "bits": 8
305
- },
306
- "language_model.model.layers.21.mlp.up_proj": {
307
- "group_size": 64,
308
- "bits": 8
309
- },
310
- "language_model.model.layers.22.mlp.gate_proj": {
311
- "group_size": 64,
312
- "bits": 8
313
- },
314
- "language_model.model.layers.22.mlp.down_proj": {
315
- "group_size": 64,
316
- "bits": 8
317
- },
318
- "language_model.model.layers.22.mlp.up_proj": {
319
- "group_size": 64,
320
- "bits": 8
321
- },
322
- "language_model.model.layers.23.mlp.gate_proj": {
323
- "group_size": 64,
324
- "bits": 8
325
- },
326
- "language_model.model.layers.23.mlp.down_proj": {
327
- "group_size": 64,
328
- "bits": 8
329
- },
330
- "language_model.model.layers.23.mlp.up_proj": {
331
- "group_size": 64,
332
- "bits": 8
333
- },
334
- "language_model.model.layers.24.mlp.gate_proj": {
335
- "group_size": 64,
336
- "bits": 8
337
- },
338
- "language_model.model.layers.24.mlp.down_proj": {
339
- "group_size": 64,
340
- "bits": 8
341
- },
342
- "language_model.model.layers.24.mlp.up_proj": {
343
- "group_size": 64,
344
- "bits": 8
345
- },
346
- "language_model.model.layers.25.mlp.gate_proj": {
347
- "group_size": 64,
348
- "bits": 8
349
- },
350
- "language_model.model.layers.25.mlp.down_proj": {
351
- "group_size": 64,
352
- "bits": 8
353
- },
354
- "language_model.model.layers.25.mlp.up_proj": {
355
- "group_size": 64,
356
- "bits": 8
357
- },
358
- "language_model.model.layers.26.mlp.gate_proj": {
359
- "group_size": 64,
360
- "bits": 8
361
- },
362
- "language_model.model.layers.26.mlp.down_proj": {
363
- "group_size": 64,
364
- "bits": 8
365
- },
366
- "language_model.model.layers.26.mlp.up_proj": {
367
- "group_size": 64,
368
- "bits": 8
369
- },
370
- "language_model.model.layers.27.mlp.gate_proj": {
371
- "group_size": 64,
372
- "bits": 8
373
- },
374
- "language_model.model.layers.27.mlp.down_proj": {
375
- "group_size": 64,
376
- "bits": 8
377
- },
378
- "language_model.model.layers.27.mlp.up_proj": {
379
- "group_size": 64,
380
- "bits": 8
381
- },
382
- "language_model.model.layers.28.mlp.gate_proj": {
383
- "group_size": 64,
384
- "bits": 8
385
- },
386
- "language_model.model.layers.28.mlp.down_proj": {
387
- "group_size": 64,
388
- "bits": 8
389
- },
390
- "language_model.model.layers.28.mlp.up_proj": {
391
- "group_size": 64,
392
- "bits": 8
393
- },
394
- "language_model.model.layers.29.mlp.gate_proj": {
395
- "group_size": 64,
396
- "bits": 8
397
- },
398
- "language_model.model.layers.29.mlp.down_proj": {
399
- "group_size": 64,
400
- "bits": 8
401
- },
402
- "language_model.model.layers.29.mlp.up_proj": {
403
- "group_size": 64,
404
- "bits": 8
405
- },
406
- "language_model.model.layers.30.mlp.gate_proj": {
407
- "group_size": 64,
408
- "bits": 8
409
- },
410
- "language_model.model.layers.30.mlp.down_proj": {
411
- "group_size": 64,
412
- "bits": 8
413
- },
414
- "language_model.model.layers.30.mlp.up_proj": {
415
- "group_size": 64,
416
- "bits": 8
417
- },
418
- "language_model.model.layers.31.mlp.gate_proj": {
419
- "group_size": 64,
420
- "bits": 8
421
- },
422
- "language_model.model.layers.31.mlp.down_proj": {
423
- "group_size": 64,
424
- "bits": 8
425
- },
426
- "language_model.model.layers.31.mlp.up_proj": {
427
- "group_size": 64,
428
- "bits": 8
429
- },
430
- "language_model.model.layers.32.mlp.gate_proj": {
431
- "group_size": 64,
432
- "bits": 8
433
- },
434
- "language_model.model.layers.32.mlp.down_proj": {
435
- "group_size": 64,
436
- "bits": 8
437
- },
438
- "language_model.model.layers.32.mlp.up_proj": {
439
- "group_size": 64,
440
- "bits": 8
441
- },
442
- "language_model.model.layers.33.mlp.gate_proj": {
443
- "group_size": 64,
444
- "bits": 8
445
- },
446
- "language_model.model.layers.33.mlp.down_proj": {
447
- "group_size": 64,
448
- "bits": 8
449
- },
450
- "language_model.model.layers.33.mlp.up_proj": {
451
- "group_size": 64,
452
- "bits": 8
453
- },
454
- "language_model.model.layers.34.mlp.gate_proj": {
455
- "group_size": 64,
456
- "bits": 8
457
- },
458
- "language_model.model.layers.34.mlp.down_proj": {
459
- "group_size": 64,
460
- "bits": 8
461
- },
462
- "language_model.model.layers.34.mlp.up_proj": {
463
- "group_size": 64,
464
- "bits": 8
465
- },
466
- "language_model.model.layers.35.mlp.gate_proj": {
467
- "group_size": 64,
468
- "bits": 8
469
- },
470
- "language_model.model.layers.35.mlp.down_proj": {
471
- "group_size": 64,
472
- "bits": 8
473
- },
474
- "language_model.model.layers.35.mlp.up_proj": {
475
- "group_size": 64,
476
- "bits": 8
477
- },
478
- "language_model.model.layers.36.mlp.gate_proj": {
479
- "group_size": 64,
480
- "bits": 8
481
- },
482
- "language_model.model.layers.36.mlp.down_proj": {
483
- "group_size": 64,
484
- "bits": 8
485
- },
486
- "language_model.model.layers.36.mlp.up_proj": {
487
- "group_size": 64,
488
- "bits": 8
489
- },
490
- "language_model.model.layers.37.mlp.gate_proj": {
491
- "group_size": 64,
492
- "bits": 8
493
- },
494
- "language_model.model.layers.37.mlp.down_proj": {
495
- "group_size": 64,
496
- "bits": 8
497
- },
498
- "language_model.model.layers.37.mlp.up_proj": {
499
- "group_size": 64,
500
- "bits": 8
501
- },
502
- "language_model.model.layers.38.mlp.gate_proj": {
503
- "group_size": 64,
504
- "bits": 8
505
- },
506
- "language_model.model.layers.38.mlp.down_proj": {
507
- "group_size": 64,
508
- "bits": 8
509
- },
510
- "language_model.model.layers.38.mlp.up_proj": {
511
- "group_size": 64,
512
- "bits": 8
513
- },
514
- "language_model.model.layers.39.mlp.gate_proj": {
515
- "group_size": 64,
516
- "bits": 8
517
- },
518
- "language_model.model.layers.39.mlp.down_proj": {
519
- "group_size": 64,
520
- "bits": 8
521
- },
522
- "language_model.model.layers.39.mlp.up_proj": {
523
- "group_size": 64,
524
- "bits": 8
525
- },
526
- "language_model.model.layers.40.mlp.gate_proj": {
527
- "group_size": 64,
528
- "bits": 8
529
- },
530
- "language_model.model.layers.40.mlp.down_proj": {
531
- "group_size": 64,
532
- "bits": 8
533
- },
534
- "language_model.model.layers.40.mlp.up_proj": {
535
- "group_size": 64,
536
- "bits": 8
537
- },
538
- "language_model.model.layers.41.mlp.gate_proj": {
539
- "group_size": 64,
540
- "bits": 8
541
- },
542
- "language_model.model.layers.41.mlp.down_proj": {
543
- "group_size": 64,
544
- "bits": 8
545
- },
546
- "language_model.model.layers.41.mlp.up_proj": {
547
  "group_size": 64,
548
- "bits": 8
549
- },
550
- "language_model.model.layers.42.mlp.gate_proj": {
551
- "group_size": 64,
552
- "bits": 8
553
- },
554
- "language_model.model.layers.42.mlp.down_proj": {
555
- "group_size": 64,
556
- "bits": 8
557
- },
558
- "language_model.model.layers.42.mlp.up_proj": {
559
- "group_size": 64,
560
- "bits": 8
561
- },
562
- "language_model.model.layers.43.mlp.gate_proj": {
563
- "group_size": 64,
564
- "bits": 8
565
- },
566
- "language_model.model.layers.43.mlp.down_proj": {
567
- "group_size": 64,
568
- "bits": 8
569
- },
570
- "language_model.model.layers.43.mlp.up_proj": {
571
- "group_size": 64,
572
- "bits": 8
573
- },
574
- "language_model.model.layers.44.mlp.gate_proj": {
575
- "group_size": 64,
576
- "bits": 8
577
- },
578
- "language_model.model.layers.44.mlp.down_proj": {
579
- "group_size": 64,
580
- "bits": 8
581
- },
582
- "language_model.model.layers.44.mlp.up_proj": {
583
- "group_size": 64,
584
- "bits": 8
585
- },
586
- "language_model.model.layers.45.mlp.gate_proj": {
587
- "group_size": 64,
588
- "bits": 8
589
- },
590
- "language_model.model.layers.45.mlp.down_proj": {
591
- "group_size": 64,
592
- "bits": 8
593
- },
594
- "language_model.model.layers.45.mlp.up_proj": {
595
- "group_size": 64,
596
- "bits": 8
597
- },
598
- "language_model.model.layers.46.mlp.gate_proj": {
599
- "group_size": 64,
600
- "bits": 8
601
- },
602
- "language_model.model.layers.46.mlp.down_proj": {
603
- "group_size": 64,
604
- "bits": 8
605
- },
606
- "language_model.model.layers.46.mlp.up_proj": {
607
- "group_size": 64,
608
- "bits": 8
609
- },
610
- "language_model.model.layers.47.mlp.gate_proj": {
611
- "group_size": 64,
612
- "bits": 8
613
- },
614
- "language_model.model.layers.47.mlp.down_proj": {
615
- "group_size": 64,
616
- "bits": 8
617
- },
618
- "language_model.model.layers.47.mlp.up_proj": {
619
- "group_size": 64,
620
- "bits": 8
621
  }
622
  },
623
  "quantization_config": {
624
  "group_size": 64,
625
  "bits": 4,
626
  "mode": "affine",
627
- "language_model.model.layers.0.mlp.gate_proj": {
628
- "group_size": 64,
629
- "bits": 8
630
- },
631
- "language_model.model.layers.0.mlp.down_proj": {
632
- "group_size": 64,
633
- "bits": 8
634
- },
635
- "language_model.model.layers.0.mlp.up_proj": {
636
- "group_size": 64,
637
- "bits": 8
638
- },
639
- "language_model.model.layers.1.mlp.gate_proj": {
640
- "group_size": 64,
641
- "bits": 8
642
- },
643
- "language_model.model.layers.1.mlp.down_proj": {
644
- "group_size": 64,
645
- "bits": 8
646
- },
647
- "language_model.model.layers.1.mlp.up_proj": {
648
- "group_size": 64,
649
- "bits": 8
650
- },
651
- "language_model.model.layers.2.mlp.gate_proj": {
652
- "group_size": 64,
653
- "bits": 8
654
- },
655
- "language_model.model.layers.2.mlp.down_proj": {
656
- "group_size": 64,
657
- "bits": 8
658
- },
659
- "language_model.model.layers.2.mlp.up_proj": {
660
- "group_size": 64,
661
- "bits": 8
662
- },
663
- "language_model.model.layers.3.mlp.gate_proj": {
664
- "group_size": 64,
665
- "bits": 8
666
- },
667
- "language_model.model.layers.3.mlp.down_proj": {
668
- "group_size": 64,
669
- "bits": 8
670
- },
671
- "language_model.model.layers.3.mlp.up_proj": {
672
- "group_size": 64,
673
- "bits": 8
674
- },
675
- "language_model.model.layers.4.mlp.gate_proj": {
676
- "group_size": 64,
677
- "bits": 8
678
- },
679
- "language_model.model.layers.4.mlp.down_proj": {
680
- "group_size": 64,
681
- "bits": 8
682
- },
683
- "language_model.model.layers.4.mlp.up_proj": {
684
- "group_size": 64,
685
- "bits": 8
686
- },
687
- "language_model.model.layers.5.mlp.gate_proj": {
688
- "group_size": 64,
689
- "bits": 8
690
- },
691
- "language_model.model.layers.5.mlp.down_proj": {
692
- "group_size": 64,
693
- "bits": 8
694
- },
695
- "language_model.model.layers.5.mlp.up_proj": {
696
- "group_size": 64,
697
- "bits": 8
698
- },
699
- "language_model.model.layers.6.mlp.gate_proj": {
700
- "group_size": 64,
701
- "bits": 8
702
- },
703
- "language_model.model.layers.6.mlp.down_proj": {
704
- "group_size": 64,
705
- "bits": 8
706
- },
707
- "language_model.model.layers.6.mlp.up_proj": {
708
- "group_size": 64,
709
- "bits": 8
710
- },
711
- "language_model.model.layers.7.mlp.gate_proj": {
712
- "group_size": 64,
713
- "bits": 8
714
- },
715
- "language_model.model.layers.7.mlp.down_proj": {
716
- "group_size": 64,
717
- "bits": 8
718
- },
719
- "language_model.model.layers.7.mlp.up_proj": {
720
- "group_size": 64,
721
- "bits": 8
722
- },
723
- "language_model.model.layers.8.mlp.gate_proj": {
724
- "group_size": 64,
725
- "bits": 8
726
- },
727
- "language_model.model.layers.8.mlp.down_proj": {
728
- "group_size": 64,
729
- "bits": 8
730
- },
731
- "language_model.model.layers.8.mlp.up_proj": {
732
- "group_size": 64,
733
- "bits": 8
734
- },
735
- "language_model.model.layers.9.mlp.gate_proj": {
736
- "group_size": 64,
737
- "bits": 8
738
- },
739
- "language_model.model.layers.9.mlp.down_proj": {
740
- "group_size": 64,
741
- "bits": 8
742
- },
743
- "language_model.model.layers.9.mlp.up_proj": {
744
- "group_size": 64,
745
- "bits": 8
746
- },
747
- "language_model.model.layers.10.mlp.gate_proj": {
748
- "group_size": 64,
749
- "bits": 8
750
- },
751
- "language_model.model.layers.10.mlp.down_proj": {
752
- "group_size": 64,
753
- "bits": 8
754
- },
755
- "language_model.model.layers.10.mlp.up_proj": {
756
- "group_size": 64,
757
- "bits": 8
758
- },
759
- "language_model.model.layers.11.mlp.gate_proj": {
760
- "group_size": 64,
761
- "bits": 8
762
- },
763
- "language_model.model.layers.11.mlp.down_proj": {
764
- "group_size": 64,
765
- "bits": 8
766
- },
767
- "language_model.model.layers.11.mlp.up_proj": {
768
- "group_size": 64,
769
- "bits": 8
770
- },
771
- "language_model.model.layers.12.mlp.gate_proj": {
772
- "group_size": 64,
773
- "bits": 8
774
- },
775
- "language_model.model.layers.12.mlp.down_proj": {
776
- "group_size": 64,
777
- "bits": 8
778
- },
779
- "language_model.model.layers.12.mlp.up_proj": {
780
- "group_size": 64,
781
- "bits": 8
782
- },
783
- "language_model.model.layers.13.mlp.gate_proj": {
784
- "group_size": 64,
785
- "bits": 8
786
- },
787
- "language_model.model.layers.13.mlp.down_proj": {
788
- "group_size": 64,
789
- "bits": 8
790
- },
791
- "language_model.model.layers.13.mlp.up_proj": {
792
- "group_size": 64,
793
- "bits": 8
794
- },
795
- "language_model.model.layers.14.mlp.gate_proj": {
796
- "group_size": 64,
797
- "bits": 8
798
- },
799
- "language_model.model.layers.14.mlp.down_proj": {
800
- "group_size": 64,
801
- "bits": 8
802
- },
803
- "language_model.model.layers.14.mlp.up_proj": {
804
- "group_size": 64,
805
- "bits": 8
806
- },
807
- "language_model.model.layers.15.mlp.gate_proj": {
808
- "group_size": 64,
809
- "bits": 8
810
- },
811
- "language_model.model.layers.15.mlp.down_proj": {
812
- "group_size": 64,
813
- "bits": 8
814
- },
815
- "language_model.model.layers.15.mlp.up_proj": {
816
- "group_size": 64,
817
- "bits": 8
818
- },
819
- "language_model.model.layers.16.mlp.gate_proj": {
820
- "group_size": 64,
821
- "bits": 8
822
- },
823
- "language_model.model.layers.16.mlp.down_proj": {
824
- "group_size": 64,
825
- "bits": 8
826
- },
827
- "language_model.model.layers.16.mlp.up_proj": {
828
- "group_size": 64,
829
- "bits": 8
830
- },
831
- "language_model.model.layers.17.mlp.gate_proj": {
832
- "group_size": 64,
833
- "bits": 8
834
- },
835
- "language_model.model.layers.17.mlp.down_proj": {
836
- "group_size": 64,
837
- "bits": 8
838
- },
839
- "language_model.model.layers.17.mlp.up_proj": {
840
- "group_size": 64,
841
- "bits": 8
842
- },
843
- "language_model.model.layers.18.mlp.gate_proj": {
844
- "group_size": 64,
845
- "bits": 8
846
- },
847
- "language_model.model.layers.18.mlp.down_proj": {
848
- "group_size": 64,
849
- "bits": 8
850
- },
851
- "language_model.model.layers.18.mlp.up_proj": {
852
- "group_size": 64,
853
- "bits": 8
854
- },
855
- "language_model.model.layers.19.mlp.gate_proj": {
856
- "group_size": 64,
857
- "bits": 8
858
- },
859
- "language_model.model.layers.19.mlp.down_proj": {
860
- "group_size": 64,
861
- "bits": 8
862
- },
863
- "language_model.model.layers.19.mlp.up_proj": {
864
- "group_size": 64,
865
- "bits": 8
866
- },
867
- "language_model.model.layers.20.mlp.gate_proj": {
868
- "group_size": 64,
869
- "bits": 8
870
- },
871
- "language_model.model.layers.20.mlp.down_proj": {
872
- "group_size": 64,
873
- "bits": 8
874
- },
875
- "language_model.model.layers.20.mlp.up_proj": {
876
- "group_size": 64,
877
- "bits": 8
878
- },
879
- "language_model.model.layers.21.mlp.gate_proj": {
880
- "group_size": 64,
881
- "bits": 8
882
- },
883
- "language_model.model.layers.21.mlp.down_proj": {
884
- "group_size": 64,
885
- "bits": 8
886
- },
887
- "language_model.model.layers.21.mlp.up_proj": {
888
- "group_size": 64,
889
- "bits": 8
890
- },
891
- "language_model.model.layers.22.mlp.gate_proj": {
892
- "group_size": 64,
893
- "bits": 8
894
- },
895
- "language_model.model.layers.22.mlp.down_proj": {
896
- "group_size": 64,
897
- "bits": 8
898
- },
899
- "language_model.model.layers.22.mlp.up_proj": {
900
- "group_size": 64,
901
- "bits": 8
902
- },
903
- "language_model.model.layers.23.mlp.gate_proj": {
904
- "group_size": 64,
905
- "bits": 8
906
- },
907
- "language_model.model.layers.23.mlp.down_proj": {
908
- "group_size": 64,
909
- "bits": 8
910
- },
911
- "language_model.model.layers.23.mlp.up_proj": {
912
- "group_size": 64,
913
- "bits": 8
914
- },
915
- "language_model.model.layers.24.mlp.gate_proj": {
916
- "group_size": 64,
917
- "bits": 8
918
- },
919
- "language_model.model.layers.24.mlp.down_proj": {
920
- "group_size": 64,
921
- "bits": 8
922
- },
923
- "language_model.model.layers.24.mlp.up_proj": {
924
- "group_size": 64,
925
- "bits": 8
926
- },
927
- "language_model.model.layers.25.mlp.gate_proj": {
928
- "group_size": 64,
929
- "bits": 8
930
- },
931
- "language_model.model.layers.25.mlp.down_proj": {
932
- "group_size": 64,
933
- "bits": 8
934
- },
935
- "language_model.model.layers.25.mlp.up_proj": {
936
- "group_size": 64,
937
- "bits": 8
938
- },
939
- "language_model.model.layers.26.mlp.gate_proj": {
940
- "group_size": 64,
941
- "bits": 8
942
- },
943
- "language_model.model.layers.26.mlp.down_proj": {
944
- "group_size": 64,
945
- "bits": 8
946
- },
947
- "language_model.model.layers.26.mlp.up_proj": {
948
- "group_size": 64,
949
- "bits": 8
950
- },
951
- "language_model.model.layers.27.mlp.gate_proj": {
952
- "group_size": 64,
953
- "bits": 8
954
- },
955
- "language_model.model.layers.27.mlp.down_proj": {
956
- "group_size": 64,
957
- "bits": 8
958
- },
959
- "language_model.model.layers.27.mlp.up_proj": {
960
- "group_size": 64,
961
- "bits": 8
962
- },
963
- "language_model.model.layers.28.mlp.gate_proj": {
964
- "group_size": 64,
965
- "bits": 8
966
- },
967
- "language_model.model.layers.28.mlp.down_proj": {
968
- "group_size": 64,
969
- "bits": 8
970
- },
971
- "language_model.model.layers.28.mlp.up_proj": {
972
- "group_size": 64,
973
- "bits": 8
974
- },
975
- "language_model.model.layers.29.mlp.gate_proj": {
976
- "group_size": 64,
977
- "bits": 8
978
- },
979
- "language_model.model.layers.29.mlp.down_proj": {
980
- "group_size": 64,
981
- "bits": 8
982
- },
983
- "language_model.model.layers.29.mlp.up_proj": {
984
- "group_size": 64,
985
- "bits": 8
986
- },
987
- "language_model.model.layers.30.mlp.gate_proj": {
988
- "group_size": 64,
989
- "bits": 8
990
- },
991
- "language_model.model.layers.30.mlp.down_proj": {
992
- "group_size": 64,
993
- "bits": 8
994
- },
995
- "language_model.model.layers.30.mlp.up_proj": {
996
- "group_size": 64,
997
- "bits": 8
998
- },
999
- "language_model.model.layers.31.mlp.gate_proj": {
1000
- "group_size": 64,
1001
- "bits": 8
1002
- },
1003
- "language_model.model.layers.31.mlp.down_proj": {
1004
- "group_size": 64,
1005
- "bits": 8
1006
- },
1007
- "language_model.model.layers.31.mlp.up_proj": {
1008
- "group_size": 64,
1009
- "bits": 8
1010
- },
1011
- "language_model.model.layers.32.mlp.gate_proj": {
1012
- "group_size": 64,
1013
- "bits": 8
1014
- },
1015
- "language_model.model.layers.32.mlp.down_proj": {
1016
- "group_size": 64,
1017
- "bits": 8
1018
- },
1019
- "language_model.model.layers.32.mlp.up_proj": {
1020
- "group_size": 64,
1021
- "bits": 8
1022
- },
1023
- "language_model.model.layers.33.mlp.gate_proj": {
1024
- "group_size": 64,
1025
- "bits": 8
1026
- },
1027
- "language_model.model.layers.33.mlp.down_proj": {
1028
- "group_size": 64,
1029
- "bits": 8
1030
- },
1031
- "language_model.model.layers.33.mlp.up_proj": {
1032
- "group_size": 64,
1033
- "bits": 8
1034
- },
1035
- "language_model.model.layers.34.mlp.gate_proj": {
1036
- "group_size": 64,
1037
- "bits": 8
1038
- },
1039
- "language_model.model.layers.34.mlp.down_proj": {
1040
- "group_size": 64,
1041
- "bits": 8
1042
- },
1043
- "language_model.model.layers.34.mlp.up_proj": {
1044
- "group_size": 64,
1045
- "bits": 8
1046
- },
1047
- "language_model.model.layers.35.mlp.gate_proj": {
1048
- "group_size": 64,
1049
- "bits": 8
1050
- },
1051
- "language_model.model.layers.35.mlp.down_proj": {
1052
- "group_size": 64,
1053
- "bits": 8
1054
- },
1055
- "language_model.model.layers.35.mlp.up_proj": {
1056
- "group_size": 64,
1057
- "bits": 8
1058
- },
1059
- "language_model.model.layers.36.mlp.gate_proj": {
1060
- "group_size": 64,
1061
- "bits": 8
1062
- },
1063
- "language_model.model.layers.36.mlp.down_proj": {
1064
- "group_size": 64,
1065
- "bits": 8
1066
- },
1067
- "language_model.model.layers.36.mlp.up_proj": {
1068
- "group_size": 64,
1069
- "bits": 8
1070
- },
1071
- "language_model.model.layers.37.mlp.gate_proj": {
1072
- "group_size": 64,
1073
- "bits": 8
1074
- },
1075
- "language_model.model.layers.37.mlp.down_proj": {
1076
- "group_size": 64,
1077
- "bits": 8
1078
- },
1079
- "language_model.model.layers.37.mlp.up_proj": {
1080
- "group_size": 64,
1081
- "bits": 8
1082
- },
1083
- "language_model.model.layers.38.mlp.gate_proj": {
1084
- "group_size": 64,
1085
- "bits": 8
1086
- },
1087
- "language_model.model.layers.38.mlp.down_proj": {
1088
- "group_size": 64,
1089
- "bits": 8
1090
- },
1091
- "language_model.model.layers.38.mlp.up_proj": {
1092
- "group_size": 64,
1093
- "bits": 8
1094
- },
1095
- "language_model.model.layers.39.mlp.gate_proj": {
1096
- "group_size": 64,
1097
- "bits": 8
1098
- },
1099
- "language_model.model.layers.39.mlp.down_proj": {
1100
- "group_size": 64,
1101
- "bits": 8
1102
- },
1103
- "language_model.model.layers.39.mlp.up_proj": {
1104
- "group_size": 64,
1105
- "bits": 8
1106
- },
1107
- "language_model.model.layers.40.mlp.gate_proj": {
1108
- "group_size": 64,
1109
- "bits": 8
1110
- },
1111
- "language_model.model.layers.40.mlp.down_proj": {
1112
- "group_size": 64,
1113
- "bits": 8
1114
- },
1115
- "language_model.model.layers.40.mlp.up_proj": {
1116
- "group_size": 64,
1117
- "bits": 8
1118
- },
1119
- "language_model.model.layers.41.mlp.gate_proj": {
1120
- "group_size": 64,
1121
- "bits": 8
1122
- },
1123
- "language_model.model.layers.41.mlp.down_proj": {
1124
- "group_size": 64,
1125
- "bits": 8
1126
- },
1127
- "language_model.model.layers.41.mlp.up_proj": {
1128
- "group_size": 64,
1129
- "bits": 8
1130
- },
1131
- "language_model.model.layers.42.mlp.gate_proj": {
1132
- "group_size": 64,
1133
- "bits": 8
1134
- },
1135
- "language_model.model.layers.42.mlp.down_proj": {
1136
- "group_size": 64,
1137
- "bits": 8
1138
- },
1139
- "language_model.model.layers.42.mlp.up_proj": {
1140
- "group_size": 64,
1141
- "bits": 8
1142
- },
1143
- "language_model.model.layers.43.mlp.gate_proj": {
1144
- "group_size": 64,
1145
- "bits": 8
1146
- },
1147
- "language_model.model.layers.43.mlp.down_proj": {
1148
- "group_size": 64,
1149
- "bits": 8
1150
- },
1151
- "language_model.model.layers.43.mlp.up_proj": {
1152
- "group_size": 64,
1153
- "bits": 8
1154
- },
1155
- "language_model.model.layers.44.mlp.gate_proj": {
1156
- "group_size": 64,
1157
- "bits": 8
1158
- },
1159
- "language_model.model.layers.44.mlp.down_proj": {
1160
- "group_size": 64,
1161
- "bits": 8
1162
- },
1163
- "language_model.model.layers.44.mlp.up_proj": {
1164
- "group_size": 64,
1165
- "bits": 8
1166
- },
1167
- "language_model.model.layers.45.mlp.gate_proj": {
1168
- "group_size": 64,
1169
- "bits": 8
1170
- },
1171
- "language_model.model.layers.45.mlp.down_proj": {
1172
- "group_size": 64,
1173
- "bits": 8
1174
- },
1175
- "language_model.model.layers.45.mlp.up_proj": {
1176
- "group_size": 64,
1177
- "bits": 8
1178
- },
1179
- "language_model.model.layers.46.mlp.gate_proj": {
1180
- "group_size": 64,
1181
- "bits": 8
1182
- },
1183
- "language_model.model.layers.46.mlp.down_proj": {
1184
- "group_size": 64,
1185
- "bits": 8
1186
- },
1187
- "language_model.model.layers.46.mlp.up_proj": {
1188
- "group_size": 64,
1189
- "bits": 8
1190
- },
1191
- "language_model.model.layers.47.mlp.gate_proj": {
1192
- "group_size": 64,
1193
- "bits": 8
1194
- },
1195
- "language_model.model.layers.47.mlp.down_proj": {
1196
- "group_size": 64,
1197
- "bits": 8
1198
- },
1199
- "language_model.model.layers.47.mlp.up_proj": {
1200
  "group_size": 64,
1201
- "bits": 8
 
1202
  }
1203
  },
 
1204
  "text_config": {
1205
  "attention_bias": false,
1206
  "attention_dropout": 0.0,
@@ -1299,6 +177,8 @@
1299
  "vocab_size_per_layer_input": 0
1300
  },
1301
  "tie_word_embeddings": true,
 
 
1302
  "transformers_version": "5.10.0.dev0",
1303
  "video_token_id": 258884,
1304
  "vision_config": {
 
28
  "audio_token_id": 258881,
29
  "boa_token_id": 256000,
30
  "boi_token_id": 255999,
31
+ "do_sample": true,
32
  "dtype": "bfloat16",
33
  "eoa_token_index": 258883,
34
  "eoi_token_id": 258882,
 
37
  106,
38
  50
39
  ],
40
+ "generation_config": {
41
+ "bos_token_id": 2,
42
+ "do_sample": true,
43
+ "eos_token_id": [
44
+ 1,
45
+ 106,
46
+ 50
47
+ ],
48
+ "pad_token_id": 0,
49
+ "suppress_tokens": [
50
+ 258883,
51
+ 258882
52
+ ],
53
+ "temperature": 1.0,
54
+ "top_k": 64,
55
+ "top_p": 0.95,
56
+ "transformers_version": "5.10.0.dev0"
57
+ },
58
  "image_token_id": 258880,
59
  "initializer_range": 0.02,
60
  "model_type": "gemma4_unified",
 
62
  "group_size": 64,
63
  "bits": 4,
64
  "mode": "affine",
65
+ "language_model.model.embed_tokens": {
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
66
  "group_size": 64,
67
+ "bits": 6,
68
+ "mode": "affine"
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
69
  }
70
  },
71
  "quantization_config": {
72
  "group_size": 64,
73
  "bits": 4,
74
  "mode": "affine",
75
+ "language_model.model.embed_tokens": {
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
76
  "group_size": 64,
77
+ "bits": 6,
78
+ "mode": "affine"
79
  }
80
  },
81
+ "temperature": 1.0,
82
  "text_config": {
83
  "attention_bias": false,
84
  "attention_dropout": 0.0,
 
177
  "vocab_size_per_layer_input": 0
178
  },
179
  "tie_word_embeddings": true,
180
+ "top_k": 64,
181
+ "top_p": 0.95,
182
  "transformers_version": "5.10.0.dev0",
183
  "video_token_id": 258884,
184
  "vision_config": {
model-00001-of-00003.safetensors → model-00001-of-00002.safetensors RENAMED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:9fc7406175fdfbca0f941767bfa222ecdaea71ab1d2865cd049eb2a0a1d9f2a1
3
- size 5343482357
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9db04c6399db8073d153a6b00982bc0eae670fec87a45466a5c7387f71e7db1e
3
+ size 5351194360
model-00002-of-00003.safetensors → model-00002-of-00002.safetensors RENAMED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:62a2b9715c9bef3a4f0a2769fe2d5022ae55907b631731a24568f3e8f444d9e9
3
- size 5315166254
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bdc037c8a4820f5400568da268c2ebb3a4c727e7cb22dd2730c91ded6898baa2
3
+ size 1704386623
model-00003-of-00003.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:fd75a04eb5cc73be2760898715472e92626b0a8ba03b19ee57737419885da6c9
3
- size 329123819
 
 
 
 
model.safetensors.index.json CHANGED
The diff for this file is too large to render. See raw diff