Hugging Face's logo

OpenTransformer
/
unary-quantization-research

Safetensors
English
quantization
unary
thermometer-encoding
inference-engine
low-bit
Model card Files
xet
 Community
OpenTransformer commited on
Commit
2d161f6
·
verified ·
1 Parent(s): 50a9bcc

Add files using upload-large-folder tool

Browse files
This view is limited to 50 files because it contains too many changes.   See raw diff
Files changed (50) hide show
  1. deepseek-r1-1.5b-packed/model_layers_0_mlp_down_proj_weight.scales +0 -0
  2. deepseek-r1-1.5b-packed/model_layers_0_mlp_gate_proj_weight.scales +0 -0
  3. deepseek-r1-1.5b-packed/model_layers_0_self_attn_k_proj_bias.fp16 +0 -0
  4. deepseek-r1-1.5b-packed/model_layers_0_self_attn_k_proj_weight.rmm +1 -0
  5. deepseek-r1-1.5b-packed/model_layers_0_self_attn_k_proj_weight.signs +0 -0
  6. deepseek-r1-1.5b-packed/model_layers_0_self_attn_o_proj_weight.scales +0 -0
  7. deepseek-r1-1.5b-packed/model_layers_0_self_attn_q_proj_weight.rmm +1 -0
  8. deepseek-r1-1.5b-packed/model_layers_0_self_attn_v_proj_bias.fp16 +0 -0
  9. deepseek-r1-1.5b-packed/model_layers_0_self_attn_v_proj_weight.scales +0 -0
  10. deepseek-r1-1.5b-packed/model_layers_10_input_layernorm_weight.fp16 +0 -0
  11. deepseek-r1-1.5b-packed/model_layers_10_mlp_down_proj_weight.rmm +1 -0
  12. deepseek-r1-1.5b-packed/model_layers_10_mlp_down_proj_weight.scales +0 -0
  13. deepseek-r1-1.5b-packed/model_layers_10_mlp_gate_proj_weight.rmm +1 -0
  14. deepseek-r1-1.5b-packed/model_layers_10_post_attention_layernorm_weight.fp16 +0 -0
  15. deepseek-r1-1.5b-packed/model_layers_10_self_attn_k_proj_weight.scales +0 -0
  16. deepseek-r1-1.5b-packed/model_layers_10_self_attn_k_proj_weight.signs +0 -0
  17. deepseek-r1-1.5b-packed/model_layers_11_mlp_gate_proj_weight.rmm +1 -0
  18. deepseek-r1-1.5b-packed/model_layers_11_mlp_gate_proj_weight.scales +0 -0
  19. deepseek-r1-1.5b-packed/model_layers_11_mlp_up_proj_weight.scales +0 -0
  20. deepseek-r1-1.5b-packed/model_layers_11_self_attn_k_proj_bias.fp16 +0 -0
  21. deepseek-r1-1.5b-packed/model_layers_11_self_attn_k_proj_weight.rmm +1 -0
  22. deepseek-r1-1.5b-packed/model_layers_11_self_attn_k_proj_weight.scales +0 -0
  23. deepseek-r1-1.5b-packed/model_layers_11_self_attn_o_proj_weight.rmm +1 -0
  24. deepseek-r1-1.5b-packed/model_layers_11_self_attn_o_proj_weight.scales +0 -0
  25. deepseek-r1-1.5b-packed/model_layers_11_self_attn_q_proj_bias.fp16 +0 -0
  26. deepseek-r1-1.5b-packed/model_layers_11_self_attn_q_proj_weight.rmm +1 -0
  27. deepseek-r1-1.5b-packed/model_layers_11_self_attn_q_proj_weight.scales +0 -0
  28. deepseek-r1-1.5b-packed/model_layers_11_self_attn_v_proj_bias.fp16 +0 -0
  29. deepseek-r1-1.5b-packed/model_layers_11_self_attn_v_proj_weight.rmm +1 -0
  30. deepseek-r1-1.5b-packed/model_layers_11_self_attn_v_proj_weight.signs +0 -0
  31. deepseek-r1-1.5b-packed/model_layers_12_input_layernorm_weight.fp16 +0 -0
  32. deepseek-r1-1.5b-packed/model_layers_12_mlp_gate_proj_weight.scales +0 -0
  33. deepseek-r1-1.5b-packed/model_layers_12_self_attn_k_proj_bias.fp16 +0 -0
  34. deepseek-r1-1.5b-packed/model_layers_12_self_attn_q_proj_weight.scales +0 -0
  35. deepseek-r1-1.5b-packed/model_layers_12_self_attn_v_proj_weight.rmm +1 -0
  36. deepseek-r1-1.5b-packed/model_layers_12_self_attn_v_proj_weight.scales +0 -0
  37. deepseek-r1-1.5b-packed/model_layers_13_input_layernorm_weight.fp16 +0 -0
  38. deepseek-r1-1.5b-packed/model_layers_13_mlp_gate_proj_weight.mags +0 -0
  39. deepseek-r1-1.5b-packed/model_layers_13_mlp_gate_proj_weight.rmm +1 -0
  40. deepseek-r1-1.5b-packed/model_layers_13_mlp_gate_proj_weight.scales +0 -0
  41. deepseek-r1-1.5b-packed/model_layers_13_mlp_up_proj_weight.rmm +1 -0
  42. deepseek-r1-1.5b-packed/model_layers_13_mlp_up_proj_weight.scales +0 -0
  43. deepseek-r1-1.5b-packed/model_layers_13_self_attn_k_proj_bias.fp16 +0 -0
  44. deepseek-r1-1.5b-packed/model_layers_13_self_attn_k_proj_weight.scales +0 -0
  45. deepseek-r1-1.5b-packed/model_layers_13_self_attn_q_proj_weight.scales +0 -0
  46. deepseek-r1-1.5b-packed/model_layers_13_self_attn_v_proj_weight.signs +0 -0
  47. deepseek-r1-1.5b-packed/model_layers_14_mlp_down_proj_weight.scales +0 -0
  48. deepseek-r1-1.5b-packed/model_layers_14_mlp_gate_proj_weight.scales +0 -0
  49. deepseek-r1-1.5b-packed/model_layers_14_mlp_up_proj_weight.scales +0 -0
  50. deepseek-r1-1.5b-packed/model_layers_14_self_attn_o_proj_weight.rmm +1 -0
deepseek-r1-1.5b-packed/model_layers_0_mlp_down_proj_weight.scales ADDED
Binary file (6.14 kB). View file
 
deepseek-r1-1.5b-packed/model_layers_0_mlp_gate_proj_weight.scales ADDED
Binary file (35.8 kB). View file
 
deepseek-r1-1.5b-packed/model_layers_0_self_attn_k_proj_bias.fp16 ADDED
Binary file (512 Bytes). View file
 
deepseek-r1-1.5b-packed/model_layers_0_self_attn_k_proj_weight.rmm ADDED
@@ -0,0 +1 @@
 
 
1
+ 
deepseek-r1-1.5b-packed/model_layers_0_self_attn_k_proj_weight.signs ADDED
Binary file (49.2 kB). View file
 
deepseek-r1-1.5b-packed/model_layers_0_self_attn_o_proj_weight.scales ADDED
Binary file (6.14 kB). View file
 
deepseek-r1-1.5b-packed/model_layers_0_self_attn_q_proj_weight.rmm ADDED
@@ -0,0 +1 @@
 
 
1
+ 
deepseek-r1-1.5b-packed/model_layers_0_self_attn_v_proj_bias.fp16 ADDED
Binary file (512 Bytes). View file
 
deepseek-r1-1.5b-packed/model_layers_0_self_attn_v_proj_weight.scales ADDED
Binary file (1.02 kB). View file
 
deepseek-r1-1.5b-packed/model_layers_10_input_layernorm_weight.fp16 ADDED
Binary file (3.07 kB). View file
 
deepseek-r1-1.5b-packed/model_layers_10_mlp_down_proj_weight.rmm ADDED
@@ -0,0 +1 @@
 
 
1
+ 
deepseek-r1-1.5b-packed/model_layers_10_mlp_down_proj_weight.scales ADDED
Binary file (6.14 kB). View file
 
deepseek-r1-1.5b-packed/model_layers_10_mlp_gate_proj_weight.rmm ADDED
@@ -0,0 +1 @@
 
 
1
+ 
deepseek-r1-1.5b-packed/model_layers_10_post_attention_layernorm_weight.fp16 ADDED
Binary file (3.07 kB). View file
 
deepseek-r1-1.5b-packed/model_layers_10_self_attn_k_proj_weight.scales ADDED
Binary file (1.02 kB). View file
 
deepseek-r1-1.5b-packed/model_layers_10_self_attn_k_proj_weight.signs ADDED
Binary file (49.2 kB). View file
 
deepseek-r1-1.5b-packed/model_layers_11_mlp_gate_proj_weight.rmm ADDED
@@ -0,0 +1 @@
 
 
1
+ 
deepseek-r1-1.5b-packed/model_layers_11_mlp_gate_proj_weight.scales ADDED
Binary file (35.8 kB). View file
 
deepseek-r1-1.5b-packed/model_layers_11_mlp_up_proj_weight.scales ADDED
Binary file (35.8 kB). View file
 
deepseek-r1-1.5b-packed/model_layers_11_self_attn_k_proj_bias.fp16 ADDED
Binary file (512 Bytes). View file
 
deepseek-r1-1.5b-packed/model_layers_11_self_attn_k_proj_weight.rmm ADDED
@@ -0,0 +1 @@
 
 
1
+ 
deepseek-r1-1.5b-packed/model_layers_11_self_attn_k_proj_weight.scales ADDED
Binary file (1.02 kB). View file
 
deepseek-r1-1.5b-packed/model_layers_11_self_attn_o_proj_weight.rmm ADDED
@@ -0,0 +1 @@
 
 
1
+ 
deepseek-r1-1.5b-packed/model_layers_11_self_attn_o_proj_weight.scales ADDED
Binary file (6.14 kB). View file
 
deepseek-r1-1.5b-packed/model_layers_11_self_attn_q_proj_bias.fp16 ADDED
Binary file (3.07 kB). View file
 
deepseek-r1-1.5b-packed/model_layers_11_self_attn_q_proj_weight.rmm ADDED
@@ -0,0 +1 @@
 
 
1
+ 
deepseek-r1-1.5b-packed/model_layers_11_self_attn_q_proj_weight.scales ADDED
Binary file (6.14 kB). View file
 
deepseek-r1-1.5b-packed/model_layers_11_self_attn_v_proj_bias.fp16 ADDED
Binary file (512 Bytes). View file
 
deepseek-r1-1.5b-packed/model_layers_11_self_attn_v_proj_weight.rmm ADDED
@@ -0,0 +1 @@
 
 
1
+ 
deepseek-r1-1.5b-packed/model_layers_11_self_attn_v_proj_weight.signs ADDED
Binary file (49.2 kB). View file
 
deepseek-r1-1.5b-packed/model_layers_12_input_layernorm_weight.fp16 ADDED
Binary file (3.07 kB). View file
 
deepseek-r1-1.5b-packed/model_layers_12_mlp_gate_proj_weight.scales ADDED
Binary file (35.8 kB). View file
 
deepseek-r1-1.5b-packed/model_layers_12_self_attn_k_proj_bias.fp16 ADDED
Binary file (512 Bytes). View file
 
deepseek-r1-1.5b-packed/model_layers_12_self_attn_q_proj_weight.scales ADDED
Binary file (6.14 kB). View file
 
deepseek-r1-1.5b-packed/model_layers_12_self_attn_v_proj_weight.rmm ADDED
@@ -0,0 +1 @@
 
 
1
+ 
deepseek-r1-1.5b-packed/model_layers_12_self_attn_v_proj_weight.scales ADDED
Binary file (1.02 kB). View file
 
deepseek-r1-1.5b-packed/model_layers_13_input_layernorm_weight.fp16 ADDED
Binary file (3.07 kB). View file
 
deepseek-r1-1.5b-packed/model_layers_13_mlp_gate_proj_weight.mags ADDED
File without changes
deepseek-r1-1.5b-packed/model_layers_13_mlp_gate_proj_weight.rmm ADDED
@@ -0,0 +1 @@
 
 
1
+ 
deepseek-r1-1.5b-packed/model_layers_13_mlp_gate_proj_weight.scales ADDED
Binary file (35.8 kB). View file
 
deepseek-r1-1.5b-packed/model_layers_13_mlp_up_proj_weight.rmm ADDED
@@ -0,0 +1 @@
 
 
1
+ 
deepseek-r1-1.5b-packed/model_layers_13_mlp_up_proj_weight.scales ADDED
Binary file (35.8 kB). View file
 
deepseek-r1-1.5b-packed/model_layers_13_self_attn_k_proj_bias.fp16 ADDED
Binary file (512 Bytes). View file
 
deepseek-r1-1.5b-packed/model_layers_13_self_attn_k_proj_weight.scales ADDED
Binary file (1.02 kB). View file
 
deepseek-r1-1.5b-packed/model_layers_13_self_attn_q_proj_weight.scales ADDED
Binary file (6.14 kB). View file
 
deepseek-r1-1.5b-packed/model_layers_13_self_attn_v_proj_weight.signs ADDED
Binary file (49.2 kB). View file
 
deepseek-r1-1.5b-packed/model_layers_14_mlp_down_proj_weight.scales ADDED
Binary file (6.14 kB). View file
 
deepseek-r1-1.5b-packed/model_layers_14_mlp_gate_proj_weight.scales ADDED
Binary file (35.8 kB). View file
 
deepseek-r1-1.5b-packed/model_layers_14_mlp_up_proj_weight.scales ADDED
Binary file (35.8 kB). View file
 
deepseek-r1-1.5b-packed/model_layers_14_self_attn_o_proj_weight.rmm ADDED
@@ -0,0 +1 @@
 
 
1
+