Hugging Face's logo

JackBinary
/
OpenCodeReasoning-Nemotron-1.1-14B-q4f32_1-MLC

MLC-LLM
web-llm
Model card Files
xet
 Community
JackBinary commited on
Commit
f662e00
·
verified ·
1 Parent(s): bf591b5

Add files using upload-large-folder tool

Browse files
Files changed (50) hide show
  1. README.md +52 -0
  2. ndarray-cache-b16.json +0 -0
  3. ndarray-cache.json +0 -0
  4. params_shard_100.bin +3 -0
  5. params_shard_101.bin +3 -0
  6. params_shard_102.bin +3 -0
  7. params_shard_109.bin +3 -0
  8. params_shard_113.bin +3 -0
  9. params_shard_117.bin +3 -0
  10. params_shard_119.bin +3 -0
  11. params_shard_124.bin +3 -0
  12. params_shard_127.bin +3 -0
  13. params_shard_132.bin +3 -0
  14. params_shard_138.bin +3 -0
  15. params_shard_142.bin +3 -0
  16. params_shard_149.bin +3 -0
  17. params_shard_15.bin +3 -0
  18. params_shard_151.bin +3 -0
  19. params_shard_158.bin +3 -0
  20. params_shard_16.bin +3 -0
  21. params_shard_164.bin +3 -0
  22. params_shard_17.bin +3 -0
  23. params_shard_173.bin +3 -0
  24. params_shard_175.bin +3 -0
  25. params_shard_176.bin +3 -0
  26. params_shard_18.bin +3 -0
  27. params_shard_180.bin +3 -0
  28. params_shard_182.bin +3 -0
  29. params_shard_185.bin +3 -0
  30. params_shard_191.bin +3 -0
  31. params_shard_192.bin +3 -0
  32. params_shard_20.bin +3 -0
  33. params_shard_3.bin +3 -0
  34. params_shard_4.bin +3 -0
  35. params_shard_40.bin +3 -0
  36. params_shard_49.bin +3 -0
  37. params_shard_54.bin +3 -0
  38. params_shard_59.bin +3 -0
  39. params_shard_64.bin +3 -0
  40. params_shard_65.bin +3 -0
  41. params_shard_68.bin +3 -0
  42. params_shard_69.bin +3 -0
  43. params_shard_73.bin +3 -0
  44. params_shard_8.bin +3 -0
  45. params_shard_81.bin +3 -0
  46. params_shard_82.bin +3 -0
  47. params_shard_85.bin +3 -0
  48. params_shard_86.bin +3 -0
  49. params_shard_90.bin +3 -0
  50. params_shard_94.bin +3 -0
README.md ADDED
@@ -0,0 +1,52 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: mlc-llm
3
+ base_model: nvidia/OpenCodeReasoning-Nemotron-1.1-14B
4
+ tags:
5
+ - mlc-llm
6
+ - web-llm
7
+ ---
8
+
9
+ # OpenCodeReasoning-Nemotron-1.1-14B-q4f32_1-MLC
10
+
11
+ This is the [OpenCodeReasoning-Nemotron-1.1-14B](https://huggingface.co/nvidia/OpenCodeReasoning-Nemotron-1.1-14B) model in MLC format `q4f32_1`.
12
+ The model can be used with [MLC-LLM](https://github.com/mlc-ai/mlc-llm) and [WebLLM](https://github.com/mlc-ai/web-llm).
13
+
14
+ ## Example Usage
15
+
16
+ Before using the examples, please follow the [installation guide](https://llm.mlc.ai/docs/install/mlc_llm.html#install-mlc-packages).
17
+
18
+ ### Chat CLI
19
+
20
+ ```bash
21
+ mlc_llm chat HF://JackBinary/OpenCodeReasoning-Nemotron-1.1-14B-q4f32_1-MLC
22
+ ````
23
+
24
+ ### REST Server
25
+
26
+ ```bash
27
+ mlc_llm serve HF://JackBinary/OpenCodeReasoning-Nemotron-1.1-14B-q4f32_1-MLC
28
+ ```
29
+
30
+ ### Python API
31
+
32
+ ```python
33
+ from mlc_llm import MLCEngine
34
+
35
+ model = "HF://JackBinary/OpenCodeReasoning-Nemotron-1.1-14B-q4f32_1-MLC"
36
+ engine = MLCEngine(model)
37
+
38
+ for response in engine.chat.completions.create(
39
+ messages=[{"role": "user", "content": "What is the meaning of life?"}],
40
+ model=model,
41
+ stream=True,
42
+ ):
43
+ for choice in response.choices:
44
+ print(choice.delta.content, end="", flush=True)
45
+ print("\n")
46
+
47
+ engine.terminate()
48
+ ```
49
+
50
+ ## Documentation
51
+
52
+ For more on MLC LLM, visit the [documentation](https://llm.mlc.ai/docs/) and [GitHub repo](https://github.com/mlc-ai/mlc-llm).
ndarray-cache-b16.json ADDED
The diff for this file is too large to render. See raw diff
 
ndarray-cache.json ADDED
The diff for this file is too large to render. See raw diff
 
params_shard_100.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bdaa7d9da45fad26a7743ceaf9c42ee6db04be18b70e8f6b79bf5ba2af125a10
3
+ size 70778880
params_shard_101.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d59bddb89e4db816948f647af58c76b9b8fbaaccbe4c7b3f7a7c376bb1e26fe5
3
+ size 18350080
params_shard_102.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c1b83ce81ad2c5bfd1173acb9651ce76aeb242dc67ccb1f2df8a64bacbf3b8ef
3
+ size 30345216
params_shard_109.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:21a16c0d747ef62b6da132c15561faece85c8dd3a097d45360212e3166f6c4c1
3
+ size 18350080
params_shard_113.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0d3e6ff7276fb078e58d06bd95dfce8505be8c073298a5193ebe35f050991a57
3
+ size 18350080
params_shard_117.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c7dd2de86f0852d57a4a097623de0cf6dc2bb5ada1c62e47755aa278e749a8ff
3
+ size 18350080
params_shard_119.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ffd6cb8ded16d8036b9b2e95754259b464396f36bff84e4f59ab941ccb46b320
3
+ size 35389440
params_shard_124.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1b48ae75f971da8f8416fbfc53397328884c6f6761a34a5ac3a4609e137a8479
3
+ size 70778880
params_shard_127.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1e4b97a7695639a0f8793f64274beb182bde537b670ea2634b06dd46bcd70b6b
3
+ size 32471040
params_shard_132.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2b759e16ae2236a53019d112a8e8c28170ef699ee6ea74e44593932fa299f972
3
+ size 30345216
params_shard_138.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4ed4fc2918b48811bd2a0ef206e6eab722fab90d11cc4e0f9bdeefb6c15366f0
3
+ size 70778880
params_shard_142.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d55cb8e34d2f9279275672c9f1b53d19986543aa3b8ddee05ea592a2e661906d
3
+ size 70778880
params_shard_149.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d9738634be58b4d3f52fd02bcfbdb7b0c8fc7d21c0cb014ece8949bcc4a82695
3
+ size 35389440
params_shard_15.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9661e0304177f2f79852be1ec7767ac816e0eb6a60d217a2f65c8eb30306a8c2
3
+ size 30345216
params_shard_151.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e18b622af1bc23886854b802b6c5d2634a1ec3a4de81ea0c7e8efb1bda66d66b
3
+ size 18350080
params_shard_158.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:76ba6fb333f3f2e5dce6d1778647bbc6b94604d1d9fad9f4872391c94eb14877
3
+ size 70778880
params_shard_16.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:984130b606cb549d496d9b30723a59cce5212306f195da8b81de9a04ffcf413e
3
+ size 35389440
params_shard_164.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c2675ff941e5481992f7f0c09846671a2bf2b65a7ff6f0bd83504498cf5ab495
3
+ size 30345216
params_shard_17.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1387f0ee4e267f0d556f42971a62a2fe5c74bce374a72c18b49ce8e89da29d28
3
+ size 70778880
params_shard_173.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cf7ec5b4d32fbfeb16da3e4dc8065de6996eb6ee6e6cc3359aeb43a4e8743ffc
3
+ size 35389440
params_shard_175.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f7875a28128131fc5a8304058d473d03c7eae65fcab0e63900afde88c1d19d0a
3
+ size 18350080
params_shard_176.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:61bb6ac420207b98f0835e97e88f0dc692b39cb781328092cb83837640184ea0
3
+ size 30345216
params_shard_18.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:034f66d899a5ce393d0527c3740a8c21360695e4f13d57aacd466a4467979ff6
3
+ size 18350080
params_shard_180.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:72e5833c6610af3d478c4a7736a518c02a55456d37a4169a364f94d34a3e0f41
3
+ size 30345216
params_shard_182.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7b489142b2a395fa88e3b949ad7021989209af7eeaa8aee963ff71cf22942511
3
+ size 70778880
params_shard_185.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8cc1244f1d43f84816124541ead32f561ff1257480d63dc5ab4d51aa31cf2cac
3
+ size 35389440
params_shard_191.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9169f148d7ba9401f009609531fbf6cfc988f862bb39bd11cbeddbcdace29535
3
+ size 18350080
params_shard_192.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5189d12d2e60db8d6e0c681bfb973a9ea1b8e9e71cc194d68b1734be5da32d82
3
+ size 30345216
params_shard_20.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0369e13384a904c339f8b71336bfc4934baa7f65c604243724194af16c99bbb2
3
+ size 35389440
params_shard_3.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ae5590523a444485e71c1d8e4332d9359be0cdd57342c794d4d5b3d1a4015fc5
3
+ size 70778880
params_shard_4.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c5762bfd82ed920ba3c227042f42e88caeecc13715d39937412afb85eebe342c
3
+ size 35389440
params_shard_40.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b14c37c18728ba8d1594f5fb2c11128b00e6511e1aec1266c03291b5b8ff21d9
3
+ size 35389440
params_shard_49.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8f525b931bc1dee24e79f47d2d05643c38a967efcfa6bbb7f0276ceff7ec00f7
3
+ size 70778880
params_shard_54.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4c206c4a9138755c2e41b705a0d9f8a00b2e1f31087ecd5695d87c6308da2465
3
+ size 18350080
params_shard_59.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:130e596263da9ea3b807125025d97714544b3772e448bf75fff6747df56ee4be
3
+ size 30345216
params_shard_64.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:17dd7752723cffcc5b98555abc61bd2dd706f5974af21b1a33b3e47b0f40221c
3
+ size 18350080
params_shard_65.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:661b3a7c12e770760b0fa4e7d4ab91f531a516c0876a428765629807a25a03a4
3
+ size 30355456
params_shard_68.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4aebe64afc845f6f7d08a7b6122ea90c4eff20242ab4ceaf2b374cdd890e6840
3
+ size 18350080
params_shard_69.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:589164b4b0ddfdc287811240117f47cb0b69dd12bf8954293b232bd125d8ee3b
3
+ size 30345216
params_shard_73.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b330276db0ca9cc165ef350ff88824313c12780abdbe8c9eab185e3c19aeb4f8
3
+ size 30345216
params_shard_8.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e93a087a821fe2d9c51282ed05468291d40c5dddd866082e7e440f9924189607
3
+ size 35389440
params_shard_81.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2acf8d885bb053cf956954b048d09baeee277e09bc4c3670cb3e378df45a051a
3
+ size 30345216
params_shard_82.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3a4a3b06ea12197c8e669a5219fd22a92b0059ee1d85c897871f10840b8c7404
3
+ size 35389440
params_shard_85.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:458dfbd091eed446ea6a604e9d845b2162ddb05fa9a96769cb65392e6c2f51c9
3
+ size 30345216
params_shard_86.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1c81afd2f775195c192c62d14772420f7e0a974f688a7300bbfc77d85b2473b7
3
+ size 35389440
params_shard_90.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5f78880657485f26794e4e237414407dda836d304cadbef0e6ae74b56065e71f
3
+ size 33110016
params_shard_94.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d77e2fa432e3cc581b44d5fe915a85ef773eabd41d12315857dcc4dfe95fd582
3
+ size 32638976