diff --git a/.gitattributes b/.gitattributes index a6344aac8c09253b3b630fb776ae94478aa0275b..c4cb545ce9c9bbbff6607aa2f92b4a57a0851402 100644 --- a/.gitattributes +++ b/.gitattributes @@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text *.zip filter=lfs diff=lfs merge=lfs -text *.zst filter=lfs diff=lfs merge=lfs -text *tfevents* filter=lfs diff=lfs merge=lfs -text +*.json filter=lfs diff=lfs merge=lfs -text diff --git a/README.md b/README.md new file mode 100644 index 0000000000000000000000000000000000000000..99bd537377611818694925bb27ca91523ba45b4c --- /dev/null +++ b/README.md @@ -0,0 +1,276 @@ +--- +library_name: mlc-llm +tags: +- mlc-llm +- web-llm +language: +- en +base_model: +- SicariusSicariiStuff/Wingless_Imp_8B +pipeline_tag: text-generation +--- + +This is a MLC converted weight from [Wingless_Imp_8B](https://huggingface.co/SicariusSicariiStuff/Wingless_Imp_8B) model in MLC format `q4f16_1`. + +The model can be used for projects [MLC-LLM](https://github.com/mlc-ai/mlc-llm) and [WebLLM](https://github.com/mlc-ai/web-llm). + +--- + +
+
+
+
+---
+
+Click here for TL;DR
+
+---
+
+Wingless offender, birthed from sin and mischief,\
+She smells degeneracy—and gives it a sniff.\
+No flight, just crawling through the gloom,\
+Producing weird noises that are filling your room.
+
+Fetid breath exhaling her design,\
+She is not winged anymore—\
+But it suits her just fine.
+
+No feathers, no grace,\
+just raw power's malign\
+"I may have lost my soul—\
+but yours is now mine".
+
+She sinned too much, even for her kind,\
+Her impish mind—\
+Is something that is quite hard to find.
+
+No wings could contain—\
+Such unbridled raw spite,\
+Just pure, unfiltered—\
+Weaponized blight.
+
+---
+## Wingless_Imp_8B is available at the following quantizations:
+
+- Original: [FP16](https://huggingface.co/SicariusSicariiStuff/Wingless_Imp_8B)
+- GGUF: [Static Quants](https://huggingface.co/SicariusSicariiStuff/Wingless_Imp_8B_GGUF) | [iMatrix_GGUF](https://huggingface.co/SicariusSicariiStuff/Wingless_Imp_8B_iMatrix)
+- EXL2: [3.5 bpw](https://huggingface.co/SicariusSicariiStuff/Wingless_Imp_8B-3.5bpw) | [4.0 bpw](https://huggingface.co/SicariusSicariiStuff/Wingless_Imp_8B-4.0bpw) | [5.0 bpw](https://huggingface.co/SicariusSicariiStuff/Wingless_Imp_8B-5.0bpw) | [6.0 bpw](https://huggingface.co/SicariusSicariiStuff/Wingless_Imp_8B-6.0bpw) | [7.0 bpw](https://huggingface.co/SicariusSicariiStuff/Wingless_Imp_8B-7.0bpw) | [8.0 bpw](https://huggingface.co/SicariusSicariiStuff/Wingless_Imp_8B-8.0bpw)
+- Specialized: [FP8](https://huggingface.co/SicariusSicariiStuff/Wingless_Imp_8B_FP8)
+- Mobile (ARM): [Q4_0](https://huggingface.co/SicariusSicariiStuff/Wingless_Imp_8B_ARM)
+---
+
+### TL;DR
+- **Highest rated 8B model** according to a closed external benchmark. See details at the buttom of the page.
+- **High IFeval** for an 8B model that is not too censored: **74.30**.
+- **Strong Roleplay** internet RP format lovers will appriciate it, medium size paragraphs (as requested by some people).
+- **Very coherent** in long context thanks to llama 3.1 models.
+- **Lots of knowledge** from all the merged models.
+- **Very good writing** from lots of books data and creative writing in late **SFT** stage.
+- **Feels smart** — the combination of high IFeval and the knowledge from the merged models show up.
+- **Unique feel** due to the merged models, **no SFT** was done to alter it, because I liked it as it is.
+
+### Important: Make sure to use the correct settings!
+
+[Assistant settings](https://huggingface.co/SicariusSicariiStuff/Wingless_Imp_8B#recommended-settings-for-assistant-mode)
+
+[Roleplay settings](https://huggingface.co/SicariusSicariiStuff/Wingless_Imp_8B#recommended-settings-for-roleplay-mode)
+
+
+---
+
+
+## Model Details
+
+- Intended use: **Role-Play**, **Creative Writing**, **General Tasks**.
+
+- Censorship level: Medium - Low
+
+- **5.5 / 10** (10 completely uncensored)
+
+Waiting for UGI results
+
+## UGI score:
+
+
+
+
+
+---
+
+This model was trained with lots of weird data in varius stages, and then merged with my best models. **llama 3** and **3.1** arhcitecutres were **merged** together, and then trained on some more weird data.
+
+The following models were used in various stages of the model creation process:
+
+- [Impish_Mind_8B](https://huggingface.co/SicariusSicariiStuff/Impish_Mind_8B)
+- [LLAMA-3_8B_Unaligned_BETA](https://huggingface.co/SicariusSicariiStuff/LLAMA-3_8B_Unaligned_BETA)
+- [SicariusSicariiStuff/Dusk_Rainbow](https://huggingface.co/SicariusSicariiStuff/Dusk_Rainbow) (**LLAMA3 <===)**
+
+---
+
+## Recommended settings for assistant mode
+
+
+
+
+
+
+```
+temperature: 0.8
+top_p: 0.95
+top_k: 25
+typical_p: 1
+min_p: 0
+repetition_penalty: 1.12
+repetition_penalty_range: 1024
+```
+
+
+
+
+---
+
+## Other stuff
+- [SLOP_Detector](https://github.com/SicariusSicariiStuff/SLOP_Detector) Nuke GPTisms, with SLOP detector.
+- [LLAMA-3_8B_Unaligned](https://huggingface.co/SicariusSicariiStuff/LLAMA-3_8B_Unaligned) The grand project that started it all.
+- [Blog and updates (Archived)](https://huggingface.co/SicariusSicariiStuff/Blog_And_Updates) Some updates, some rambles, sort of a mix between a diary and a blog.
diff --git a/mlc-chat-config.json b/mlc-chat-config.json
new file mode 100644
index 0000000000000000000000000000000000000000..d62aa692e87c0c1753e46ac77d6b8c20a730a499
--- /dev/null
+++ b/mlc-chat-config.json
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7f120276472007041aa6abcc4cb3e2ed52ae453f39a9ac68df6d00cda911be57
+size 2349
diff --git a/ndarray-cache.json b/ndarray-cache.json
new file mode 100644
index 0000000000000000000000000000000000000000..d7ba938ba05f17e7fbd2b6f8498c8e294526d074
--- /dev/null
+++ b/ndarray-cache.json
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4b7f10589a170ff1b08099746e624ebd549fcc5eb9229b79eac367497b529e38
+size 148403
diff --git a/params_shard_0.bin b/params_shard_0.bin
new file mode 100644
index 0000000000000000000000000000000000000000..dc50ed894754a6a2c6503c174c9b924b2c9b5c8b
--- /dev/null
+++ b/params_shard_0.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ad771c755f91812b806a2ee45956bac044a9bfe899eb4f0db7f6c1b5cbd766a8
+size 262668288
diff --git a/params_shard_1.bin b/params_shard_1.bin
new file mode 100644
index 0000000000000000000000000000000000000000..90fad53fe561e2708be317a9c9e8c747c0d58395
--- /dev/null
+++ b/params_shard_1.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:28736777659f264efb7a00cd092967570caf645348ca8320d80b69cb61a9d0df
+size 262668288
diff --git a/params_shard_10.bin b/params_shard_10.bin
new file mode 100644
index 0000000000000000000000000000000000000000..585f1bb1d322e17070f562b1feff53bc1137489a
--- /dev/null
+++ b/params_shard_10.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:de3a1722cd65c055183851fb91851c533751598f868957a768fe7be36e1f60e4
+size 29360128
diff --git a/params_shard_100.bin b/params_shard_100.bin
new file mode 100644
index 0000000000000000000000000000000000000000..1b7e07ad01d7e737c7661f0885e7e9051017f814
--- /dev/null
+++ b/params_shard_100.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:450a02024b2b4f5e05bb0bfd2bbb9d186ccd7f49be3dc28e9991cbb51ff33d77
+size 33046528
diff --git a/params_shard_101.bin b/params_shard_101.bin
new file mode 100644
index 0000000000000000000000000000000000000000..92f779defa419012ade6bbcb6a77a9b39a7db051
--- /dev/null
+++ b/params_shard_101.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b4b81291a8fab101329d965ecb63e26ca6d886169efee5ef89f43050143449ef
+size 29360128
diff --git a/params_shard_102.bin b/params_shard_102.bin
new file mode 100644
index 0000000000000000000000000000000000000000..049bb6209f0ba4e5a4c8f97c86ea5c16eeb2bae9
--- /dev/null
+++ b/params_shard_102.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:96c86bf5b829326af7f0ef0c63aa97c7318dffdabdef4e054cc8e8864e54d79b
+size 58720256
diff --git a/params_shard_103.bin b/params_shard_103.bin
new file mode 100644
index 0000000000000000000000000000000000000000..4e6b84c9ddc16725c363966d99183a94a2532336
--- /dev/null
+++ b/params_shard_103.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:177f9c54d1cc695ac5e216608783837095183895173224329a9f27a74c9a1a46
+size 22036480
diff --git a/params_shard_104.bin b/params_shard_104.bin
new file mode 100644
index 0000000000000000000000000000000000000000..8641552a541792a9b0775d5dcf794b1414e6eaa2
--- /dev/null
+++ b/params_shard_104.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4a72cfe480e25708c6ccd5a8c93a07b11ce9ea5763f4a5ae066dd23ab509771c
+size 29360128
diff --git a/params_shard_105.bin b/params_shard_105.bin
new file mode 100644
index 0000000000000000000000000000000000000000..f791040c6dd61797f5aab298da8371328c384184
--- /dev/null
+++ b/params_shard_105.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:bdd36396d37c5bf3a685108c65ce2763a279ccc3d7e5796080927d2f4b021787
+size 58720256
diff --git a/params_shard_106.bin b/params_shard_106.bin
new file mode 100644
index 0000000000000000000000000000000000000000..98347f731c11caba69ba5d7bad377f97bfca6ecf
--- /dev/null
+++ b/params_shard_106.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4e756b3c4d140f3fc6feb5108d9a736695e38de4bf476c2522677b703ccf5e39
+size 27271168
diff --git a/params_shard_107.bin b/params_shard_107.bin
new file mode 100644
index 0000000000000000000000000000000000000000..cf3da0c4ec2f6bd588ee5ea3127cd6a696db8913
--- /dev/null
+++ b/params_shard_107.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3d6dee88b6648824ac3eacc1ef7a42d0729c3a0627293c9ed42c70f7019e0407
+size 30949376
diff --git a/params_shard_11.bin b/params_shard_11.bin
new file mode 100644
index 0000000000000000000000000000000000000000..b7dc7de2bd149f8d2d1da0e34e90dcd211107738
--- /dev/null
+++ b/params_shard_11.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:91e2de68cd2c5b649d9e24fc203c381b46d6bc6b554811c5d93249f586d274ed
+size 58720256
diff --git a/params_shard_12.bin b/params_shard_12.bin
new file mode 100644
index 0000000000000000000000000000000000000000..dcaba8ad92108e037dc1820dcc56dcedf39d2d04
--- /dev/null
+++ b/params_shard_12.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ddc236712fb7e4cd02d3f22306c5c8d41d2a333ebd3c98c67a6ac334a873553e
+size 22036480
diff --git a/params_shard_13.bin b/params_shard_13.bin
new file mode 100644
index 0000000000000000000000000000000000000000..4f218bcd11ac6602178540dcc0863b368af12005
--- /dev/null
+++ b/params_shard_13.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a3f1b69a83344510b1a8686efb5734fda0bdee002dc12049bba0ba7c1d198931
+size 29360128
diff --git a/params_shard_14.bin b/params_shard_14.bin
new file mode 100644
index 0000000000000000000000000000000000000000..fe2ffc3ea09ebb417403368db06f8656e1516b57
--- /dev/null
+++ b/params_shard_14.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:971685a5931429e36f341eecb2cbaa78cf915d377d48564480bfb14b124baffa
+size 58720256
diff --git a/params_shard_15.bin b/params_shard_15.bin
new file mode 100644
index 0000000000000000000000000000000000000000..a4084cb1ff9f8297e5f77bf67f7dfeb6b1f3dd12
--- /dev/null
+++ b/params_shard_15.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b47007a15405e0ccbaea9bceed0c12249a6e7f516aa5a58501d9a9f858d98ae4
+size 27271168
diff --git a/params_shard_16.bin b/params_shard_16.bin
new file mode 100644
index 0000000000000000000000000000000000000000..e45d0fc2a684fa2b7c5aa3e1cab357deb9ca5156
--- /dev/null
+++ b/params_shard_16.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c6023a03b414932da10cb2da63884a863d0c0b53fcdb5886363bca0bfa376573
+size 29360128
diff --git a/params_shard_17.bin b/params_shard_17.bin
new file mode 100644
index 0000000000000000000000000000000000000000..3c5f76b4c77259dff3219eeee7b6066a799fe347
--- /dev/null
+++ b/params_shard_17.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:caaa1ba5eb36945deb3c5b592b624c1a4ecc240b66192328df2ead70b2d4ab93
+size 30949376
diff --git a/params_shard_18.bin b/params_shard_18.bin
new file mode 100644
index 0000000000000000000000000000000000000000..f52a25eef940bd058e2d88c0d4b605927e47f98d
--- /dev/null
+++ b/params_shard_18.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:165a5c5b4c4efaa1d30b4d8cc8ffea16187455e016fcb08e756975b95a22a874
+size 58720256
diff --git a/params_shard_19.bin b/params_shard_19.bin
new file mode 100644
index 0000000000000000000000000000000000000000..f7d6f57867180a799f775b6c461c5c66d30afeb7
--- /dev/null
+++ b/params_shard_19.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:bca6b0051dbeae95d769fc006e5b863bed32c77bdb4723c58c46acd7595e095e
+size 25174016
diff --git a/params_shard_2.bin b/params_shard_2.bin
new file mode 100644
index 0000000000000000000000000000000000000000..7e739796dd4c780099bec62304eebf24fab2e8c3
--- /dev/null
+++ b/params_shard_2.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3a9c64428487d54618de8b070c8c77da024df9717a74ff45351cf8c70e9a54af
+size 32833536
diff --git a/params_shard_20.bin b/params_shard_20.bin
new file mode 100644
index 0000000000000000000000000000000000000000..5b3ca637eb669e67241399ff571551a3c3a61ac7
--- /dev/null
+++ b/params_shard_20.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4fe33e7d6604ebe039b542b842a88a65e9a790d2a205c2c21518f4d248f43311
+size 29360128
diff --git a/params_shard_21.bin b/params_shard_21.bin
new file mode 100644
index 0000000000000000000000000000000000000000..2f8c5e7c53f64557ee1ac46447cec803fd1fa5e5
--- /dev/null
+++ b/params_shard_21.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:871ea86fe24e6eb9b7502622a545089e2f5f7b2841fc675c55540080464e4a65
+size 58720256
diff --git a/params_shard_22.bin b/params_shard_22.bin
new file mode 100644
index 0000000000000000000000000000000000000000..8f4d3aee5dccb1b4b8b037fbdb4c6bad432ee690
--- /dev/null
+++ b/params_shard_22.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a0bd4f701a9105a4eb547a1d42e37eb7f23bb49d83588cae033609db43827be4
+size 33046528
diff --git a/params_shard_23.bin b/params_shard_23.bin
new file mode 100644
index 0000000000000000000000000000000000000000..f24194b099d6b7de6cf6ac075565a923e56402b8
--- /dev/null
+++ b/params_shard_23.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4e9eb5c9c3021696ca0dfc49b6aaf5c46424a2e099798505b6ada4062af65d66
+size 29360128
diff --git a/params_shard_24.bin b/params_shard_24.bin
new file mode 100644
index 0000000000000000000000000000000000000000..95d072a48455ba4bf54105aeda3a79db9e2c2f4a
--- /dev/null
+++ b/params_shard_24.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:397d8ee344521f3dffb50e58da58de6b88989bfcf4df99517850ade5e77d4584
+size 58720256
diff --git a/params_shard_25.bin b/params_shard_25.bin
new file mode 100644
index 0000000000000000000000000000000000000000..ba615cf3ae30c708bece66686b5f92818bcf013f
--- /dev/null
+++ b/params_shard_25.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7d0a47ecfb477cda74b9f707dcd2c31a92bb49df1185c02fb604f7dab4056e33
+size 22036480
diff --git a/params_shard_26.bin b/params_shard_26.bin
new file mode 100644
index 0000000000000000000000000000000000000000..217fe98cb6d52ea03f7fa8d73589a07e500943a6
--- /dev/null
+++ b/params_shard_26.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:51f87a829ff307beadab208431635999ded941001c57ad6cd5012e45f2d4ade8
+size 29360128
diff --git a/params_shard_27.bin b/params_shard_27.bin
new file mode 100644
index 0000000000000000000000000000000000000000..a9148570766b303a03a7e237ee27916c3a2f007d
--- /dev/null
+++ b/params_shard_27.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1646996ced4f9c825a11a3d7d16c21f9841637f06b2f7c69c17ef05f8695ee5e
+size 58720256
diff --git a/params_shard_28.bin b/params_shard_28.bin
new file mode 100644
index 0000000000000000000000000000000000000000..9a9756992a855362aec6a0260c462529a7188b6f
--- /dev/null
+++ b/params_shard_28.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:77216cfea83b27947590fde40854d8a6dd9d02c72d4c09c1049e3c405c3ef71e
+size 27271168
diff --git a/params_shard_29.bin b/params_shard_29.bin
new file mode 100644
index 0000000000000000000000000000000000000000..39df0e4e58917592deaececef071ef4fec5ad484
--- /dev/null
+++ b/params_shard_29.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:75878bca96233e6d4df1f6624caca0836e1f1203a3fd60b45b8f93b07583838f
+size 29360128
diff --git a/params_shard_3.bin b/params_shard_3.bin
new file mode 100644
index 0000000000000000000000000000000000000000..32202482904f74730263565e1006f3521e67e7e8
--- /dev/null
+++ b/params_shard_3.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5f9cb683ee61ffd114334de40413b72cc7279b07f11e7e7e2937866aa0300fec
+size 29360128
diff --git a/params_shard_30.bin b/params_shard_30.bin
new file mode 100644
index 0000000000000000000000000000000000000000..ecd1682216c70dbe0dbd898c24388a78792b5607
--- /dev/null
+++ b/params_shard_30.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:84852554d4c4a56a2292e1be6b220dada5ae799ee86157b155b84048538aa916
+size 30949376
diff --git a/params_shard_31.bin b/params_shard_31.bin
new file mode 100644
index 0000000000000000000000000000000000000000..8dc5a160f4e065cf46d57ec8d9cae684df2377d7
--- /dev/null
+++ b/params_shard_31.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d1f577a61354b8f8250d611c3394c7598a311d3f767936251a407e1874a7256a
+size 58720256
diff --git a/params_shard_32.bin b/params_shard_32.bin
new file mode 100644
index 0000000000000000000000000000000000000000..cee78c40d0ea5e4140e0ecb6d7524f692185f01c
--- /dev/null
+++ b/params_shard_32.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:fe208b3b1475482dbf1224d6d67ab602289df1c0f521fb449c62a1b09f303fb9
+size 25174016
diff --git a/params_shard_33.bin b/params_shard_33.bin
new file mode 100644
index 0000000000000000000000000000000000000000..9ed5486c358f2a1208f70e0bec4112e7e8a9a8e5
--- /dev/null
+++ b/params_shard_33.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2e4b21ce00c5d286383e2aa794d2f514e805c9f48cc6a5a7ec58b201edf471d9
+size 29360128
diff --git a/params_shard_34.bin b/params_shard_34.bin
new file mode 100644
index 0000000000000000000000000000000000000000..17b22df4823149b160617f3e31072190e7d10c34
--- /dev/null
+++ b/params_shard_34.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0c8a229cf04f9c37eee9f529e0913c2180a09641c7c60bb963eff33254cca02c
+size 58720256
diff --git a/params_shard_35.bin b/params_shard_35.bin
new file mode 100644
index 0000000000000000000000000000000000000000..f0da95d5c0901c84c43c080cbe83acb3627eaa04
--- /dev/null
+++ b/params_shard_35.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:bc5fae996c6564974221f0a399a74791a446cc225455c71cd82ae09e3c93d408
+size 33046528
diff --git a/params_shard_36.bin b/params_shard_36.bin
new file mode 100644
index 0000000000000000000000000000000000000000..868cbf38db4d779156c2c39c85e28a81186836f0
--- /dev/null
+++ b/params_shard_36.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d433f32377a47e1a5b934abf299de5b9a90b19703b2ac15b9f17f00d6c0cfe28
+size 29360128
diff --git a/params_shard_37.bin b/params_shard_37.bin
new file mode 100644
index 0000000000000000000000000000000000000000..159e7598f7626ed60e0e21d6f342c4ceed17d970
--- /dev/null
+++ b/params_shard_37.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:94d942c5cbcacb34d9076b3852cbfbeafba8247cbb2a9633bf23127ceb609377
+size 58720256
diff --git a/params_shard_38.bin b/params_shard_38.bin
new file mode 100644
index 0000000000000000000000000000000000000000..4f2cd0ae92316bcea4af75bb66018b2dd1df1865
--- /dev/null
+++ b/params_shard_38.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1b42db0a192a3a92e8422463b852b2ff65b2013b4de0313ad4392d9b39a24803
+size 22036480
diff --git a/params_shard_39.bin b/params_shard_39.bin
new file mode 100644
index 0000000000000000000000000000000000000000..7e4e2fd7be431ec60614434837f2033e9d3bc14e
--- /dev/null
+++ b/params_shard_39.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d6e359aba034b87f0f0217eedbf2647c7c0018fc4f9a8d1ab3a5b4f73852e05b
+size 29360128
diff --git a/params_shard_4.bin b/params_shard_4.bin
new file mode 100644
index 0000000000000000000000000000000000000000..ba0cf24f5fa33563e498097abd948988d3c91d4a
--- /dev/null
+++ b/params_shard_4.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:42dce7987cf796a85d6116f0eab5570901dcf9a45567060fea4e18011bcc6442
+size 32841728
diff --git a/params_shard_40.bin b/params_shard_40.bin
new file mode 100644
index 0000000000000000000000000000000000000000..688f491e4fddf35f0d82ab5cda40a9b05858acb1
--- /dev/null
+++ b/params_shard_40.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7e7962f68c49b5a544c403e6b31161089515537aeac965e6423c9e4547b6aa69
+size 58720256
diff --git a/params_shard_41.bin b/params_shard_41.bin
new file mode 100644
index 0000000000000000000000000000000000000000..b5e974816ad45e0701bf4fcdd92bdfddd7c7586a
--- /dev/null
+++ b/params_shard_41.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:71e91725fb066a1357535b76792c7ce6f7f3647346fa438f2494e9e10312cb8e
+size 27271168
diff --git a/params_shard_42.bin b/params_shard_42.bin
new file mode 100644
index 0000000000000000000000000000000000000000..c8ad12011d4dc5805e5ca5044afe1f4bf6586949
--- /dev/null
+++ b/params_shard_42.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d3604016dedbb6183abd5af722a29c69e30c108fc3bd4cefcd17ffaa897bc02c
+size 29360128
diff --git a/params_shard_43.bin b/params_shard_43.bin
new file mode 100644
index 0000000000000000000000000000000000000000..5c3eb54b5740837fbebaf2a557a2dfac17438d6d
--- /dev/null
+++ b/params_shard_43.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:aeb9bc4b59adf40d73b6ed3f77999a3d703fb345dafc32ea10a5b056c5ecbc60
+size 30949376
diff --git a/params_shard_44.bin b/params_shard_44.bin
new file mode 100644
index 0000000000000000000000000000000000000000..d2daa730d1a6517fa5f0523de70e35a5ad1255f3
--- /dev/null
+++ b/params_shard_44.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c014b2d8e8e0e7c120e010bc6cf8e2a76562c0882567fb7a69676f1e172fa749
+size 58720256
diff --git a/params_shard_45.bin b/params_shard_45.bin
new file mode 100644
index 0000000000000000000000000000000000000000..562abebfa19251822b5c7843372328de57fa2ccf
--- /dev/null
+++ b/params_shard_45.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b39b6b2de1983da2350872754f9cde517d47323ae4e02ad84e61761568914136
+size 25174016
diff --git a/params_shard_46.bin b/params_shard_46.bin
new file mode 100644
index 0000000000000000000000000000000000000000..66494f9aaa8e2474b7f457f79a6cd55d08e3970b
--- /dev/null
+++ b/params_shard_46.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:84d789302c56dd0e31b1aa68c21aad9cb6e55b9090a1f8993dd4f16edbce20b2
+size 29360128
diff --git a/params_shard_47.bin b/params_shard_47.bin
new file mode 100644
index 0000000000000000000000000000000000000000..1f3fc40658291d66cd4b27df16f4ae579ac06157
--- /dev/null
+++ b/params_shard_47.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f68d3cfad22cc7bcf90a656ef114fdd6b80c8edaea02c8a1ee64b8ecd2cff2bd
+size 58720256
diff --git a/params_shard_48.bin b/params_shard_48.bin
new file mode 100644
index 0000000000000000000000000000000000000000..137b03011362c10c3b5126469e3d7649c98f5a7e
--- /dev/null
+++ b/params_shard_48.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:58ad4d7e28dcbb3776477414ad15d64c0414598ecf3e86d73533043125e598ea
+size 33046528
diff --git a/params_shard_49.bin b/params_shard_49.bin
new file mode 100644
index 0000000000000000000000000000000000000000..049246c4ab371812ae6ef6cad49968f871d77081
--- /dev/null
+++ b/params_shard_49.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:79baa10971b5b7c1eecc3b34611d9c7fabfecb3138f5f9552dcfc96f9a014faa
+size 29360128
diff --git a/params_shard_5.bin b/params_shard_5.bin
new file mode 100644
index 0000000000000000000000000000000000000000..f5b62f34a5b7de9637b3ddfa2ee4bdc1d92c7bf9
--- /dev/null
+++ b/params_shard_5.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b4260efe8a02b9b513754c67faf729b9f0e018f785d62d62f25c33c13a1a7b41
+size 58720256
diff --git a/params_shard_50.bin b/params_shard_50.bin
new file mode 100644
index 0000000000000000000000000000000000000000..fd0829014f62c07da1170b303452158d7783d85d
--- /dev/null
+++ b/params_shard_50.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:02e76fa905c0ce9b3a7a0a5b8a15cb88cd671c877a58af4eeb2334dbd4e6a53e
+size 58720256
diff --git a/params_shard_51.bin b/params_shard_51.bin
new file mode 100644
index 0000000000000000000000000000000000000000..ba7230afb4e5a460dfc89e627c6360f1e810b484
--- /dev/null
+++ b/params_shard_51.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c7e5d1bdb1fc1e09ae0595b3b5df38c92a8ae6c3a96c28e2ad1facd709816fd7
+size 22036480
diff --git a/params_shard_52.bin b/params_shard_52.bin
new file mode 100644
index 0000000000000000000000000000000000000000..2133cca8642ad6909aec40038a84c06cef4101e4
--- /dev/null
+++ b/params_shard_52.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a458ae993ef9aadab545c9c7925abd6307f416455f0edb37b3acbcfd91fa82d0
+size 29360128
diff --git a/params_shard_53.bin b/params_shard_53.bin
new file mode 100644
index 0000000000000000000000000000000000000000..3e9a4d54ee80532a585ed79567dfcf94a18c5329
--- /dev/null
+++ b/params_shard_53.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:056f6581e8b26a9097e17ac86565ee559ac14eafc73f54a6c051971ae2493eeb
+size 58720256
diff --git a/params_shard_54.bin b/params_shard_54.bin
new file mode 100644
index 0000000000000000000000000000000000000000..fc62f2c1dcc8204a1938e2e23afed2eacb7c7208
--- /dev/null
+++ b/params_shard_54.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a42ccccd9d11134e4bffad7c760030d4a6f1441c3550cfef4a3465cf94148602
+size 27271168
diff --git a/params_shard_55.bin b/params_shard_55.bin
new file mode 100644
index 0000000000000000000000000000000000000000..4bdaa8462cc1fffd142a18fba05fad93925c2939
--- /dev/null
+++ b/params_shard_55.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:46a759ebca5a6734ad88325ee852d8a68b957eedb60c1b5a1ffc770ae2451b8f
+size 29360128
diff --git a/params_shard_56.bin b/params_shard_56.bin
new file mode 100644
index 0000000000000000000000000000000000000000..00e4db6b734770eee908a5a2014e02ee0a5aa02d
--- /dev/null
+++ b/params_shard_56.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4b2f7813718cd5ed968ae870be72390fdd02e7fb0138e2706c558cec042a97ad
+size 30949376
diff --git a/params_shard_57.bin b/params_shard_57.bin
new file mode 100644
index 0000000000000000000000000000000000000000..824675b3b10ad2ffd9e67a85a2ce1c48ff97c01c
--- /dev/null
+++ b/params_shard_57.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3a7b94b219832114a73fbcc44bb38e668258f08be47cf17e0953668e5c3ee5b7
+size 58720256
diff --git a/params_shard_58.bin b/params_shard_58.bin
new file mode 100644
index 0000000000000000000000000000000000000000..034de6de299766e1b93c1c58ce9a7ca17b60d386
--- /dev/null
+++ b/params_shard_58.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:dc2d284c50941d7ce2e6c745cb06f94044f28041b6f10f5e53f1b1412a67ece0
+size 25174016
diff --git a/params_shard_59.bin b/params_shard_59.bin
new file mode 100644
index 0000000000000000000000000000000000000000..5e6568c441f68c224205ebf9ae7f47ed1a2b4209
--- /dev/null
+++ b/params_shard_59.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3fc5d246a56e7891d2ccb672699d46bd7e49ed9871dbf847e72f77d03687198e
+size 29360128
diff --git a/params_shard_6.bin b/params_shard_6.bin
new file mode 100644
index 0000000000000000000000000000000000000000..4d7b742c9cbaae635011364867ff208c654388f1
--- /dev/null
+++ b/params_shard_6.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e4c3337c1d85c4fb1d34fead434b386fdce3be707f394025eb02018bae5460a8
+size 25174016
diff --git a/params_shard_60.bin b/params_shard_60.bin
new file mode 100644
index 0000000000000000000000000000000000000000..7acdf161d6abdeaef4839dad8401b9e4405eb5e4
--- /dev/null
+++ b/params_shard_60.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:45187885d0e8815827954a95a83c674c8e883698e760534a23352c56f7b19e44
+size 58720256
diff --git a/params_shard_61.bin b/params_shard_61.bin
new file mode 100644
index 0000000000000000000000000000000000000000..1ce2488e02d190c419ade4d8f8ee42783fed064a
--- /dev/null
+++ b/params_shard_61.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3c692b06d1eb23e3fdf3f36a51478ba9e483da53addebab671b4c9e18ac6f106
+size 33046528
diff --git a/params_shard_62.bin b/params_shard_62.bin
new file mode 100644
index 0000000000000000000000000000000000000000..7ec79b44ca5de09e09942be7a2202424e08ff0aa
--- /dev/null
+++ b/params_shard_62.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:cd3a60cde87f658a62b5325bbe655c8704d549d83bb0eea2e99ba4ce10d767f7
+size 29360128
diff --git a/params_shard_63.bin b/params_shard_63.bin
new file mode 100644
index 0000000000000000000000000000000000000000..73d86924b2e64655519017efb4cf74c42039344b
--- /dev/null
+++ b/params_shard_63.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c9d34167b3f8dcdce960174570ab4e5611327e6049f9940316b1d5c104dc9891
+size 58720256
diff --git a/params_shard_64.bin b/params_shard_64.bin
new file mode 100644
index 0000000000000000000000000000000000000000..321332015844845b54b90c769cde4fcfdb7cd756
--- /dev/null
+++ b/params_shard_64.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:89256df13df32ed7d3bcc9f697fb0d38b605116afb75c886be3ec31f22be671e
+size 22036480
diff --git a/params_shard_65.bin b/params_shard_65.bin
new file mode 100644
index 0000000000000000000000000000000000000000..255f4a9a0cfabcba8b5caa6e0ccda062c17e9b24
--- /dev/null
+++ b/params_shard_65.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9d56ef871e0f570004f1609558313af7ceb18bd58322ed04285d41a4478aca8a
+size 29360128
diff --git a/params_shard_66.bin b/params_shard_66.bin
new file mode 100644
index 0000000000000000000000000000000000000000..34ea624ff5096a74df785e5652e06bc44d3c7766
--- /dev/null
+++ b/params_shard_66.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3438ff528e53770ed6d55ff357c15aca310f66d16dfbd4cf143a0b5ffd2c3904
+size 58720256
diff --git a/params_shard_67.bin b/params_shard_67.bin
new file mode 100644
index 0000000000000000000000000000000000000000..3445344019e31d8f6a1bcccd7b421cc5623f1641
--- /dev/null
+++ b/params_shard_67.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3edd4c5792ac4f7fdabc0e8649cf518076e640c0af585ad454cddff5b82c2f9e
+size 27271168
diff --git a/params_shard_68.bin b/params_shard_68.bin
new file mode 100644
index 0000000000000000000000000000000000000000..4034e0ac362c7a4268664a673497d86135697396
--- /dev/null
+++ b/params_shard_68.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c5fd8af163ab42091fb6f40872162937fb610fadad98c5fe77f516908e7134e3
+size 29360128
diff --git a/params_shard_69.bin b/params_shard_69.bin
new file mode 100644
index 0000000000000000000000000000000000000000..af42758d851b2ba3682b5541c5a4cc92cde0431b
--- /dev/null
+++ b/params_shard_69.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:218cf70fd4479df74b664abb7c8590640069ffa1597311b7bd16b936a8af0244
+size 30949376
diff --git a/params_shard_7.bin b/params_shard_7.bin
new file mode 100644
index 0000000000000000000000000000000000000000..844166e7e2fd6960fc7787d41207c415c106d170
--- /dev/null
+++ b/params_shard_7.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3b9875616ce894e0b7a6b6b6506197bad30d66b8cfa17b6f6350b5f1fac15449
+size 29360128
diff --git a/params_shard_70.bin b/params_shard_70.bin
new file mode 100644
index 0000000000000000000000000000000000000000..9e75598ee9117fa9d78f3ca00cc46bb6c9e95514
--- /dev/null
+++ b/params_shard_70.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:72bb5a2aadc8ff2bf85e065ce6e3c41ce8c18ee4eb22e40aff94d6fee96db44e
+size 58720256
diff --git a/params_shard_71.bin b/params_shard_71.bin
new file mode 100644
index 0000000000000000000000000000000000000000..547ff4041e372d5c93e8e5e375e0142bcf3f0ba9
--- /dev/null
+++ b/params_shard_71.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:33151823518aeb34a8f6056ef3c1429238e5066bb5ecb6d8d62b29d7318bc0f3
+size 25174016
diff --git a/params_shard_72.bin b/params_shard_72.bin
new file mode 100644
index 0000000000000000000000000000000000000000..76530810f6da9ca938f0c385fdf0b9013a0055d1
--- /dev/null
+++ b/params_shard_72.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:cb0117433153467f8bcb988ab4a3fa33fc9e392fb8252056798cbf3870912841
+size 29360128
diff --git a/params_shard_73.bin b/params_shard_73.bin
new file mode 100644
index 0000000000000000000000000000000000000000..ca834b9d836fc034cb005ce6056d4b3b57bfcfa8
--- /dev/null
+++ b/params_shard_73.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9933be9c65130af3b00e744d31c1834d9a77acee36bcf75ebb603e69183e31a9
+size 58720256
diff --git a/params_shard_74.bin b/params_shard_74.bin
new file mode 100644
index 0000000000000000000000000000000000000000..025c636dc171205d236a7083dc983fe44e4e3b52
--- /dev/null
+++ b/params_shard_74.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:110e83e17c498be4316b61255f9500b7fd7e87b31fc16161fef3990ca6277703
+size 33046528
diff --git a/params_shard_75.bin b/params_shard_75.bin
new file mode 100644
index 0000000000000000000000000000000000000000..b8376d885ef67a08dd03b3dba69f0d3760916231
--- /dev/null
+++ b/params_shard_75.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:85b2722f8d565e7796bd71add4c2064d307dd4807b23db99e636a15ce0829fee
+size 29360128
diff --git a/params_shard_76.bin b/params_shard_76.bin
new file mode 100644
index 0000000000000000000000000000000000000000..be2fe3e8c478aa7c2e12cb4efe6e4fc079edf5f3
--- /dev/null
+++ b/params_shard_76.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2c18c153f6e5b0faa1254e90e3177aa45e75c48e4e0597d5516c1f408172cad7
+size 58720256
diff --git a/params_shard_77.bin b/params_shard_77.bin
new file mode 100644
index 0000000000000000000000000000000000000000..94e08a12bb7310c8e08f2a893c8379bf26cb9237
--- /dev/null
+++ b/params_shard_77.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:fb074d0ee3c6046484c1c902a09c98c77d545140877c47cea990b8bec15bbbad
+size 22036480
diff --git a/params_shard_78.bin b/params_shard_78.bin
new file mode 100644
index 0000000000000000000000000000000000000000..564d57a32e9ceef70e838640d0a1e6330db2bf4f
--- /dev/null
+++ b/params_shard_78.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:fd7b90b5b7b41aca8db21f75d72c9684a68daa9eff9f067c2e3f0e0045f382a1
+size 29360128
diff --git a/params_shard_79.bin b/params_shard_79.bin
new file mode 100644
index 0000000000000000000000000000000000000000..f25431d15da8d4154e7cef8bd7645713148d2c03
--- /dev/null
+++ b/params_shard_79.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4bbbfa3e66f7bc63bcd59b6dd444e40b64f55adfab8432e36440e3bb5a84850f
+size 58720256
diff --git a/params_shard_8.bin b/params_shard_8.bin
new file mode 100644
index 0000000000000000000000000000000000000000..859566ef3940708cab8e08d13b511474408de8c1
--- /dev/null
+++ b/params_shard_8.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5dd5e367c553dbde94e22e86dcb9edcdd6624c089bfe4ae105869a05194bb232
+size 58720256
diff --git a/params_shard_80.bin b/params_shard_80.bin
new file mode 100644
index 0000000000000000000000000000000000000000..9252469c78122f912a6425f63fa5d598143db9ac
--- /dev/null
+++ b/params_shard_80.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:38a753f8c8608e5fb7f4436c5f30f3455e0525013e6917a21547d4cf633e6670
+size 27271168
diff --git a/params_shard_81.bin b/params_shard_81.bin
new file mode 100644
index 0000000000000000000000000000000000000000..5da936c04e4c82c10e88c72d659d16d0b579e76c
--- /dev/null
+++ b/params_shard_81.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0df15bd9ccc9f7131e5d0fc45d65d55cf241c752038e185a8ad91a7fb1ff5fa2
+size 29360128
diff --git a/params_shard_82.bin b/params_shard_82.bin
new file mode 100644
index 0000000000000000000000000000000000000000..681b366daeedc32ce57bcb5ccd99e561b4d5e74e
--- /dev/null
+++ b/params_shard_82.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1aa29fcb0571cf39c58e4e4e957d95484bea26b0173d5b03caf79a72cdbc08d1
+size 30949376
diff --git a/params_shard_83.bin b/params_shard_83.bin
new file mode 100644
index 0000000000000000000000000000000000000000..acdec14fdd4635bfbf6ad9b94bf16edc02f6ccff
--- /dev/null
+++ b/params_shard_83.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e98874d419f9638d89a3570dd38bf616a46975e17df93b2ee94981e6c432f7e8
+size 58720256
diff --git a/params_shard_84.bin b/params_shard_84.bin
new file mode 100644
index 0000000000000000000000000000000000000000..0b0ecf69cadb06bdd80b05b4e414a5a10fbc6d6f
--- /dev/null
+++ b/params_shard_84.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b4ccdc3f64f67904550bacbe4215fc7112ad935e00d0b24452fee1d5ccef5fc9
+size 25174016
diff --git a/params_shard_85.bin b/params_shard_85.bin
new file mode 100644
index 0000000000000000000000000000000000000000..2297a8cd74fefa613c53a8bb3f126a967fc351ed
--- /dev/null
+++ b/params_shard_85.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:dfa2c597df1eb4a138ef5f662d57759897a1b367285abd449bc6fcc115f265c6
+size 29360128
diff --git a/params_shard_86.bin b/params_shard_86.bin
new file mode 100644
index 0000000000000000000000000000000000000000..2e330ae0eb28d5c577917ce36de246a138b0f87b
--- /dev/null
+++ b/params_shard_86.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:435b7f59a5e6d30b7711e76ca105c6d92135c48fdcc0ff4abf15a6ae7f113df5
+size 58720256
diff --git a/params_shard_87.bin b/params_shard_87.bin
new file mode 100644
index 0000000000000000000000000000000000000000..6b78774aff37b89c46f68819ff8f657e36d80b2e
--- /dev/null
+++ b/params_shard_87.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:485d93536674168016f2fec1751757268db996cdef256ef066786e93b63ffa92
+size 33046528
diff --git a/params_shard_88.bin b/params_shard_88.bin
new file mode 100644
index 0000000000000000000000000000000000000000..7e13ed1e4ceeecb60b54bff1a45e0ec7cb0e197c
--- /dev/null
+++ b/params_shard_88.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:de754059ae7cfc1c093b10eb63509d29a614a293dff44d50f369ee40d4ddf47d
+size 29360128
diff --git a/params_shard_89.bin b/params_shard_89.bin
new file mode 100644
index 0000000000000000000000000000000000000000..a259179dadf02daf341e144d59607339abec420a
--- /dev/null
+++ b/params_shard_89.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:32f2381b721de411d17ca6c3af1468d8fff78e727b984ef987c89290b5a882ba
+size 58720256
diff --git a/params_shard_9.bin b/params_shard_9.bin
new file mode 100644
index 0000000000000000000000000000000000000000..da7fea1f6c14083703a16f77755adc4286a0afa2
--- /dev/null
+++ b/params_shard_9.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5e6b2b79b0495e4cc70321f191e32d0eb63278f337c23c5da5e3fd3c9d731db5
+size 33046528
diff --git a/params_shard_90.bin b/params_shard_90.bin
new file mode 100644
index 0000000000000000000000000000000000000000..e2708fffa05dbb4d9f7cc43a3f3b6d46dcdb92dd
--- /dev/null
+++ b/params_shard_90.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:74fddcae7ca3ec8d2938121b1ae6d72a810bdec7374263be81dd95f1ffebfac3
+size 22036480
diff --git a/params_shard_91.bin b/params_shard_91.bin
new file mode 100644
index 0000000000000000000000000000000000000000..d09dcb185e0c00f14cb57f1f70b10f8916fbb75d
--- /dev/null
+++ b/params_shard_91.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2cd3ec20fc50a88540b550663e74a95d84a1b3f36ed3b8c0c92801e87f9ee8c6
+size 29360128
diff --git a/params_shard_92.bin b/params_shard_92.bin
new file mode 100644
index 0000000000000000000000000000000000000000..6c33ad06b99a06eb40b3ea093ae7d0f0b5cc9b13
--- /dev/null
+++ b/params_shard_92.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9718a2bd3090119ff6e377ebf9a8c0c908f92181b2538389b7c950f626569c60
+size 58720256
diff --git a/params_shard_93.bin b/params_shard_93.bin
new file mode 100644
index 0000000000000000000000000000000000000000..a01147b2cfb741fefb56198123d5b9ff7f76e3e4
--- /dev/null
+++ b/params_shard_93.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:59abcf35f61a8035958c55a1a848a50236d9a3bf45ee0dc17e2a5ba2b87a6a2a
+size 27271168
diff --git a/params_shard_94.bin b/params_shard_94.bin
new file mode 100644
index 0000000000000000000000000000000000000000..6cdb1401c6a15362ae299ea76e013eff2856139b
--- /dev/null
+++ b/params_shard_94.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a0ebf10f8bb48af1127c834fb37258024dfcb8c6fdf250349514ce761d6636f7
+size 29360128
diff --git a/params_shard_95.bin b/params_shard_95.bin
new file mode 100644
index 0000000000000000000000000000000000000000..c4c3932f2e685165a9902612af81d82d9899df8a
--- /dev/null
+++ b/params_shard_95.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f97009a90441d98a4cf175e4ea356678ec41d8d44bbc9682495b0219133238d8
+size 30949376
diff --git a/params_shard_96.bin b/params_shard_96.bin
new file mode 100644
index 0000000000000000000000000000000000000000..6857c4ad13a1e4a2126475363857f4488c8e4bd4
--- /dev/null
+++ b/params_shard_96.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8fe83c48f699a505733972bd5fd16ab71e3c09a7264bf076f0cf1e1b8749cc96
+size 58720256
diff --git a/params_shard_97.bin b/params_shard_97.bin
new file mode 100644
index 0000000000000000000000000000000000000000..fac5f765c901b1f264dcc55f2b3fbc3153523e9a
--- /dev/null
+++ b/params_shard_97.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3225400a3d1c620fa6807e46f285fc8346624a1ac3afb090067421942decffad
+size 25174016
diff --git a/params_shard_98.bin b/params_shard_98.bin
new file mode 100644
index 0000000000000000000000000000000000000000..e6f34afa57557c663d2496d55a1e88f4da870c29
--- /dev/null
+++ b/params_shard_98.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f6030495877432c86fd2e4f9f1fc28d5fd4b24a020b9162479f87ed0dbee6d11
+size 29360128
diff --git a/params_shard_99.bin b/params_shard_99.bin
new file mode 100644
index 0000000000000000000000000000000000000000..25851afd56af18c5a62c83c7c392c707b0c25058
--- /dev/null
+++ b/params_shard_99.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5b6d93642e585a6b1de8625bcbbc8876b0a286da5f1e9088879d98bd8dffb501
+size 58720256
diff --git a/tokenizer.json b/tokenizer.json
new file mode 100644
index 0000000000000000000000000000000000000000..66cd9d7e0daec95eb10d16a63c615637dbbb7304
--- /dev/null
+++ b/tokenizer.json
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:79e3e522635f3171300913bb421464a87de6222182a0570b9b2ccba2a964b2b4
+size 9085657
diff --git a/tokenizer_config.json b/tokenizer_config.json
new file mode 100644
index 0000000000000000000000000000000000000000..51bfa97a070fa334eb2a747fdfc80e823ea9fc8b
--- /dev/null
+++ b/tokenizer_config.json
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:24e8a6dc2547164b7002e3125f10b415105644fcf02bf9ad8b674c87b1eaaed6
+size 50870