Pretergeek/OpenChat-3.5-0106_8.11B_36Layers-Interleaved
Text Generation • 8B • Updated • 13 • 2
OpenChat-3.5-0106 with Additional Layers
Upscaled models using the Block Expansion method. Unlike the more common DUP Scaling, BE doesn't require fine-tuning to recover lost performance.
-
-
Pretergeek/OpenChat-3.5-0106_8.99B_40Layers-Interleaved
Text Generation • 9B • Updated • 12 • 2 -
Pretergeek/OpenChat-3.5-0106_10.7B_48Layers-Interleaved
Text Generation • 11B • Updated • 7 • 2 -
Pretergeek/OpenChat-3.5-0106_8.11B_36Layers-Appended
Text Generation • 8B • Updated • 15 • 2 -
Pretergeek/OpenChat-3.5-0106_8.99B_40Layers-Appended
Text Generation • 9B • Updated • 94 • 2 -
Pretergeek/OpenChat-3.5-0106_9.86B_44Layers-Appended
Text Generation • 10B • Updated • 9 • 2 -
Pretergeek/OpenChat-3.5-0106_10.7B_48Layers-Appended
Text Generation • 11B • Updated • 11 • 2