Anyone running this on 2ΓH200 with vLLM? Hangs after "Fp8 MoE backend"
1
#23 opened 2 months ago
by
Maclow
[Feature request] Eliminate pre-attention RMSNorm in Mistral-Small 4 via scale invariance + weight folding
#20 opened 4 months ago
by
graefics
Create Dockerfile
π€π₯ 1
#18 opened 5 months ago
by
sa6273473
When using in vibe or opencode, often responds with just "Task completed" instead of actually doing the task
π 1
3
#16 opened 5 months ago
by
sdroege
Love the license, confused by some of the decisions.
π€π 17
15
#15 opened 5 months ago
by
CyborgPaloma
Wrong context length in context?
1
#14 opened 5 months ago
by
wimmmm
Small?
ππ€ 16
6
#12 opened 5 months ago
by
Carnyzzle
Please state benchmark versions
π 2
2
#11 opened 5 months ago
by
harveensingh-sarvam
please make a 15B and 40B creative writting model. β€οΈβ€οΈ
1
#6 opened 5 months ago
by
UniversalLove333
"Small" model is now 120B and beyond the reach of most people, even in the upper-middle class with multiple consumer GPUs
β€οΈπ 15
68
#5 opened 5 months ago
by
Fizzarolli
Recommended sampler?
4
#4 opened 5 months ago
by
mratsim
Video of Step-by-Step Review and Testing
#3 opened 5 months ago
by
fahdmirzac
Add evaluation results
#2 opened 5 months ago
by
nielsr
French Hegemonia
π€ 2
1
#1 opened 5 months ago
by
ox-ox