This PR uploads the process_config.json file allowing to serve the model using vLLM without issues
#8 opened 2 months ago
by
hdnh2006
Recommend to upload process_config.json from original model
1
#7 opened 2 months ago
by
hdnh2006
Additional quants
π₯ 1
#6 opened 3 months ago
by
Theory-of-mind
The benchmark of this version
ππ 4
8
#5 opened 3 months ago
by
whw2026
Changes?
1
#4 opened 3 months ago
by
blankreg
Loosing quality?
2
#1 opened 4 months ago
by
Trilogix1