Can make 2 and 3 bit quant?
#2
by Ryu-Sena - opened
Hi can make 2 bit and 3 bit quant, i want compare the result and ability? Thanks
Hi can make 2 bit and 3 bit quant, i want compare the result and ability? Thanks
quality degregation was immense on Q2 and Q3, and claude explained to me that flat quants were the only layering method available for this model because of its custom shape values so i deleted them. i could be wrong but i do believe claude in that regard so Q4 was the cut off