Interesting with the size of the weights

#1
by Jon-Nielsen - opened

Great work on your REAP releases and kudos for not just sticking to one preferred format.

I'm enjoying using your NVFP4 quant of this one right now.

Looking at the size of the weights on this one has me thinking. Given your preference for targeting and squeezing the 4x6000s, could a larger REAP be possible for W4A16?

Cheers

Sign up or log in to comment