Steps to convert to GGUF?

#1
by eaddario - opened

Hi Lucebox team, pretty cool stuff you guys are doing with Dflash and PFlash!

Any chance you could share steps to create XS.2 GGUFs? or better, open a PR in llama.cpp with the changes, even if it's in draft format? I'd gladly work on it to complete.

I'm at the very early stages of trying to add it, and working my way through all the issues (currently stuck at Unrecognized keys in rope_parameters for 'rope_type'='default': {'original_max_position_embeddings'}) but since you've already done it, though to add.

Either way, wish you all the success in your project!

Sign up or log in to comment