Thanks for this
#3
by Jon-Nielsen - opened
Your carefully tuned quants for this specific setup are appreciated.
And it's exciting that all this came together with tabbyAPI and reasoning and tool calling support. Fingers crossed for tensor parallelism becoming possible :-)