Fix Slowness and Stuck Issues with Long Inputs
#8
by NA-Wen - opened
The issue arises when the model is provided with long input sequences (~ 64k string length), which can lead to significant performance degradation. Specifically, the system may experience slower processing times or, in some cases, may even freeze or get stuck entirely.