Spaces:

AIencoder
/

THE_CODER_SCHOOL_AI

Sleeping

AIencoder commited on Mar 10

Commit

f8079bf

verified ·

1 Parent(s): 84e3513

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -10,7 +10,7 @@ model_path = hf_hub_download(
 llm = Llama(
     model_path=model_path,
-    n_ctx=32767,
     n_threads=2,
     chat_format="chatml",
     verbose=False

 llm = Llama(
     model_path=model_path,
+    n_ctx=4096,
     n_threads=2,
     chat_format="chatml",
     verbose=False