diyclassics Claude Opus 4.8 (1M context) commited on
Commit
e5a1cab
·
1 Parent(s): 24a1bb1

test: bump latincy-preprocess 0.2.0 -> 0.3.2 (recover tokenizer fixes)

Browse files

Isolate whether preprocess 0.3.2 (Rust backend) was the segfault culprit or
a bystander: all other pins held, only preprocess bumped to the version that
carries the tokenizer/U-V/enclitic fixes model v3.9.6 adopted. Watch the run
log — revert to 0.2.0 if it segfaults, keep if stable.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>

Files changed (1) hide show
  1. requirements.txt +6 -1
requirements.txt CHANGED
@@ -26,7 +26,12 @@ spacy-legacy==3.0.12
26
  spacy-loggers==1.0.5
27
 
28
  # --- LatinCy pipeline components (pinned to model-compatible versions). ---
29
- latincy-preprocess==0.2.0
 
 
 
 
 
30
  la-latincy-lookups==1.0.0
31
  latincy-lexicon==0.5.0
32
  latincy-diacritics @ https://huggingface.co/latincy/latincy-diacritics/resolve/main/latincy_diacritics-0.1.0-py3-none-any.whl
 
26
  spacy-loggers==1.0.5
27
 
28
  # --- LatinCy pipeline components (pinned to model-compatible versions). ---
29
+ # preprocess 0.3.2 carries the tokenizer / U-V / enclitic fixes that model
30
+ # v3.9.6 widened its compat range (<0.4.0) to adopt. Testing whether it is
31
+ # stable on HF with the rest of the stack pinned — if it segfaults, the Rust
32
+ # wheel is the culprit and this drops back to 0.2.0; if it holds, we keep the
33
+ # fixes. All other pins held constant so this isolates preprocess.
34
+ latincy-preprocess==0.3.2
35
  la-latincy-lookups==1.0.0
36
  latincy-lexicon==0.5.0
37
  latincy-diacritics @ https://huggingface.co/latincy/latincy-diacritics/resolve/main/latincy_diacritics-0.1.0-py3-none-any.whl