xlm-v-base-plains-cree-en-tlm

facebook/xlm-v-base fine-tuned with the Translation Language Modeling (TLM) objective on a Plains Cree–English parallel corpus.

Training

Fine-tuned using the TLM objective introduced in Lample & Conneau (2019). Cree–English sentence pairs are concatenated and masked jointly, encouraging the model to use cross-lingual context when predicting masked tokens.

Training data: Bloomfield (1934) Plains Cree texts (scraped and sentence-aligned) + EdTeKLA parallel corpus (~9,000 sentence pairs total) Epochs: 15 | Batch size: 16 | Max length: 128 Hardware: 1× NVIDIA A100 40 GB

Intended use

This checkpoint serves as the student encoder foundation for Cross-Lingual Knowledge Distillation (CLKD) of figurative language classifiers into Plains Cree.

Citation

If you use this model, please cite the associated thesis/paper (TBD).

Data

Training data includes:

• Bloomfield (1934) Plains Cree Texts (scraped and sentence-aligned)
• EdTeKLA Indigenous Languages Corpora