---
base_model: FacebookAI/xlm-mlm-100-1280
language:
- crk
license: cc-by-4.0
pipeline_tag: fill-mask
tags:
- translation-language-modeling
- plains-cree
- low-resource
---

# xlm-mlm-plains-cree-en-tlm

FacebookAI/xlm-mlm-100-1280 fine-tuned with the Translation Language Modeling (TLM) objective on a Plains Cree–English parallel corpus.

## Training

Fine-tuned using the TLM objective introduced in [Lample & Conneau (2019)](https://arxiv.org/abs/1901.07291).
Cree–English sentence pairs are concatenated and masked jointly, encouraging the model to use cross-lingual context when predicting masked tokens.

**Training data:** Bloomfield (1934) Plains Cree texts (scraped and sentence-aligned) + EdTeKLA parallel corpus (~9,000 sentence pairs total)
**Epochs:** 15 | **Batch size:** 16 | **Max length:** 256
**Hardware:** 1× NVIDIA A100 40 GB

## Intended use

This checkpoint serves as the student encoder foundation for Cross-Lingual Knowledge Distillation (CLKD) of figurative language classifiers into Plains Cree.


## Citation

If you use this model, please cite the associated thesis/paper (TBD).


## Data

Training data includes:
- [Bloomfield (1934) *Plains Cree Texts*](https://bloomfield.kiyanaw.net) (scraped and sentence-aligned)
- [EdTeKLA Indigenous Languages Corpora](https://github.com/EdTeKLA/IndigenousLanguages_Corpora)