Safetensors
English
gpt2
GPT2-85M-BPE-TXT / README.md
codebyzeb's picture
Create README.md
6312baa verified
|
Raw
History Blame
312 Bytes
metadata
datasets:
  - phonemetransformers/IPA-BabyLM
language:
  - en
base_model:
  - openai-community/gpt2

GPT2 trained on the BabyLM 2024 training set using a BPE tokenizer.

Model trained for From Babble to Words: Pre-Training Language Models on Continuous Streams of Phonemes.