trixyL
/

transformerlm-ar-8k-simplestories

Text Generation

Model card Files Files and versions

transformerlm-ar-8k-simplestories / special_tokens_simplestories_8k.json

trixyL's picture

add: tokenizer config

7af4291 verified 6 months ago

History Blame Contribute Delete

27 Bytes

	{
	"<\|endoftext\|>": 7999
	}