samuelcardillo
/

Carnice-Qwen3.6-MoE-35B-A3B

Mixture of Experts

Model card Files Files and versions

Carnice-Qwen3.6-MoE-35B-A3B / fp8 /generation_config.json

samuelcardillo's picture

Add FP8 dynamic quantization variant

034fe92 verified 4 months ago

History Blame Contribute Delete

173 Bytes

	{
	"_from_model_config": true,
	"bos_token_id": 248044,
	"eos_token_id": 248046,
	"pad_token_id": 248055,
	"transformers_version": "5.6.0.dev0",
	"use_cache": false
	}