AXERA-TECH
/

HY-MT1.5-1.8B_GPTQ_INT4-AX620E

HY-MT1.5-1.8B_GPTQ_INT4

Model card Files Files and versions

HY-MT1.5-1.8B_GPTQ_INT4-AX620E / config.json

yongqiang

Update axllm binary and token config

3f3c4b6 about 1 month ago

History Blame Contribute Delete

718 Bytes

	{
	"model_name": "AXERA-TECH/HY-MT1.5-1.8B_GPTQ_INT4-AX620E",
	"url_tokenizer_model": "hymt1-5-1.8b_tokenizer.txt",
	"tokenizer_type": "HunYuan",
	"post_config_path": "post_config.json",
	"template_filename_axmodel": "hymt1-5_1k_ax620e_axmodel/hunyuan_v1_dense_p128_l%d_together.axmodel",
	"filename_post_axmodel": "hymt1-5_1k_ax620e_axmodel/hunyuan_v1_dense_post.axmodel",
	"filename_tokens_embed": "hymt1-5_1k_ax620e_axmodel/model.embed_tokens.weight.bfloat16.bin",
	"axmodel_num": 32,
	"tokens_embed_num": 120818,
	"tokens_embed_size": 2048,
	"bos": false,
	"eos": false,
	"use_mmap_load_embed": true,
	"use_mmap_load_layer": false,
	"server_timeout_ms": 300000,
	"server_max_output_tokens": 1024
	}