fusion-llm-demo / models

Commit History

v2.2.0: end-to-end pipeline validation + GRPO no-tokenizer fallback
a1d6a7c

zhan1206 commited on

v2.1.0: fix N25 off-by-one, S2 reward_fn string safety
b0bc454

zhan1206 commited on

v20: fix N23/N24/M7/S2 - critical regression fixes from v1.9.0 audit
376d8d7

zhan1206 commited on

v19: fix N23-N25 + S1 reward functions + F1/F2/F3 documentation
3e586fd

zhan1206 commited on

v18: fix N18/N19/N20/N21/N22 Thinking Dial pipeline bugs
47aafb2

zhan1206 commited on

v17: fix Thinking Dial training pipeline (N10/N11/N12/N13/N14/N15/N16/N17)
2e32205

zhan1206 commited on

v16-hotfix: fix kv_head_dim bug, add incremental gen test
488ee46

zhan1206 commited on

v16: fix critical audit defects (N6/N7/N8/N9 + S3/S4/M2/M5)
65bdd96

zhan1206 commited on

v15: fix remaining audit issues (F1/F2/S1/M3/M8/doc)
2c578a9

zhan1206 commited on

v14 fix: F1 ThinkingDialModel thinking_embedding/gate 实际使用,F5 top_p NaN guard,M1 RoPE position_ids,M6 position_ids 传递链,DPO tokenizer 属性,forward() position_ids 参数
c1899e9

zhan1206 commited on

fix: 修复 F-NEW-13 GQA双重扩展 + S-NEW-13 GQA KV维度 + LOW清理
b17e601

zhan1206 commited on

fix: 修复 SBLAttention forward_with_qkv() 形状错误和测试文件结构
60f5ce8

zhan1206 commited on

Fix tests: FusionMiniLayer Q/K/V reshape + logging import + pytest compat
83efc18

zhan1206 commited on

fix: external audit issues from commit 08f2cd2
443dc7d

zhan1206 commited on

fix: SBLAttention forward() guard for removed projections
08f2cd2

zhan1206 commited on

fix: v13 external audit - CRITICAL/HIGH/MEDIUM fixes
86985bf

zhan1206 commited on

fix: comprehensive audit fixes - CRITICAL/HIGH/MEDIUM/LOW
a959e9a

zhan1206 commited on

Feat: Add GGML/ONNX deployment and optimized SBLA attention (0.49ms)
cb121a2

zhan1206 commited on

fix(v12): resolve 6 defects from v11 audit (F-NEW-6, S-NEW-5, M-NEW-5/6, MI-NEW-4/5/6)
656dacb

zhan1206 commited on

fix(v11): resolve remaining 5 defects (S-NEW-1/2, M-NEW-2/3, MI-NEW-1)
0dafe0f

zhan1206 commited on

fix(v9): resolve 3 fatal + 1 serious + 1 moderate defects from external audit
336bb73

zhan1206 commited on

fix: v6 audit - all critical/severe/moderate/minor defects
1c801e3

zhan1206 commited on

feat: implement S1 KV Cache + S2 GQA in SBLAttention
93c5166

zhan1206 commited on

fix: F1 mask double-conversion NaN, F2 think token old format, S3 vocab sync, S1/S2 TODO, N1-N5
4cfb0d8

zhan1206 commited on

fix: v5 remove empty tokenizer.json, unify think tokens, integrate tokenizer into training pipeline
bae07a4

zhan1206 commited on

feat: train SentencePiece tokenizer + update README
ff4d952

zhan1206 commited on

chore: replace author real name with GitHub username
17159b7

zhan1206 commited on

fix: v4 comprehensive defect repair (S3/M1/M3/M4/M5/F2/F3)
20a50dc

zhan1206 commited on

feat: M4 attention unification + DPO trainer + inference dashboard
e5984c7

zhan1206 commited on

fix: v3 comprehensive defect repair
3ab86b9

zhan1206 commited on

feat: 重写 DyQuant 量化代码,修复 thinking_dial.py 编码问题
95a02a4

zhan1206 commited on

fix: 修复 S1-S4/M2-M4 缺陷,规范化工程结构
03059b7

zhan1206 commited on

fix: FusionModel forward propagation loss=NaN
fdb1083

zhan1206 commited on

feat: 完成 SBLA 注意力集成 + MVP 训练流程
c77cab5

zhan1206 commited on

feat: 初始化 Fusion 项目 - 六边形开源大模型
22cd791

zhan1206 commited on