Skip to content

Glm45 accuracy alignment - #1

Open
zhanghonggeng wants to merge 3 commits into
mainfrom
glm45-accuracy-alignment
Open

Glm45 accuracy alignment#1
zhanghonggeng wants to merge 3 commits into
mainfrom
glm45-accuracy-alignment

Conversation

@zhanghonggeng

Copy link
Copy Markdown

Adds bit-exact numerical alignment patches between Megatron-LM and PaddleFleet for the GLM-4.5 MoE model, gated by USE_ACCURACY_COMPATIBLE=1 environment variable.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant