From Muon to Gradient Clipping: Some Thoughts on QK Stability

(mastergodzilla.github.io)

28 points | by Eridanus2 8 days ago ago

No comments yet.