blog reading: Muon

Paper List

https://thinkingmachines.ai/blog/modular-manifolds/

EDM2: https://github.com/NVlabs/edm2

https://arxiv.org/pdf/2312.02696

https://arxiv.org/pdf/2406.02507

http://arxiv.org/abs/2102.07227

Notes

Stiefel manifold

1. $A \in R^{n \times k}, A^T A = I_k$.

2. $dim(V_k(R^n)) = nk - \frac{1}{2} k(k+1)$.

https://en.wikipedia.org/wiki/Stiefel_manifold