$\mu\mathrm{P}$:前身、原理与后续发展

$\mu\mathrm{P}$ 的初始化与学习率缩放、可复现的 MLP 实验,以及深度、优化器和 MoE 中的扩展。

October 25, 2026 · 19 min · Jiwen Jiang

Muon

I curate some learning materials for CUDA Programming

April 21, 2026 · 1 min · Jiwen Jiang

Mixture of Experts

I curate some learning materials for CUDA Programming

April 1, 2024 · 0 min · Jiwen Jiang

Machine Learning Systems

I summarize some self-learning resources for machine learning systems. Please stay tuned!

March 31, 2024 · 1 min · Jiwen Jiang

Distributed Systems

I summarize some self-learning resources for distributed systems.

March 30, 2024 · 1 min · Jiwen Jiang