Issues

• ImportError: cannot import name 'MuonWithAuxAdam' from 'muon'

  KellerJordan/Muon#61 · Filter by author shiwanghua opened on Dec 23, 2025
  1

• Supporting QK-Clip (MuonClip) as an additional input

  KellerJordan/Muon#59 · Filter by author axion66 opened on Nov 27, 2025

• Does Muon need clip_grad?

  KellerJordan/Muon#56 · Filter by author OBJECT907 opened on Nov 4, 2025
  1

• optimizer applies weight decay to parameters even when their gradient is None

  KellerJordan/Muon#54 · Filter by author Muinez opened on Nov 1, 2025

• Muon momentum update appears to deviate from the paper; seems to be using a running average

  KellerJordan/Muon#52 · Filter by author RobotSail opened on Sep 24, 2025
  5

• The performernce of Muon optimizer worse than AdamW ?

  KellerJordan/Muon#51 · Filter by author chenzixiong808-max opened on Sep 19, 2025
  2

• Muon for multi-head attention weights

  KellerJordan/Muon#50 · Filter by author schmidt-ai opened on Sep 16, 2025
  1

• Learning rate compared to adamw

  KellerJordan/Muon#49 · Filter by author davnords opened on Sep 1, 2025
  6

• Muon optimizer shows no GPU memory reduction with Accelerator mixed precision (bf16)

  KellerJordan/Muon#48 · Filter by author gitouni opened on Aug 27, 2025

• Does Muon save the state["momentum_buffer"] correctly in a distributed setting?

  KellerJordan/Muon#46 · Filter by author EIFY opened on Aug 21, 2025
  5

• Does Muon support FSDP Zero3

  KellerJordan/Muon#45 · Filter by author lucaswychan opened on Aug 4, 2025
  2

• Request: Add torch.compile Support to Muon Optimizer

  KellerJordan/Muon#40 · Filter by author wertyuilife2 opened on Jul 14, 2025

• pip package seems outdated

  KellerJordan/Muon#39 · Filter by author wendlerc opened on Jul 9, 2025
  1

• Guidelines for whether to use muon for parameters

  KellerJordan/Muon#31 · Filter by author insomniaaac opened on Jun 19, 2025
  1

• Finetuning with Muon

  KellerJordan/Muon#25 · Filter by author dxqb opened on Jun 4, 2025
  4

• How to use with FSDP

  KellerJordan/Muon#23 · Filter by author asahniSC opened on May 12, 2025
  1

• Question about Muon's Different Performance on Dense vs MoE Models

  KellerJordan/Muon#19 · Filter by author mactavish91 opened on Mar 12, 2025

• Use of Muon with Multi Dimensional Parallel training paradigms.

  KellerJordan/Muon#18 · Filter by author 23Uday opened on Mar 1, 2025

• Muon with Llama?

  KellerJordan/Muon#9 · Filter by author yangsp5 opened on Dec 11, 2024
  5