Search results

Gefen optimizer: same convergence as AdamW with 8x lower memory footprint, enabling larger models or higher batch sizes with increased throughput

Status: Open.

#545 In jettify/pytorch-optimizer;

· ndvbd opened on Jun 18, 2026

ScalingOpt | Welcome to join the Optimization Community!

Status: Open.

#544 In jettify/pytorch-optimizer;

· tianshijing opened on Dec 3, 2025

Muon

Status: Open.

#543 In jettify/pytorch-optimizer;

· jason718 opened on Aug 22, 2025

AttributeError: module 'torch_optimizer' has no attribute 'Lion'

Status: Open.

#542 In jettify/pytorch-optimizer;

· SamMohel opened on Dec 10, 2024

How to stop memory leak while using adahessian?

Status: Open.

#540 In jettify/pytorch-optimizer;

· Shubh-Goyal-07 opened on Aug 8, 2024

[Feature Request] Aida optimizer

Status: Open.

#538 In jettify/pytorch-optimizer;

· okbalefthanded opened on Feb 15, 2024

AttributeError: module 'torch_optimizer' has no attribute 'MAGRAD'

Status: Open.

#537 In jettify/pytorch-optimizer;

· SamMohel opened on Dec 18, 2023

Configurable step size instead of hard-coded default values for adafactor

Status: Open.

#535 In jettify/pytorch-optimizer;

· lamthuy opened on Sep 23, 2023

Implementation of Shampoo inconsistent with the paper

Status: Open.

#502 In jettify/pytorch-optimizer;

· siddharth9820 opened on May 29, 2023

Include the Sophia Optimizer

Status: Open.

#501 In jettify/pytorch-optimizer;

· bratao opened on May 24, 2023

adahessian bug: it does not support the 3D conv

Status: Open.

#500 In jettify/pytorch-optimizer;

· ziming-liu opened on May 17, 2023

Include AdaNorm optimizer (WACV 2023)

Status: Open.

#499 In jettify/pytorch-optimizer;

· shivram1987 opened on Mar 18, 2023