SCAO — Optimizer

I built a 2nd-order optimizer for LLMs.

2 votes·1 comment·Apr 24, 2026

About

54% faster LLM training. SCAO is a sparse, second-order PyTorch optimizer designed as a high-throughput, drop-in replacement for AdamW. - whispering3/scao