TatuEngine
05 de jul. de 2026
TatuEngine SFT — Adafactor and the 4 NaN fixes
The saga of making Student BitMamba-1B learn without exploding: Adafactor vs AdamW, saving 4 GB of VRAM, and the 4 bugs that produced NaN during bf16 training.
Continuar lendo →