nan

2 posts

Jul 05, 2026

TatuEngine SFT — Adafactor and the 4 NaN fixes

The saga of making Student BitMamba-1B learn without exploding: Adafactor vs AdamW, saving 4 GB of VRAM, and the 4 bugs that produced NaN during bf16 training.

tatuengine sft adafactor

Continue reading →

TatuEngine

Jul 05, 2026

SFT do TatuEngine — Adafactor e os 4 fixes do NaN

A saga de fazer o Student BitMamba-1B aprender sem explodir: Adafactor vs AdamW, a economia de 4 GB de VRAM, e os 4 bugs que produziam NaN no treinamento em bf16.

tatuengine sft adafactor

Continue reading →

Browse by tags

TatuEngine SFT — Adafactor and the 4 NaN fixes

SFT do TatuEngine — Adafactor e os 4 fixes do NaN