Trainers, optimizers, recipes, debugging large runs.
Most training frameworks are 50,000 lines of code in a trench coat. This is what falls out when you start from FSDP and a will to delete.