Minimalistic large language model 3D-parallelism training
Minimalistic 4D-parallelism distributed training framework for education purpose
Open on GitHub