The official repo of Pai-Megatron-Patch for LLM & VLM large scale training developed by Alibaba Cloud.
Open on GitHub