Hackable and optimized Transformers building blocks, supporting a composable construction.
PyTorch extensions for high performance and large scale training.
Open on GitHub