Phil Wang

Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch

Implementation of DALL-E 2, OpenAI's updated text-to-image synthesis neural network, in Pytorch

Implementation of Denoising Diffusion Probabilistic Model in Pytorch

Implementation of Imagen, Google's Text-to-Image Neural Network, in Pytorch

An implementation of model parallel GPT-2 and GPT-3-style models using the mesh-tensorflow library.

Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM

A concise but complete full-attention transformer with a set of promising experimental features from various papers

Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch

Simple command line tool for text to image generation using OpenAI's CLIP and Siren (Implicit neural representation network). Technique was originally created by https://twitter.com/advadnoun

Vector (and Scalar) Quantization, in Pytorch

Simplest working implementation of Stylegan2, state of the art generative adversarial network, in Pytorch. Enabling everyone to experience disentanglement

Implementation of MusicLM, Google's new SOTA model for music generation using attention networks, in Pytorch