Will DePue

Train the smallest LM you can that fits in 16MB. Best model wins!

Run GPT model on the browser with WebGPU. An implementation of GPT inference in less than ~1500 lines of vanilla Javascript.

A tiny nearest-neighbor embedding database built with SQLite and Pytorch. (In development!)