ncnn is a high-performance neural network inference framework optimized for the mobile platform
Tengine is a lite, high performance, modular inference engine for embedded device
Open on GitHub