Llama.cpp
Efficient inference engine for C and C++ language models.
Free
Efficient Model Execution Tools
Tools in Efficient Model Execution Tools
GGML
Efficient tensor library for machine learning on everyday devices.