Llama.cpp
Efficient inference engine for C and C++ language models.
Free
Model Performance Enhancement Tools
Tools in Model Performance Enhancement Tools
Vllm
Efficient engine for serving large language models with speed.
Albumentations
Image augmentation library for enhancing datasets in deep learning.
Subscription
from $10/m