Fast Model Processing Tools

Exllama

Memory-efficient model for AI applications with quantized weights.