Large Model Management Tools

Exllama

Memory-efficient model for AI applications with quantized weights.