Tools To Enable Experimentation

Exllama

Memory-efficient model for AI applications with quantized weights.