Fast Model Execution Tools

Exllama

Memory-efficient model for AI applications with quantized weights.

Megatron LM

Advanced framework for training large transformer models efficiently.