GitHub - turboderp/exllamav2: A fast inference library for running LLMs locally on modern consumer-class GPUs
github.com
A fast inference library for running LLMs locally on modern consumer-class GPUs - GitHub - turboderp/exllamav2: A fast inference library for running LLMs locally on modern consumer-class GPUs