The AQLM Quantization Algorithm, Explained | Towards Data Science

In this blog post, we cover the AQLM quantization algorithm which sets a new state-of-the-art for compressing LLMs down to 2 bits!

By · · 1 min read
The AQLM Quantization Algorithm, Explained | Towards Data Science

Source: Towards Data Science

In this blog post, we cover the AQLM quantization algorithm which sets a new state-of-the-art for compressing LLMs down to 2 bits!