Skip to main content

GPTQ, AWQ & GGUF — Quantization Formats

Layer: Model optimization Status: 🔴 Not started

What it is​

How it works​

Why it matters​

Key terms​

TermMeaning

Code / demo​

My notes​

Fill in from research and experimentation.

Resources​