Quantization

So you bought a Mac mini and want to run local AI. How far can you actually go? Most modern LLaMAstyle LLMs are trained…