Local AI guides

Where to start

Start with how much memory a model needs, then check that your GPU is supported, then read the Ollama settings page. The quantization page explains the file names you will meet.

This is an independent guide. It is not connected with Ollama, the llama.cpp project or any company named here. This field changes quickly: statements about Ollama and llama.cpp were read on 14 November 2026 from the pages named under Sources. The memory numbers are estimates from arithmetic. We did not run any model for these pages.