1 essay on this topic.
How to run open AI models locally: the memory arithmetic, picking a size for your machine, GGUF and MLX, Ollama, llama.cpp, LM Studio, and Python.
