Short answer

Yes. Pick a model whose download is a few GB smaller than your memory. On 8 GB, these fit (Ollama download sizes):

  • Llama 3.2 3B: 2.0 GB
  • Qwen 3.5 4B: 3.3 GB
  • Gemma 4 E2B: 4.6 GB (tighter)

They're good for quick questions, summaries and simple writing.

What to expect

  • Simpler answers than big cloud chatbots, and slower replies on modest hardware.
  • Close other heavy apps (browsers with lots of tabs) to leave memory spare.
  • Long documents need extra memory, so keep inputs short.

Which app?

  • Mac (M1 or newer): LM Studio says 8 GB Macs work with smaller models (it recommends 16 GB+). Ollama works too.
  • Windows: LM Studio recommends 16 GB, so on 8 GB use the smallest models; Ollama is also an option.
  • GPT4All says 8 GB is enough for 3B models.

What we actually ran: Qwen 3.5 0.8B with Ollama on a CPU-only Linux server. We haven't tested the 3–4B models on an 8 GB laptop ourselves.

Check your exact computer →

Next: Full local AI guide · Ollama vs LM Studio

Sources

Prices and plans change often. Always confirm on the official site before you buy.