David Nowak.
Home/Tools/Ollama
Tool review

Ollama

Earned listing · No vendor relationship
Reviewed Sep 2026 · Every claim sourced · Category: marketing content & design
Straight verdict: use it if you want a capable AI that never sends a byte anywhere — it's the easiest way to run real models on your own machine, free forever. Know the two catches: your hardware decides your model, and the installer's defaults assume you'll do the security work (patch and never expose it to the internet).
Data

Where does your data go?

Nowhere — that's the entire product. But the honest answer has three layers:

  • Locally: nothing leaves your machine. Ollama runs open-weight models on your own hardware. No account, no login, no telemetry requirement. What you type stays in RAM and your disk.
  • Cloud tier (optional, separate): Ollama sells cloud-hosted inference — hosted in the US and Europe (Singapore for some models), with a published zero data retention commitment: no prompt logging, no training on your data, per-request cost visible in your account.
  • The catch nobody advertises: defaults are insecure. The local API has no authentication, and the documented OLLAMA_HOST=0.0.0.0 setup — widely used in practice — exposes it to the network. Security researchers counted ~300,000 Ollama servers publicly reachable on the internet.
Translate it: your data genuinely never leaves the machine — but that guarantee is only as good as the firewall around it. The tool trusts you to lock the door.
Reliability

What happens when it's wrong?

A local model's failure mode is the model, not the vendor — and open models are measurably weaker than the closed flagships:

  • Quality is hardware-capped. A 7–8B model (fits 16GB RAM/6GB VRAM) is genuinely useful for drafting and summarizing but nowhere near ChatGPT or Claude flagship level on reasoning. A 70B model rivals them — and needs 64GB RAM or 48GB+ VRAM. Pick the biggest model your machine fits, and expect a gap.
  • Documented security failures — the section every local-first pitch skips. CVE-2026-7482 ("Bleeding Llama," CVSS 9.1, patched Feb 2026): an unauthenticated attacker could leak other users' conversation history, system prompts, and environment variables — API keys included — from any reachable Ollama server in three API calls.
  • Worse for Windows users: the updater is still unpatched. CVE-2026-42248/42249 (disclosed by CERT Polska after 90 days of maintainer silence): the Windows auto-updater doesn't verify update signatures and writes installers from HTTP headers — a chain that drops a persistent executable on every login.
  • What the failure teaches: the tool's security posture depends on patch discipline and network hygiene that a small-business owner may not have.
Practical rule: run it locally, patch it immediately, never port-forward it, and keep it off shared machines. On Windows, disable auto-update until the updater CVEs are fixed. See the glossary for every term these reviews use.
Limits

What's it actually bad at?

  • The app has closed much of the gap, but depth still needs the ecosystem. The desktop app now offers chat with file drag-and-drop and even connects Claude Desktop to your local models; Open WebUI remains the answer for advanced workflows. Setup is easy; going deep is homework.
  • Hardware is the real price. 16GB RAM for a useful model, 64GB for a flagship-class one, an SSD strongly recommended. The software is free; the machine that runs it well is not.
  • Model quality varies wildly — open models span from excellent to toy, and there's no vetting layer between "downloads on ollama.com" and "worth trusting."
  • Windows auto-update is currently unsafe — the one platform where the default install needs manual intervention.
  • The maintainer-response record is mixed: CERT Polska reported the Windows flaws in January 2026; 90 days passed with no engagement before they published. Open-source speed cuts both ways.
Cost

What does it cost really?

Local
$0

Free forever, no account, no usage meter, MIT-licensed. The real cost is hardware: 16GB RAM for a useful model, 64GB for flagship-class, an SSD strongly recommended.

Cloud Pro
$20/mo

$60 of monthly usage credits at published per-token rates, zero data retention, hosted US/Europe. Optional and separate — local use never touches this page.

Max / Team
$100 / $500

Max: $300 credits, 10 concurrent requests. Team: $1,000 shared credits, unlimited users. Per-token model pricing (e.g., deepseek-v4-flash at $0.22 in / $0.66 out per million tokens).

The traps: the pricing page now sells cloud first — easy to mistake Ollama for a paid product when local is the headline. Cloud concurrency is limited (1 free / 3 Pro / 10 Max), and peak pricing applies to cloud models at midday UTC. The "Free" cloud tier is a trial of starter models, not the local product.

Impact

What does it replace — and what do you still do?

It replaces the subscription relationship: a capable model that answers to nobody's server, no usage anxiety, no policy changes, works offline. For regulated data — customer records, patient info, legal documents — it's the only approach where the data-handling answer is "it never leaves the building." You still own: hardware maintenance, model selection, updating the software, and the network security the defaults don't provide.

Platform

What the ecosystem offers

  • The desktop app closed the gap: a proper chat interface with file drag-and-drop (text, PDFs, images), a setup walkthrough for first launch, and faster responses — model loading got roughly twice as quick in a recent release.
  • Claude Desktop can use it: Anthropic's desktop app now connects to Ollama as a gateway, meaning you can use your own local models inside Claude's interface — local and hosted tools, working together.
  • Agent launchers: ollama launch runs coding agents and DeepSeek's agent harness against your local models; the OpenAI-compatible API gained web search; Mac performance improved through a new Apple-chip engine.
  • Release cadence: three updates in the review week — fixes landing fast, which is the open-source trade: quick patches, but you're the one applying them.
  • Still standing: the Windows updater security flaws remain unpatched as of this re-review.
Exit

If I stop paying, what do I lose?

  • Nothing — there's nothing to cancel. Local Ollama has no subscription, no account, no server-side state. Delete the app and the models; your data was always on your machine.
  • The cloud tier exits cleanly: cancel and keep using local; zero data retention means there's no history to lose either way.
  • The lock-in reality is model formats, not the vendor: models run anywhere llama.cpp-derived runtimes run — switching to alternatives (LM Studio, vLLM) is friction, not loss. The MIT license and open weights mean no exit cliff exists.
Fit

Who is this NOT for?

Anyone who won't maintain software — unpatched Ollama is a data leak, and the Windows updater is currently unsafe. Businesses without decent hardware — a model that fits in 8GB RAM is a demo, not an assistant. And anyone who expected "local" to mean "zero homework": the security defaults are the homework.

David's take — Ollama is the tool that makes the local-first argument real, and the only AI tool where the data-handling answer is "nowhere." Free forever, open source, no account, models that never phone home — for regulated data this is the honest recommendation, and the cloud tier's zero-retention terms are unusually clean for a vendor. The caveats are the ones the local-AI movement doesn't like saying out loud: a critical memory-leak CVE that exposed other users' conversations to unauthenticated attackers, Windows updater flaws still unpatched after 90 days of silence, ~300,000 exposed servers because the defaults trust the operator, and model quality that's only as good as the machine underneath. This is the review where "local" stops being a privacy slogan and becomes a maintenance contract. For an owner with decent hardware and patch discipline: the best deal in AI, genuinely. If that description doesn't fit your business, this tool isn't for you — and that's a complete answer, not a shortfall.

Sources — all public, checked Sep 5, 2026
  1. Ollama pricing page — Free/Pro/Max/Team tiers, per-token model pricing, peak pricing, concurrency limits
  2. Ollama: Transparent pricing (Aug 2026) — per-token plans, zero data retention, no service fees, US/Europe/Singapore hosting
  3. Ollama homepage — local/cloud/private/open positioning, "never trained on" claim
  4. Ollama on GitHub — MIT license, REST API, Docker image, open weights
  5. SpecPicks: Ollama installation guide 2026 — hardware requirements table (RAM/VRAM/disk by model size), Apple Silicon, platform support
  6. maketocreate: Ollama in 2026 — local-free-forever confirmation, memory footprints, troubleshooting
  7. NVD: CVE-2026-7482 — GGUF heap out-of-bounds read (CVSS 9.1), patched in 0.17.1 (Feb 2026)
  8. Cyera: Bleeding Llama (May 2026) — ~300,000 exposed instances, exposed data classes, remediation
  9. Cloud Security Alliance: research note (May 2026) — exposure growth, enterprise security guidance
  10. NVD: CVE-2026-42249 — Windows updater path traversal + missing signature check, persistent RCE, unpatched
  11. Help Net Security: updater flaws (May 2026) — CERT Polska timeline, Striga findings, disable-auto-update guidance
  12. Ollama GitHub releases — v0.33.x cadence: Claude Desktop gateway, agent harness launchers, MLX engine, TTFT caching
  13. Ollama blog: the new app — chat interface, drag-and-drop, multimodal engine

I'm David. I build AI that keeps your data yours.

David Nowak

Twenty years building software for businesses like yours — cloud tools when they fit, your own machines when the data demands it. Fixed fee starting at $500.

Book a session

Bring one real problem. You leave with a plan — whether we work together or not.

"Most companies are selling you fear and complexity. He cuts through the bullshit and just fixes things. That's what partnership looks like."
Jim · Owner, media production company · more testimonials