Skip to content
howai.

Ollama

“Ollama is the easiest way to run and build with open AI models locally or in the cloud on macOS, Windows, and Linux.”

by Ollama

Free planFree and open sourceProfessionalHeat 79

Our review

Ollama makes it simple to download and run open large language models such as Llama, Gemma and Mistral on macOS, Windows and Linux, with a local API for apps.

Pros

  • Private, offline AI
  • Free and open source

Cons

  • Quality depends on your hardware

Being used for

  • Running AI models locally54 posts · X · HN · X
  • Writing and debugging code32 posts · X · HN · X
  • Building AI agents21 posts · X · HN · HN

Based on 84 public posts on X and Hacker News that describe using it · checked Oct 23, 2026

Use cases · Hear from users

Real posts from people using Ollama on X, sorted by engagement (English first).

  • Terp @OnlyTerp

    Had to do a full system reinstall LOL this is why I used my 2nd pc :) basically what happened was I have qwen3-next on ollama running locally on my pc. I was trying to get open claw to use my local model for heavy lifting so I don't burn too much tokens so I asked openclaw to se…

    19 likes · 1 reposts · 10 repliesView on X ↗
  • Wise @trikcode

    this is probably the cleanest setup for using a local model and any remote model without switching providers. i tried it with Ollama + GPT and the setup was way simpler than i expected. here’s what i did 🧵 https://t.co/rTs7f3jR3d

    15 likes · 4 reposts · 6 repliesView on X ↗
  • As many of you know, I’m a heavy user of local LLMs for voice input and interactive models. ASR alone isn’t enough for voice input. Spoken input is often ambiguous: someone’s name, for example, can be transcribed as any number of Chinese characters that sound the same. So how d…

    16 likes · 1 reposts · 4 repliesView on X ↗
  • DAY 53 — I stopped asking AI to just TALK. I made it TAKE ACTION. ⚡ Today I learned and built my first LLM Tool Calling system. What I built A mini AI Customer Support Agent using: • Python • Ollama • Llama 3.2 3B • Mock database • 3 custom tools https://t.co/Et30A7pLxv

    4 likes · 0 reposts · 4 repliesView on X ↗
  • Valid JSON isn’t the same as a correct answer. “A schema-conforming response is not a correct response.” How I use Ollama on a Mac mini for repetitive work, with validation and final review kept separate. https://t.co/ElOl8hOv9g

    7 likes · 0 reposts · 1 repliesView on X ↗
  • I was testing a local ollama setup at my desk to debug raw web and API traffic for a client project. normally u gotta copy paste ugly logs into cloud models... which leaks private tokens and passwords. so i built a small script to scrub passwords, pack the web requests into…

    4 likes · 0 reposts · 2 repliesView on X ↗
Show 14 more posts ›
  • MZI @MZI_codes

    I Tested the new Qwen 3.5 2B model on 128MB UHD. i used @ollama to run it locally. Key takeaway : If you want to run a local model for any reason (privacy or whatever) on a UHD graphics card make sure you turn off thinking using the command /set nothink to speed up inference.…

    2 likes · 0 reposts · 2 repliesView on X ↗
  • I used to use llama 3.2 for text generation and spelling checks in ollama locally. Now, I tried ifioravanti/mistral-grammar-checker, and it's astonishingly good.

    4 likes · 0 reposts · 1 repliesView on X ↗
  • So like, I use Ollama like I have no usage limits, with Deepseek v4.1 Flash. And honestly, I never run out. I use it all day, having it work on Gaming accessibility mod stuff. No I am not releasing anything yet. And I just plain never run out of AI. #AI #Ollama

    4 likes · 0 reposts · 1 repliesView on X ↗
  • I built a semantic search that returns similar movies using @weaviate_io, and implements RAG with the Ollama local model. https://t.co/XJTz6CPfqi

    3 likes · 0 reposts · 1 repliesView on X ↗
  • No luck. I tried the new gpt-oss-20b local model on my M2 Macbook Air 8 GB RAM and it just slowed everything down and took forever to respond. Unfortunate. Anyone know any good local models I can run using Ollama with my macbook? https://t.co/Bt0rsSbkn9

    2 likes · 0 reposts · 1 repliesView on X ↗
  • Someone said you can finetune running llama.cpp to run models faster.. I tried and failed, running ollama was faster for me.. hopefully I can comeback in future and see what Mistake I made..or you can share some tips if you would have done differently https://t.co/zBDxPACgWm

    2 likes · 0 reposts · 1 repliesView on X ↗
  • Cole @LegendaryLibr

    If you have a single gpu and are making gen ai stuff, you can use a local llm to write prompts for generations. Been using qwen 3.8 27b-q4_k_m to prompt more elaborate stuff. I use Pi with ollama to prompt, then stop ollama to eject the llm from vram so I can then generate the v…

    1 likes · 0 reposts · 1 repliesView on X ↗
  • So this is whacky. I use LMStudio and Ollama for local models on my Mac Mini M4. Recently the new qwen3 models dropped and I loaded up qwen3-30B-a3b and tested it. And it's the first local model that reliably executes tool calls.

    1 likes · 0 reposts · 1 repliesView on X ↗
  • I didn't install an AI agent to help me troubleshoot Kubernetes. Instead, I took the hard route and built one. One's infrastructure experience might say, "Install the agent, wire it in, move on." This spring at the Recurse Center, I wrote a chatbot agent and its own MCP server.…

    1 likes · 0 reposts · 1 repliesView on X ↗
  • 3ene @BBleimschein

    I wanted to try running my coding agent with a local model this morning, but ran into slow responses with Ollama. That led to the core insight: on macOS, Ollama adds overhead and doesn’t give a clean Metal‑accelerated path, so I built a minimal MLX server with @OpenAI codex.

    0 likes · 0 reposts · 1 repliesView on X ↗
  • Satish G @satishgoda

    I recently subscribed to @ollama Pro and have been using their library of models along with @LangChain. Yesterday while reading the docs I learned that you can use the models with Claude! The Claude setup walkthrough actually maps their models to the equivalent Ollama offering a…

    1 likes · 0 reposts · 0 repliesView on X ↗
  • Local 8B model on my RTX 2060 found the overflow in 3 seconds. Switched to Codex in the same chat. It fixed the code, wrote the tests, and generated the chart. Real diffs. Real tests. Phone + laptop. NivKode #LocalLLaMA #Ollama https://t.co/M7ln6Z9Y8s

    0 likes · 0 reposts · 0 repliesView on X ↗
  • Tried @ollama launch + Clauda code + GLM Flash today, surely, clauda code has alot of potentials working with its own models tailored for all scenarios. However, working with local model was promising until i tried generate Rust code for Tauri + Dioxus. #LOCALMODEL, #OLLAMAL…

    0 likes · 0 reposts · 0 repliesView on X ↗
  • 🚀 I built a webserver powered entirely by an LLM. Every HTTP/1.1 response — headers, body, everything — is generated in real-time by a local model (via Ollama). No traditional backend logic. 🧠 Pure AI. 📡 Pure shell. 🔗 https://t.co/lo6DPoT6Yy #AI #LLM #DevOps #bash #webdev

    0 likes · 0 reposts · 0 repliesView on X ↗