AnythingLLM
Local-first private AI assistant for your documents — no cloud required.
Visit AnythingLLM Free desktop, Cloud from $10/mo
What is AnythingLLM?
AnythingLLM is an open-source desktop app that lets you chat with your documents using local AI models (via Ollama or LM Studio) or cloud APIs. Built for privacy-first users and enterprises who cannot send data to ChatGPT.
Key features
- Run entirely local via Ollama / LM Studio
- Cloud option also available
- Document RAG across PDFs, docs, websites
- Open source (MIT)
- Mac + Windows + Linux + Docker
Pros
- Genuine privacy — data never leaves your machine if you want
- Open source and auditable
- Works with any LLM (local or API)
Cons
- Local performance limited by your hardware
- UI less polished than ChatGPT
- Setup non-trivial for non-developers
Best for
Privacy-conscious individualsRegulated industries (legal, healthcare)Developers wanting full controlSelf-hosting enthusiasts
Alternatives to AnythingLLM
Productivity
NotebookLM ★
Google's research notebook — upload sources, get a personalised AI tutor.
Research
FreemiumFree (50 sources/notebook), Plus $19.99/mo via Google One AI
Released June 2023
Coding
Continue
Open-source Copilot for VS Code and JetBrains — bring your own model.
Autocomplete
FreeFree (BYO API key)
Released June 2023