AnythingLLM Cloud logo

7 self-hosted AnythingLLM Cloud alternatives

Hosted platform to build and run retrieval-augmented generation (RAG) chatbots and agents over documents and data sources. Provides workspaces, connectors, embeddings/vector store integrations, and access to model providers for team deployments.

Alternatives to AnythingLLM Cloud

Ollama is a local LLM runtime that lets you pull, run, and customize models, offering a CLI and REST API for chat, generation, and embeddings.

Ollama screenshot

177.1k stars17.1k forksMITlast commit Actively maintained

Feature-rich, self-hosted AI interface that integrates Ollama and OpenAI-compatible APIs, offers RAG, vector DB support, image tools, RBAC and observability.

Open WebUI screenshot

147k stars21.4k forkslast commit Actively maintained

AnythingLLM is an all-in-one desktop and Docker app for chatting with documents using RAG, running AI agents, and connecting to local or hosted LLMs and vector databases.

AnythingLLM screenshot

64k stars7k forksMITlast commit Actively maintained

LibreChat is a self-hosted AI chat platform that supports multiple LLM providers, custom endpoints, agents/tools, file and image chat, conversation search, and presets.

LibreChat screenshot

41.4k stars8.5k forksMITlast commit Actively maintained

Self-hostable personal AI 'second brain' for chat, semantic search, custom agents, automations and integration with local or cloud LLMs.

Khoj screenshot

36.1k stars2.3k forksAGPL-3.0last commit Actively maintained

Self-hosted private AI tools for chat and document Q&A, supporting local Ollama inference or OpenAI-compatible APIs, with built-in authentication and user management.

1.7k stars87 forksAGPL-3.0last commit Likely dormant

LLM-driven movie and TV recommendation web app that uses Sonarr/Radarr libraries and Plex/Jellyfin watch history to generate personalized suggestions.

1.1k stars20 forksMITlast commit Slowing down

What replacing AnythingLLM Cloud actually involves

Every option on this page is open source and free to run on your own hardware, so you own the data and there is no subscription to cancel. 5 of 7 shipped a commit in the last six months. Licences in this list: MIT, AGPL-3.0. In exchange you take on hosting, backups and updates yourself.

Browse everything in AI Interfaces (Chatbots, Agents, RAG Apps).

Other tools people replace alongside AnythingLLM Cloud