AnythingLLM
All-in-one AI chat app with RAG, agents, and multi-model support
64k stars 7k forks last commit first released MIT
Actively maintained
Last commit 27 Jul 2026.
AnythingLLM is a full-stack AI application for building a private ChatGPT-like experience around your own documents and content. It supports local and hosted LLMs, integrates with multiple vector database backends, and organizes content into isolated workspaces for cleaner context management.
Key Features
- Retrieval-augmented generation (RAG) to chat with PDFs, DOCX, TXT, CSV, codebases, and more
- Workspace-based organization with separated context and optional document sharing
- AI agents, including a no-code agent builder and MCP compatibility
- Supports local and commercial LLM providers (including Ollama and llama.cpp-compatible models)
- Multiple vector database options (default local-first setup, with external backends available)
- Multi-user deployment with permissions (Docker deployment)
- Embeddable website chat widget (Docker deployment)
- Developer API for integrations and automation
Use Cases
- Internal knowledge base chat for teams (policies, runbooks, product docs)
- Private document Q&A for sensitive datasets and client files
- Building agent-assisted workflows that reference curated business content
AnythingLLM is a strong choice when you want a configurable, privacy-conscious AI application that can run locally or on a server, while staying flexible about which LLM and vector database you use.
Categories:
Tags:
Tech Stack:
Similar to AnythingLLM
Tiledesk
Open-source platform for AI chatbots and multichannel live chat
Open-source conversational platform to build AI chatbots, multichannel live chat, and human-in-the-loop customer support with knowledge base and RAG capabilities.
Scriberr
Offline AI audio and video transcription with transcript chat
Scriberr is a self-hosted, privacy-focused AI transcription app for audio and video, with speaker diarization, word-level timestamps, summaries, and transcript chat.
Ollama
Run and manage large language models locally with an API
Ollama is a local LLM runtime that lets you pull, run, and customize models, offering a CLI and REST API for chat, generation, and embeddings.
SecureAI Tools
Self-hosted private AI chat and document Q&A with local inference
Self-hosted private AI tools for chat and document Q&A, supporting local Ollama inference or OpenAI-compatible APIs, with built-in authentication and user management.
LocalAI
OpenAI-compatible local AI inference server and API
Run LLMs, image, and audio models locally with an OpenAI-compatible API, optional GPU acceleration, and a built-in web UI for managing and testing models.
LibreChat
Self-hosted multi-provider AI chat UI with agents and tools
LibreChat is a self-hosted AI chat platform that supports multiple LLM providers, custom endpoints, agents/tools, file and image chat, conversation search, and presets.