AnythingLLM
All-in-one AI chat app with RAG, agents, and multi-model support
AnythingLLM is a full-stack AI application for building a private ChatGPT-like experience around your own documents and content. It supports local and hosted LLMs, integrates with multiple vector database backends, and organizes content into isolated workspaces for cleaner context management.
Key Features
- Retrieval-augmented generation (RAG) to chat with PDFs, DOCX, TXT, CSV, codebases, and more
- Workspace-based organization with separated context and optional document sharing
- AI agents, including a no-code agent builder and MCP compatibility
- Supports local and commercial LLM providers (including Ollama and llama.cpp-compatible models)
- Multiple vector database options (default local-first setup, with external backends available)
- Multi-user deployment with permissions (Docker deployment)
- Embeddable website chat widget (Docker deployment)
- Developer API for integrations and automation
Use Cases
- Internal knowledge base chat for teams (policies, runbooks, product docs)
- Private document Q&A for sensitive datasets and client files
- Building agent-assisted workflows that reference curated business content
AnythingLLM is a strong choice when you want a configurable, privacy-conscious AI application that can run locally or on a server, while staying flexible about which LLM and vector database you use.
Categories:
Tags:
Tech Stack:
SQLite
JavaScript
Ollama
Express
Docker
React
Node.jsSimilar Services
Open WebUI
Extensible, offline-capable web interface for LLM interactions
Feature-rich, self-hosted AI interface that integrates Ollama and OpenAI-compatible APIs, offers RAG, vector DB support, image tools, RBAC and observability.
LibreChat
Self-hosted multi-provider AI chat UI with agents and tools
LibreChat is a self-hosted AI chat platform that supports multiple LLM providers, custom endpoints, agents/tools, file and image chat, conversation search, and presets.
Netron
Visualizer for neural network and machine learning models
Netron is a model graph viewer for inspecting neural network and ML formats such as ONNX, TensorFlow Lite, PyTorch, Keras, Core ML, and more.
Khoj
Open-source personal AI for chat, semantic search and agents
Self-hostable personal AI 'second brain' for chat, semantic search, custom agents, automations and integration with local or cloud LLMs.
Perplexica
Privacy-focused AI answering engine with web search and citations
Self-hosted AI answering engine that combines web search with local or hosted LLMs to generate cited answers, with search history and file uploads.
Activepieces
AI-first no-code workflow automation with extensible integrations
Open-source automation builder for creating workflows with webhooks, HTTP steps, code actions, and an extensible TypeScript-based integration framework with AI features.
