SecureAI Tools
Self-hosted private AI chat and document Q&A with local inference
1.7k stars 87 forks last commit first released AGPL-3.0
Likely dormant
No commits since 27 May 2024. Expect to maintain it yourself or pick an alternative.
SecureAI Tools is a self-hosted web app for private AI productivity, focused on AI chat and chatting with your own documents. It can run models locally via Ollama or connect to OpenAI-compatible providers, and includes built-in access controls for multi-user use.
Key Features
- Chat interface for interacting with LLMs
- Document Q&A (PDF support) with offline document processing
- Local model inference via Ollama, with optional GPU acceleration
- Support for remote OpenAI-compatible APIs as an alternative to local inference
- Built-in email/password authentication and basic user management
- Optimized self-hosting experience with Docker Compose and setup scripts
- Integrations including Paperless-ngx and Google Drive
Use Cases
- Private, family or small-team AI assistant with account-based access
- Ask questions and summarize PDFs and organized document collections
- Run local LLMs on a workstation or home server to keep data on-premises
Limitations and Considerations
- Document chat is currently focused on PDFs; broader file-type support is still evolving
- Local inference performance depends heavily on available RAM/GPU, especially on non-Apple systems
SecureAI Tools is a practical option for users who want a privacy-oriented AI chat experience combined with document Q&A, and the flexibility to choose between local models and OpenAI-compatible providers.
Categories:
Tags:
Tech Stack:
Similar to SecureAI Tools
Scriberr
Offline AI audio and video transcription with transcript chat
Scriberr is a self-hosted, privacy-focused AI transcription app for audio and video, with speaker diarization, word-level timestamps, summaries, and transcript chat.
AnythingLLM
All-in-one AI chat app with RAG, agents, and multi-model support
AnythingLLM is an all-in-one desktop and Docker app for chatting with documents using RAG, running AI agents, and connecting to local or hosted LLMs and vector databases.
LibreChat
Self-hosted multi-provider AI chat UI with agents and tools
LibreChat is a self-hosted AI chat platform that supports multiple LLM providers, custom endpoints, agents/tools, file and image chat, conversation search, and presets.
Paperless-AI
AI extension for Paperless‑ngx providing automated analysis and RAG
Extension for Paperless‑ngx that uses OpenAI-compatible backends and Ollama to auto-classify, tag, index, and enable RAG-powered document chat and semantic search.
Ollama
Run and manage large language models locally with an API
Ollama is a local LLM runtime that lets you pull, run, and customize models, offering a CLI and REST API for chat, generation, and embeddings.
LocalAI
OpenAI-compatible local AI inference server and API
Run LLMs, image, and audio models locally with an OpenAI-compatible API, optional GPU acceleration, and a built-in web UI for managing and testing models.