Self-hosted projects tagged “Local LLM”
13 open source projects with this tag
13 services found
Ollama
Run and manage large language models locally with an API
Ollama is a local LLM runtime that lets you pull, run, and customize models, offering a CLI and REST API for chat, generation, and embeddings.
AnythingLLM
All-in-one AI chat app with RAG, agents, and multi-model support
AnythingLLM is an all-in-one desktop and Docker app for chatting with documents using RAG, running AI agents, and connecting to local or hosted LLMs and vector databases.
LocalAI
OpenAI-compatible local AI inference server and API
Run LLMs, image, and audio models locally with an OpenAI-compatible API, optional GPU acceleration, and a built-in web UI for managing and testing models.
Khoj
Open-source personal AI for chat, semantic search and agents
Self-hostable personal AI 'second brain' for chat, semantic search, custom agents, automations and integration with local or cloud LLMs.
Leon
Open-source personal assistant you can run on your own server
Leon is an open-source personal assistant that runs on your server, enabling privacy-focused automation through modular skills with text and optional voice interaction.
Willow
Open-source, privacy-focused voice assistant platform
Self-hosted voice assistant platform for ESP32 devices with on-device wake-word and command recognition, Home Assistant integration, and an optional inference server for...
Speaches
OpenAI API-compatible server for speech-to-text and text-to-speech
Self-hosted, OpenAI API-compatible server for streaming transcription, translation, and speech generation using faster-whisper and TTS engines like Piper and Kokoro.
Scriberr
Offline AI audio and video transcription with transcript chat
Scriberr is a self-hosted, privacy-focused AI transcription app for audio and video, with speaker diarization, word-level timestamps, summaries, and transcript chat.
Beelzebub
Low-code honeypot framework using LLMs for safe system deception
Secure low-code honeypot framework that uses LLMs to simulate high-interaction systems across SSH/HTTP/TCP and MCP, with metrics and cloud-native deployment options.
SecureAI Tools
Self-hosted private AI chat and document Q&A with local inference
Self-hosted private AI tools for chat and document Q&A, supporting local Ollama inference or OpenAI-compatible APIs, with built-in authentication and user management.
Edit Mind
Local AI video indexing and semantic search web app
Self-hosted web app that indexes videos with AI (transcription, vision analysis, embeddings) to enable natural-language search and scene export.
Recommendarr
AI recommendation app for movies and TV using your media libraries
LLM-driven movie and TV recommendation web app that uses Sonarr/Radarr libraries and Plex/Jellyfin watch history to generate personalized suggestions.
File Wizard
Browser-based file conversion, OCR, and audio transcription UI
Self-hosted web UI for file conversion, OCR for PDFs/images, and local Whisper-based audio transcription, wrapping common CLI tools with background jobs and history.