Self-hosted projects tagged “LLM”

Ollama is a local LLM runtime that lets you pull, run, and customize models, offering a CLI and REST API for chat, generation, and embeddings.

Alternative to:

OpenAI API+15

Feature-rich, self-hosted AI interface that integrates Ollama and OpenAI-compatible APIs, offers RAG, vector DB support, image tools, RBAC and observability.

Alternative to:

Open WebUI Cloud+19

AnythingLLM is an all-in-one desktop and Docker app for chatting with documents using RAG, running AI agents, and connecting to local or hosted LLMs and vector databases.

Alternative to:

AnythingLLM Cloud+19

Run LLMs, image, and audio models locally with an OpenAI-compatible API, optional GPU acceleration, and a built-in web UI for managing and testing models.

Alternative to:

OpenAI API+19

LibreChat is a self-hosted AI chat platform that supports multiple LLM providers, custom endpoints, agents/tools, file and image chat, conversation search, and presets.

Alternative to:

ChatGPT+11

Self-hostable personal AI 'second brain' for chat, semantic search, custom agents, automations and integration with local or cloud LLMs.

Alternative to:

Google NotebookLM+16

Netron is a model graph viewer for inspecting neural network and ML formats such as ONNX, TensorFlow Lite, PyTorch, Keras, Core ML, and more.

Self-hosted AI answering engine that combines web search with local or hosted LLMs to generate cited answers, with search history and file uploads.

Alternative to:

Perplexity+5

Langfuse is an open-source LLM engineering platform for tracing, metrics, evaluations, datasets, and prompt management to debug and improve AI applications.

Alternative to:

LangSmith+7

Open-source automation builder for creating workflows with webhooks, HTTP steps, code actions, and an extensible TypeScript-based integration framework with AI features.

Alternative to:

Zapier+17

Opik is an open-source platform to trace, evaluate, and monitor LLM apps, RAG pipelines, and agent workflows with automated evaluations and production dashboards.

Alternative to:

LangSmith+10

Open-source platform for AI chat, RAG, agents, and enterprise search across your team’s connected knowledge sources, compatible with hosted and local LLMs.

Alternative to:

Onyx+19

Maxun is an open source no-code platform to build web scraping robots that extract structured data and expose websites as APIs, markdown, or automated pipelines.

Alternative to:

Apify+1

Extension for Paperless‑ngx that uses OpenAI-compatible backends and Ollama to auto-classify, tag, index, and enable RAG-powered document chat and semantic search.

Alternative to:

AskYourPDF+19

Open-source, self-hosted personal bookkeeping app with AI-powered features.

Alternative to:

Quicken+19

Agenta is an open-source LLMOps platform with a prompt playground, prompt/version management, LLM evaluation, and production observability for LLM apps.

Alternative to:

Langfuse+7

Self-hosted voice assistant platform for ESP32 devices with on-device wake-word and command recognition, Home Assistant integration, and an optional inference server for...

Alternative to:

Amazon Alexa+9

Self-hosted, OpenAI API-compatible server for streaming transcription, translation, and speech generation using faster-whisper and TTS engines like Piper and Kokoro.

Alternative to:

OpenAI API+9

Basic Memory gives AI assistants durable, local-first memory by reading and writing structured Markdown notes, enabling reusable context across conversations and tools.

Alternative to:

Obsidian+14

Scriberr is a self-hosted, privacy-focused AI transcription app for audio and video, with speaker diarization, word-level timestamps, summaries, and transcript chat.

Alternative to:

Otter.ai+6

Secure low-code honeypot framework that uses LLMs to simulate high-interaction systems across SSH/HTTP/TCP and MCP, with metrics and cloud-native deployment options.

Alternative to:

Thinkst Canary+1

Self-hosted private AI tools for chat and document Q&A, supporting local Ollama inference or OpenAI-compatible APIs, with built-in authentication and user management.

Alternative to:

ChatGPT+13

LLM-driven movie and TV recommendation web app that uses Sonarr/Radarr libraries and Plex/Jellyfin watch history to generate personalized suggestions.

Alternative to:

ChatGPT+9

Automates purchase order ingestion, validation, and ERP posting for distributors, manufacturers and wholesalers using AI-driven item matching and configurable workflows.

Alternative to:

Microsoft Power Automate+8

Self-hosted web UI for file conversion, OCR for PDFs/images, and local Whisper-based audio transcription, wrapping common CLI tools with background jobs and history.

Alternative to:

CloudConvert+15

Open-source operating system that connects company goals, projects and check-ins with opinionated workflows, an AI executive coach, and self-hosting options.

Alternative to:

monday.com+19

News and RSS reader that auto-assigns tags (including via LLMs), lets you define scoring rules, and filter/sort feeds; supports single- and multi-user deployments.

Alternative to:

Inoreader+11

Open-source conversational platform to build AI chatbots, multichannel live chat, and human-in-the-loop customer support with knowledge base and RAG capabilities.

Alternative to:

Tiledesk+19

Automates subtitle synchronization and user audio/subtitle preferences via webhooks from Overseerr/Jellyseerr, integrating with Sonarr, Radarr, Bazarr and Plex.

Self-hosted recipe manager and PWA with web scraping, ingredient parsing, unit conversion, shopping lists, cooking logs, LLM-assisted features, and Docker deployment.

Alternative to:

Paprika Recipe Manager+7