Best Self-hosted AI & Machine Learning tools in 2026

Ollama is a local LLM runtime that lets you pull, run, and customize models, offering a CLI and REST API for chat, generation, and embeddings.

Alternative to:

OpenAI API+15

Feature-rich, self-hosted AI interface that integrates Ollama and OpenAI-compatible APIs, offers RAG, vector DB support, image tools, RBAC and observability.

Alternative to:

Open WebUI Cloud+19

Meilisearch is a lightning-fast search engine API for apps and websites, offering typo-tolerant full-text search plus vector and AI-ready hybrid retrieval.

Alternative to:

Algolia+16

AnythingLLM is an all-in-one desktop and Docker app for chatting with documents using RAG, running AI agents, and connecting to local or hosted LLMs and vector databases.

Alternative to:

AnythingLLM Cloud+19

Run LLMs, image, and audio models locally with an OpenAI-compatible API, optional GPU acceleration, and a built-in web UI for managing and testing models.

Alternative to:

OpenAI API+19

LibreChat is a self-hosted AI chat platform that supports multiple LLM providers, custom endpoints, agents/tools, file and image chat, conversation search, and presets.

Alternative to:

ChatGPT+11

Self-hostable personal AI 'second brain' for chat, semantic search, custom agents, automations and integration with local or cloud LLMs.

Alternative to:

Google NotebookLM+16

Netron is a model graph viewer for inspecting neural network and ML formats such as ONNX, TensorFlow Lite, PyTorch, Keras, Core ML, and more.

Self-hosted AI answering engine that combines web search with local or hosted LLMs to generate cited answers, with search history and file uploads.

Alternative to:

Perplexity+5

Langfuse is an open-source LLM engineering platform for tracing, metrics, evaluations, datasets, and prompt management to debug and improve AI applications.

Alternative to:

LangSmith+7

Open-source Python framework to build, scale, and deploy multimodal AI services and pipelines with gRPC/HTTP/WebSocket support and Kubernetes/Docker integration.

Alternative to:

Baseten+12

Open-source automation builder for creating workflows with webhooks, HTTP steps, code actions, and an extensible TypeScript-based integration framework with AI features.

Alternative to:

Zapier+17

Self-hostable tool to convert non-DRM eBooks into audiobooks with chapter support, metadata, multilingual TTS engines, and optional voice cloning via a web UI or CLI.

Alternative to:

Speechify+7

Opik is an open-source platform to trace, evaluate, and monitor LLM apps, RAG pipelines, and agent workflows with automated evaluations and production dashboards.

Alternative to:

LangSmith+10

Open-source platform for AI chat, RAG, agents, and enterprise search across your team’s connected knowledge sources, compatible with hosted and local LLMs.

Alternative to:

Onyx+19

Leon is an open-source personal assistant that runs on your server, enabling privacy-focused automation through modular skills with text and optional voice interaction.

Alternative to:

Amazon Alexa+6

Open-source proofreading and writing assistant that checks spelling, grammar, punctuation, and style across 30+ languages, with an HTTP API for integrations.

Alternative to:

Grammarly+4

LibreTranslate is a free, open-source machine translation API you can run on your own infrastructure, with offline-capable translations and a simple HTTP API.

Alternative to:

Google Translate

Self-hostable visual builder for chatbots and conversational forms, embeddable on websites and apps with integrations, branching logic, and real-time results analytics.

Alternative to:

ChatBot.com+9

Open-source, self-hosted AI note-taking app for fast capture and organization, with Markdown notes and RAG-based natural language search.

Alternative to:

Evernote+19

Extension for Paperless‑ngx that uses OpenAI-compatible backends and Ollama to auto-classify, tag, index, and enable RAG-powered document chat and semantic search.

Alternative to:

AskYourPDF+19

Agenta is an open-source LLMOps platform with a prompt playground, prompt/version management, LLM evaluation, and production observability for LLM apps.

Alternative to:

Langfuse+7

Open-source shadcn/ui-based component library for building ChatGPT-style and MCP apps with production-ready, customizable UI blocks.

Self-hosted voice assistant platform for ESP32 devices with on-device wake-word and command recognition, Home Assistant integration, and an optional inference server for...

Alternative to:

Amazon Alexa+9

Self-hosted, OpenAI API-compatible server for streaming transcription, translation, and speech generation using faster-whisper and TTS engines like Piper and Kokoro.

Alternative to:

OpenAI API+9

Open-source self-hosted fitness tracker for nutrition, exercise, water, and body metrics; includes AI nutrition chat, Docker deployment, web PWA and Android app.

Alternative to:

Cronometer+9

Basic Memory gives AI assistants durable, local-first memory by reading and writing structured Markdown notes, enabling reusable context across conversations and tools.

Alternative to:

Obsidian+14

Scriberr is a self-hosted, privacy-focused AI transcription app for audio and video, with speaker diarization, word-level timestamps, summaries, and transcript chat.

Alternative to:

Otter.ai+6

Self-hosted private AI tools for chat and document Q&A, supporting local Ollama inference or OpenAI-compatible APIs, with built-in authentication and user management.

Alternative to:

ChatGPT+13

Open-source BirdNET toolkit to batch-process audio recordings and identify bird species from their vocalizations using machine learning models.