Self-hosted AI & Machine Learning tools
47 open source alternatives in this category
47 services found
Ollama
Run and manage large language models locally with an API
Ollama is a local LLM runtime that lets you pull, run, and customize models, offering a CLI and REST API for chat, generation, and embeddings.
Open WebUI
Extensible, offline-capable web interface for LLM interactions
Feature-rich, self-hosted AI interface that integrates Ollama and OpenAI-compatible APIs, offers RAG, vector DB support, image tools, RBAC and observability.
AnythingLLM
All-in-one AI chat app with RAG, agents, and multi-model support
AnythingLLM is an all-in-one desktop and Docker app for chatting with documents using RAG, running AI agents, and connecting to local or hosted LLMs and vector databases.
Meilisearch
Fast search engine API with full-text, vector, and hybrid search
Meilisearch is a lightning-fast search engine API for apps and websites, offering typo-tolerant full-text search plus vector and AI-ready hybrid retrieval.
LocalAI
OpenAI-compatible local AI inference server and API
Run LLMs, image, and audio models locally with an OpenAI-compatible API, optional GPU acceleration, and a built-in web UI for managing and testing models.
LibreChat
Self-hosted multi-provider AI chat UI with agents and tools
LibreChat is a self-hosted AI chat platform that supports multiple LLM providers, custom endpoints, agents/tools, file and image chat, conversation search, and presets.
Khoj
Open-source personal AI for chat, semantic search and agents
Self-hostable personal AI 'second brain' for chat, semantic search, custom agents, automations and integration with local or cloud LLMs.
Perplexica
Privacy-focused AI answering engine with web search and citations
Self-hosted AI answering engine that combines web search with local or hosted LLMs to generate cited answers, with search history and file uploads.
Netron
Visualizer for neural network and machine learning models
Netron is a model graph viewer for inspecting neural network and ML formats such as ONNX, TensorFlow Lite, PyTorch, Keras, Core ML, and more.
Langfuse
Open-source platform for LLM observability, evals, and prompt management
Langfuse is an open-source LLM engineering platform for tracing, metrics, evaluations, datasets, and prompt management to debug and improve AI applications.
Onyx Community Edition
Self-hosted AI chat and enterprise search for any LLM
Open-source platform for AI chat, RAG, agents, and enterprise search across your team’s connected knowledge sources, compatible with hosted and local LLMs.
Activepieces
AI-first no-code workflow automation with extensible integrations
Open-source automation builder for creating workflows with webhooks, HTTP steps, code actions, and an extensible TypeScript-based integration framework with AI features.
Jina
Cloud-native Python framework for serving multimodal AI services
Open-source Python framework to build, scale, and deploy multimodal AI services and pipelines with gRPC/HTTP/WebSocket support and Kubernetes/Docker integration.
Opik
LLM observability and evaluation platform for traces, tests, and dashboards
Opik is an open-source platform to trace, evaluate, and monitor LLM apps, RAG pipelines, and agent workflows with automated evaluations and production dashboards.
ebook2audiobook
Convert eBooks into audiobooks with TTS and optional voice cloning
Self-hostable tool to convert non-DRM eBooks into audiobooks with chapter support, metadata, multilingual TTS engines, and optional voice cloning via a web UI or CLI.
Leon
Open-source personal assistant you can run on your own server
Leon is an open-source personal assistant that runs on your server, enabling privacy-focused automation through modular skills with text and optional voice interaction.
LibreTranslate
Self-hosted machine translation API powered by open-source models
LibreTranslate is a free, open-source machine translation API you can run on your own infrastructure, with offline-capable translations and a simple HTTP API.
LanguageTool
Multilingual grammar, style, and spell checker
Open-source proofreading and writing assistant that checks spelling, grammar, punctuation, and style across 30+ languages, with an HTTP API for integrations.
Blinko
Privacy-focused AI note-taking app with RAG-powered search
Open-source, self-hosted AI note-taking app for fast capture and organization, with Markdown notes and RAG-based natural language search.
Typebot
Visual chatbot and conversational form builder for web and apps
Self-hostable visual builder for chatbots and conversational forms, embeddable on websites and apps with integrations, branching logic, and real-time results analytics.
Manifest
UI blocks for building ChatGPT-style and MCP apps
Open-source shadcn/ui-based component library for building ChatGPT-style and MCP apps with production-ready, customizable UI blocks.
Paperless-AI
AI extension for Paperless‑ngx providing automated analysis and RAG
Extension for Paperless‑ngx that uses OpenAI-compatible backends and Ollama to auto-classify, tag, index, and enable RAG-powered document chat and semantic search.
SparkyFitness
Self-hosted fitness tracker with AI nutrition chat and web + mobile apps
Open-source self-hosted fitness tracker for nutrition, exercise, water, and body metrics; includes AI nutrition chat, Docker deployment, web PWA and Android app.
Agenta
Open-source LLMOps platform for prompts, evals, and observability
Agenta is an open-source LLMOps platform with a prompt playground, prompt/version management, LLM evaluation, and production observability for LLM apps.
Speaches
OpenAI API-compatible server for speech-to-text and text-to-speech
Self-hosted, OpenAI API-compatible server for streaming transcription, translation, and speech generation using faster-whisper and TTS engines like Piper and Kokoro.
Basic Memory
Local-first persistent memory for AI chats using Markdown notes
Basic Memory gives AI assistants durable, local-first memory by reading and writing structured Markdown notes, enabling reusable context across conversations and tools.
Willow
Open-source, privacy-focused voice assistant platform
Self-hosted voice assistant platform for ESP32 devices with on-device wake-word and command recognition, Home Assistant integration, and an optional inference server for STT/TTS/LLM.
Scriberr
Offline AI audio and video transcription with transcript chat
Scriberr is a self-hosted, privacy-focused AI transcription app for audio and video, with speaker diarization, word-level timestamps, summaries, and transcript chat.
Edit Mind
Local AI video indexing and semantic search web app
Self-hosted web app that indexes videos with AI (transcription, vision analysis, embeddings) to enable natural-language search and scene export.
SecureAI Tools
Self-hosted private AI chat and document Q&A with local inference
Self-hosted private AI tools for chat and document Q&A, supporting local Ollama inference or OpenAI-compatible APIs, with built-in authentication and user management.