Google Gemini logo

10 self-hosted Google Gemini alternatives

Google Gemini is a generative AI model family and assistant offering chat-based and multimodal (text, image, audio) capabilities for writing, coding, search, and retrieval-augmented tasks. Accessible via Gemini web/app, APIs, and integrations across Google services.

Alternatives to Google Gemini

Feature-rich, self-hosted AI interface that integrates Ollama and OpenAI-compatible APIs, offers RAG, vector DB support, image tools, RBAC and observability.

Open WebUI screenshot

147k stars21.4k forkslast commit Actively maintained

AnythingLLM is an all-in-one desktop and Docker app for chatting with documents using RAG, running AI agents, and connecting to local or hosted LLMs and vector databases.

AnythingLLM screenshot

64k stars7k forksMITlast commit Actively maintained

Run LLMs, image, and audio models locally with an OpenAI-compatible API, optional GPU acceleration, and a built-in web UI for managing and testing models.

LocalAI screenshot

47.9k stars4.3k forksMITlast commit Actively maintained

LibreChat is a self-hosted AI chat platform that supports multiple LLM providers, custom endpoints, agents/tools, file and image chat, conversation search, and presets.

LibreChat screenshot

41.4k stars8.5k forksMITlast commit Actively maintained

Self-hostable personal AI 'second brain' for chat, semantic search, custom agents, automations and integration with local or cloud LLMs.

Khoj screenshot

36.1k stars2.3k forksAGPL-3.0last commit Actively maintained

Leon is an open-source personal assistant that runs on your server, enabling privacy-focused automation through modular skills with text and optional voice interaction.

Leon screenshot

17.4k stars1.5k forksMITlast commit Actively maintained

Extension for Paperless‑ngx that uses OpenAI-compatible backends and Ollama to auto-classify, tag, index, and enable RAG-powered document chat and semantic search.

Paperless-AI screenshot

5.8k stars318 forksMITlast commit Actively maintained

Self-hosted private AI tools for chat and document Q&A, supporting local Ollama inference or OpenAI-compatible APIs, with built-in authentication and user management.

1.7k stars87 forksAGPL-3.0last commit Likely dormant

LLM-driven movie and TV recommendation web app that uses Sonarr/Radarr libraries and Plex/Jellyfin watch history to generate personalized suggestions.

1.1k stars20 forksMITlast commit Slowing down

What replacing Google Gemini actually involves

Every option on this page is open source and free to run on your own hardware, so you own the data and there is no subscription to cancel. 8 of 10 shipped a commit in the last six months. Licences in this list: MIT, AGPL-3.0. In exchange you take on hosting, backups and updates yourself.

Browse everything in AI Interfaces (Chatbots, Agents, RAG Apps).

Other tools people replace alongside Google Gemini