#1
Ollama is a local LLM runtime that lets you pull, run, and customize models, offering a CLI and REST API for chat, generation, and embeddings.
180.1k stars17.7k forksMITlast commit Actively maintained
The self-hosted GroqCloud API alternative
Managed cloud API by Groq for running large language models with low-latency, high-throughput inference on Groq’s LPU-based hardware. Provides hosted model serving endpoints, batching and throughput-optimized features for production LLM inference.
Alternatives to GroqCloud API
What replacing GroqCloud API actually involves
Every option on this page is open source and free to run on your own hardware, so you own the data and there is no subscription to cancel. 1 of 1 shipped a commit in the last six months. Licences in this list: MIT. In exchange you take on hosting, backups and updates yourself.
Browse everything in GenAI & LLM Platforms.
