#1
Opik is an open-source platform to trace, evaluate, and monitor LLM apps, RAG pipelines, and agent workflows with automated evaluations and production dashboards.
21.8k stars1.7k forksApache-2.0last commit Actively maintained
2 self-hosted OpenLLMetry alternatives
OpenLLMetry is an OpenTelemetry-based observability SDK and set of instrumentations for LLM/GenAI applications. It traces prompts, chains, model calls and vector DB interactions and emits OpenTelemetry-compatible metrics and traces to observability backends.
Alternatives to OpenLLMetry
#2
Agenta is an open-source LLMOps platform with a prompt playground, prompt/version management, LLM evaluation, and production observability for LLM apps.
4.7k stars662 forkslast commit Actively maintained
What replacing OpenLLMetry actually involves
Every option on this page is open source and free to run on your own hardware, so you own the data and there is no subscription to cancel. 2 of 2 shipped a commit in the last six months. Licences in this list: Apache-2.0. In exchange you take on hosting, backups and updates yourself.
Browse everything in MLOps & Experiment Tracking.