Langfuse is an open-source LLM engineering platform for tracing, metrics, evaluations, datasets, and prompt management to debug and improve AI applications.

33.8k stars3.6k forkslast commit Actively maintained
Helicone is an LLM observability platform that logs and analyzes API requests (e.g., OpenAI) to monitor latency, cost, errors, and prompt/response data for debugging, performance monitoring, and usage analytics of LLM-powered applications.
Langfuse is an open-source LLM engineering platform for tracing, metrics, evaluations, datasets, and prompt management to debug and improve AI applications.

33.8k stars3.6k forkslast commit Actively maintained
Opik is an open-source platform to trace, evaluate, and monitor LLM apps, RAG pipelines, and agent workflows with automated evaluations and production dashboards.

21.6k stars1.7k forksApache-2.0last commit Actively maintained
Agenta is an open-source LLMOps platform with a prompt playground, prompt/version management, LLM evaluation, and production observability for LLM apps.

4.6k stars641 forkslast commit Actively maintained
Every option on this page is open source and free to run on your own hardware, so you own the data and there is no subscription to cancel. 3 of 3 shipped a commit in the last six months. Licences in this list: Apache-2.0. In exchange you take on hosting, backups and updates yourself.
Browse everything in MLOps & Experiment Tracking.