Langfuse is an open-source LLM engineering platform for tracing, metrics, evaluations, datasets, and prompt management to debug and improve AI applications.

34.2k stars3.7k forkslast commit Actively maintained
LangSmith is a SaaS observability and experimentation platform for LLM applications. It provides tracing, real-time monitoring and alerting, dataset and evaluation management, and experiment tracking to debug, test, and monitor prompts, chains, and agents in production.
Langfuse is an open-source LLM engineering platform for tracing, metrics, evaluations, datasets, and prompt management to debug and improve AI applications.

34.2k stars3.7k forkslast commit Actively maintained
Opik is an open-source platform to trace, evaluate, and monitor LLM apps, RAG pipelines, and agent workflows with automated evaluations and production dashboards.

21.8k stars1.7k forksApache-2.0last commit Actively maintained
Agenta is an open-source LLMOps platform with a prompt playground, prompt/version management, LLM evaluation, and production observability for LLM apps.

4.7k stars662 forkslast commit Actively maintained
Every option on this page is open source and free to run on your own hardware, so you own the data and there is no subscription to cancel. 3 of 3 shipped a commit in the last six months. Licences in this list: Apache-2.0. In exchange you take on hosting, backups and updates yourself.
Browse everything in MLOps & Experiment Tracking.