#1
Langfuse is an open-source LLM engineering platform for tracing, metrics, evaluations, datasets, and prompt management to debug and improve AI applications.
33.8k stars3.6k forkslast commit Actively maintained
3 self-hosted PromptLayer alternatives
PromptLayer is a SaaS platform for managing, testing, and observing prompts and LLM outputs. It provides a prompt registry with versioning and visual editing, A/B and regression testing, evaluation pipelines, request tracing and logs, and usage/cost/latency monitoring.
Alternatives to PromptLayer
#2
Opik is an open-source platform to trace, evaluate, and monitor LLM apps, RAG pipelines, and agent workflows with automated evaluations and production dashboards.
21.6k stars1.7k forksApache-2.0last commit Actively maintained
#3
Agenta is an open-source LLMOps platform with a prompt playground, prompt/version management, LLM evaluation, and production observability for LLM apps.
4.6k stars641 forkslast commit Actively maintained
What replacing PromptLayer actually involves
Every option on this page is open source and free to run on your own hardware, so you own the data and there is no subscription to cancel. 3 of 3 shipped a commit in the last six months. Licences in this list: Apache-2.0. In exchange you take on hosting, backups and updates yourself.
Browse everything in MLOps & Experiment Tracking.
