Openlit

Open Source Apache-2.0

Platform for AI Engineering: OpenTelemetry-native LLM Observability, GPU Monitoring, Guardrails, Evaluati

Difficulty
●●● Advanced
Last check
2026-05-18

Description

Open source platform for AI Engineering: OpenTelemetry-native LLM Observability, GPU Monitoring, Guardrails, Evaluations, Prompt Management, Vault, Playground. πŸš€πŸ’» Integrates with 50+ LLM Providers, VectorDBs, Agent Frameworks and GPUs.

Preview

Openlit Preview

Platforms

Linux Docker

Replaces the following proprietary tools

Datadog Openlit
New Relic Openlit
PagerDuty Openlit

Self-Hosting

Openlit can be self-hosted on your own infrastructure. Visit the official documentation for installation instructions.

Documentation β†’

Tags

#ai-observability #amd-gpu #clickhouse #distributed-tracing #genai #gpu-monitoring #grafana
← Back to Monitoring & Observability