Openlit

Open Source Apache-2.0

Open source platform for AI Engineering: OpenTelemetry-native LLM Observability, GPU Monitoring, Guardrails, Evaluati...

Difficulty
โ—โ—โ— Advanced
Last check
2026-03-01

Description

Open source platform for AI Engineering: OpenTelemetry-native LLM Observability, GPU Monitoring, Guardrails, Evaluations, Prompt Management, Vault, Playground. ๐Ÿš€๐Ÿ’ป Integrates with 50+ LLM Providers, VectorDBs, Agent Frameworks and GPUs.

Preview

Openlit Preview

Platforms

Linux Docker

Replaces the following proprietary tools

Datadog Openlit
New Relic Openlit
PagerDuty Openlit

Self-Hosting

Openlit can be self-hosted on your own infrastructure. Visit the official documentation for installation instructions.

Documentation โ†’

Tags

#ai-observability #amd-gpu #clickhouse #distributed-tracing #genai #gpu-monitoring #grafana
โ† Back to Monitoring & Observability