OpenTelemetry

Send OpenTelemetry (OTEL) traces from LiteLLM to Qualifire for complete observability across your LLM calls.

Looking for real-time guardrails? Check out the Qualifire Guardrails Integration for content moderation, prompt injection detection, and more.

Pre-Requisites

Create an account on Qualifire
Get your API key from the Qualifire dashboard

pip install litellm

Quick Start

Use just 2 lines of code to send OpenTelemetry traces across all providers to Qualifire.

litellm.callbacks = ["otel"]

import litellm
import os

# Set OpenTelemetry configuration for Qualifire
os.environ["OTEL_EXPORTER"] = "otlp_http"
os.environ["OTEL_ENDPOINT"] = "https://proxy.qualifire.ai/api/telemetry"
os.environ["OTEL_HEADERS"] = "X-Qualifire-API-Key=your-qualifire-api-key"

# LLM API Keys
os.environ["OPENAI_API_KEY"] = "your-openai-api-key"

# Set otel as a callback & LiteLLM will send traces to Qualifire
litellm.callbacks = ["otel"]

# OpenAI call
response = litellm.completion(
  model="gpt-4o",
  messages=[
    {"role": "user", "content": "Hi 👋 - i'm openai"}
  ]
)

Using with LiteLLM Proxy

Setup config.yaml

Configure the LiteLLM proxy with OpenTelemetry callback:

model_list:
  - model_name: gpt-4o
    litellm_params:
      model: openai/gpt-4o
      api_key: os.environ/OPENAI_API_KEY

litellm_settings:
  callbacks: ["otel"]

general_settings:
  master_key: "sk-1234"

environment_variables:
  OTEL_EXPORTER: "otlp_http"
  OTEL_ENDPOINT: "https://proxy.qualifire.ai/api/telemetry"
  OTEL_HEADERS: "X-Qualifire-API-Key=your-qualifire-api-key"

Start the proxy

litellm --config config.yaml

Test it!

curl -X POST 'http://0.0.0.0:4000/chat/completions' \
-H 'Content-Type: application/json' \
-H 'Authorization: Bearer sk-1234' \
-d '{ "model": "gpt-4o", "messages": [{"role": "user", "content": "Hello!"}]}'

Environment Variables

All three environment variables are required for OTEL tracing. The OTEL_HEADERS variable must include your Qualifire API key.

Variable	Description
`OTEL_EXPORTER`	The exporter type. Use `otlp_http` for Qualifire
`OTEL_ENDPOINT`	Qualifire telemetry endpoint: `https://proxy.qualifire.ai/api/telemetry`
`OTEL_HEADERS`	Authentication header: `X-Qualifire-API-Key=<your-api-key>`

What Gets Traced?

Span & Timing Data

Start time, end time, and duration for each operation in the trace.

Request & Response Attributes

Model name, messages, parameters, generated content, and finish reason.

Token Usage & Errors

Prompt tokens, completion tokens, total tokens, and any exception details if the call fails. Custom metadata you add to requests is also captured.

Once data is in Qualifire, you can:

View end-to-end traces across your AI pipeline
Analyze latency and performance metrics
Debug issues with detailed span information
Correlate traces with evaluations and guardrail results

Get Started

Evaluations

Guardrails

Observability

Prompt Management

Integrations

Pre-Requisites

Quick Start

Using with LiteLLM Proxy

Environment Variables

What Gets Traced?

Additional Resources

​Pre-Requisites

​Quick Start

​Using with LiteLLM Proxy

​Environment Variables

​What Gets Traced?

​Additional Resources

Pre-Requisites

Quick Start

Using with LiteLLM Proxy

Environment Variables

What Gets Traced?

Additional Resources