open_telemetry_collector

Send metrics to an Open Telemetry collector.

Exports Redpanda Connect metrics to one or more OpenTelemetry Collector endpoints over HTTP or gRPC for aggregation and onward export.

Metrics are encoded using the OpenTelemetry Metrics protocol and can be sent to any collector endpoint that supports OTLP.

You can configure multiple collector endpoints (both HTTP and gRPC simultaneously). All configured endpoints will receive the same metrics data. This is useful for redundancy or sending metrics to multiple observability platforms.

  • Common

  • Advanced

metrics:
  open_telemetry_collector:
    service: benthos
    http:
      - address: localhost:4318
        secure: false
    grpc:
      - address: localhost:4317
        secure: false
metrics:
  open_telemetry_collector:
    service: redpanda-connect-prod
    http:
      - address: otel-collector.prod.example.com:4318
        secure: true
    grpc:
      - address: otel-collector.prod.example.com:4317
        secure: true
    tags:
      environment: production
      region: us-east-1
      cluster: kafka-prod-01

Fields

grpc[]

A list of grpc collectors.

Type: object

grpc[].address

The endpoint of a collector to send events to.

Type: string

# Examples:
address: localhost:4317

grpc[].secure

Connect to the collector with client transport security

Type: bool

Default: false

http[]

A list of http collectors.

Type: object

http[].address

The endpoint of a collector to send events to.

Type: string

# Examples:
address: localhost:4318

http[].secure

Connect to the collector over HTTPS

Type: bool

Default: false

service

The name of the service in metrics.

Type: string

Default: benthos

tags

A map of tags to add to all exported metrics.

Type: string

Default: {}

Usage

The most common setup uses a local OpenTelemetry Collector running as a sidecar or daemon, which then forwards metrics to your observability backend:

metrics:
  open_telemetry_collector:
    service: my-service-name
    grpc:
      - address: localhost:4317

For production deployments with remote collectors, enable TLS:

metrics:
  open_telemetry_collector:
    service: my-service-name
    grpc:
      - address: otel-collector.example.com:4317
        secure: true

Use the tags field to add labels to all exported metrics for filtering and grouping in your observability platform:

metrics:
  open_telemetry_collector:
    service: my-service-name
    grpc:
      - address: localhost:4317
    tags:
      environment: production
      cluster: kafka-01