Monitoring
Health checks
Redpanda Connect serves two HTTP endpoints for health checks:
-
/pingcan be used as a liveness probe as it always returns a 200. -
/readycan be used as a readiness probe as it serves a 200 only when both the input and output are connected, otherwise a 503 is returned.
Metrics
Redpanda Connect exposes lots of metrics either to Statsd, Prometheus, Cloudwatch or for debugging purposes an HTTP endpoint that returns a JSON formatted object.
The target destination of Redpanda Connect metrics is configurable from the metrics section, where it’s also possible to rename and restrict the metrics that are emitted with mappings.
Pipeline status events
|
This component requires an enterprise license. You can either upgrade to an Enterprise Edition license, or generate a trial license key that’s valid for 30 days. |
Redpanda Connect can emit real-time status events to a Kafka topic as pipelines start, run, and stop. Status events provide:
-
Pipeline lifecycle tracking (initialization, running, shutdown)
-
Connection health monitoring with 30-second heartbeats
-
Detailed error information when connections fail
-
Graceful vs. error shutdown detection
For configuration and monitoring details, see Monitor Pipeline Status.
Tracing
Redpanda Connect also emits opentracing events to a tracer of your choice, which can be used to visualise the processors within a pipeline.