rpk connect
Run and manage Redpanda Connect streaming pipelines. Redpanda Connect is a high-performance stream processor for mundane data engineering tasks.
For full details, see the Redpanda Connect documentation.
Subcommands
| Command | Description |
|---|---|
Manage Redpanda Connect agents. Agents allow you to build AI-powered workflows using Redpanda Connect resources. |
|
Execute Bloblang mappings from the command line. Provides a convenient tool for mapping JSON documents. |
|
Prints a new Redpanda Connect config to stdout containing specified components according to an expression. |
|
Test pipeline configurations by performing a dry run. Exits with a status code 1 if any connection errors are detected in a directory. |
|
Parse a config file and echo back a normalized version. This command is useful for sanity checking a config if it isn’t behaving as expected, as it shows you a normalised version after environment variables have been resolved. |
|
Shows a list of commands or help for one command. |
|
Install Redpanda Connect. This command installs the latest version by default. |
|
Check a Redpanda Connect configuration file for syntax errors and potential issues without running it. |
|
List available Redpanda Connect components. Shows inputs, outputs, processors, caches, rate limits, buffers, metrics, and tracers that can be used in pipelines. |
|
Execute an MCP server against a suite of Redpanda Connect resources. Each resource will be exposed as a tool that AI can interact with. |
|
Manage custom Redpanda Connect plugins. Use these commands to create and initialize plugin projects for extending Redpanda Connect with custom components. |
|
Run a Redpanda Connect pipeline from a configuration file. The pipeline streams data between inputs and outputs with optional processing. |
|
Run Redpanda Connect in streams mode, where multiple pipelines can be executed in a single process and can be created, updated, and removed via REST HTTP endpoints. The config field specified with the |
|
Work with Redpanda Connect templates. Templates allow you to define reusable configuration patterns. |
|
Run unit tests defined in Redpanda Connect configuration files to verify pipeline behavior. |
|
Uninstall the Redpanda Connect plugin. |
|
Upgrade to the latest Redpanda Connect version. |
Global flags
| Value | Type | Description |
|---|---|---|
|
string |
Redpanda or |
|
stringArray |
Override |
|
bool |
Ignore |
|
string |
|
|
bool |
Enable verbose logging. |