# What’s New in Redpanda Connect

> For the complete documentation index, see [llms.txt](https://docs.redpanda.com/llms.txt). Component-specific: [connect-full.txt](https://docs.redpanda.com/connect-full.txt)

---
title: What’s New in Redpanda Connect
latest-connect-version: 4.93.0
latest-operator-version: v26.1.4
latest-console-tag: v3.7.3
latest-redpanda-tag: v26.1.9
docname: whats-new
page-component-name: connect
page-version: master
page-component-version: master
page-component-title: Connect
page-relative-src-path: whats-new.adoc
page-edit-url: https://github.com/redpanda-data/rp-connect-docs/edit/main/modules/get-started/pages/whats-new.adoc
description: Summary of new features in Redpanda Connect.
page-git-created-date: "2024-11-14"
page-git-modified-date: "2026-05-26"
---

<!-- Source: https://docs.redpanda.com/connect/get-started/whats-new.md -->

This topic includes new content added from version 4.29.0 onwards.

For a full list of product updates, and details of updates prior to version 4.29.0, see the [Redpanda Connect changelog](https://github.com/redpanda-data/connect/blob/main/CHANGELOG.md). For new Cloud-specific features, see [What’s New in Redpanda Cloud](https://docs.redpanda.com/cloud-data-platform/get-started/whats-new-cloud/).

## [](#version-4-90-3)Version 4.90.3

[See the full release notes](https://github.com/redpanda-data/connect/releases/tag/v4.90.3).

### [](#salesforce-connector-refactoring)Salesforce connector refactoring

The `salesforce` processor (introduced in [version 4.85.0](#_version_4_85_0)) has been removed and replaced with dedicated input components that provide the same functionality with better separation of concerns. The [salesforce\_sink](https://docs.redpanda.com/connect/components/outputs/salesforce_sink/) output remains available.

| Component | Type | Status | Description |
| --- | --- | --- | --- |
| salesforce | Inputs | stable | Executes SOQL queries against Salesforce and returns the results as messages. |
| salesforce_cdc | Inputs | stable | Captures change data from Salesforce objects using the Pub/Sub API. |
| salesforce_graphql | Inputs | stable | Executes GraphQL queries against Salesforce and returns the results as messages. |

#### [](#migration-guide)Migration guide

To migrate from the removed `salesforce` processor, use the appropriate input component based on your use case:

| Previous processor feature | Replacement |
| --- | --- |
| SOQL queries | salesforce input |
| Change Data Capture (CDC) | salesforce_cdc input |
| GraphQL queries | salesforce_graphql input |

## [](#version-4-90-1)Version 4.90.1

[See the full release notes](https://github.com/redpanda-data/connect/releases/tag/v4.90.1).

## [](#version-4-90-0)Version 4.90.0

[See the full release notes](https://github.com/redpanda-data/connect/releases/tag/v4.90.0).

### [](#component-updates)Component updates

This release adds the following new component:

| Component | Type | Status | Description |
| --- | --- | --- | --- |
| gcp_bigquery_write_api | Outputs | stable | Writes messages to a BigQuery table using the Storage Write API. This provides higher throughput and lower latency than the legacy streaming API or load jobs. |

### [](#new-field-support)New field support

This release adds support for the following new fields:

| Field | Description | Affected components |
| --- | --- | --- |
| max_parallel_snapshot_tables | Specifies the number of tables that will be snapshotted in parallel. | Inputs:mysql_cdc |

## [](#version-4-89-3)Version 4.89.3

[See the full release notes](https://github.com/redpanda-data/connect/releases/tag/v4.89.3).

### [](#new-field-support-2)New field support

This release adds support for the following new fields:

| Field | Description | Affected components |
| --- | --- | --- |
| case_sensitive_columns | Controls how message field names are matched against table column names, and how column references in the partition spec are resolved. | Outputs:iceberg |

## [](#version-4-89-2)Version 4.89.2

[See the full release notes](https://github.com/redpanda-data/connect/releases/tag/v4.89.2).

## [](#version-4-89-1)Version 4.89.1

[See the full release notes](https://github.com/redpanda-data/connect/releases/tag/v4.89.1).

## [](#version-4-89-0)Version 4.89.0

[See the full release notes](https://github.com/redpanda-data/connect/releases/tag/v4.89.0).

### [](#new-field-support-3)New field support

This release adds support for the following new fields:

| Field | Description | Affected components |
| --- | --- | --- |
| default_timestamp_unit | The precision used when encoding TIMESTAMP logical types. | Processors:parquet_encode |

## [](#version-4-88-0)Version 4.88.0

[See the full release notes](https://github.com/redpanda-data/connect/releases/tag/v4.88.0).

### [](#component-updates-2)Component updates

This release adds the following new components:

| Component | Type | Status | Description |
| --- | --- | --- | --- |
| arc | Outputs | stable | This output sends data to an Arc columnar analytical database using its high-performance MessagePack ingestion endpoint. |
| open_telemetry_collector | Metrics | stable | Exports Redpanda Connect metrics to one or more OpenTelemetry Collector endpoints over HTTP or gRPC for aggregation and onward export. |

### [](#new-field-support-4)New field support

This release adds support for the following new fields:

| Field | Description | Affected components |
| --- | --- | --- |
| pdb_name | The name of the pluggable database (PDB) to monitor. When connecting to a CDB root, LogMiner output is scoped to this PDB via SRC_CON_NAME filtering and catalog queries use ALTER SESSION SET CONTAINER to switch context. | Inputs:oracledb_cdc |

### [](#deprecations-and-removals)Deprecations and removals

The MCP (Model Context Protocol) server feature in Redpanda Connect has been deprecated and removed. This includes:

-   All MCP server documentation

-   The following CLI commands:

    -   `rpk connect mcp-server`

    -   `rpk connect mcp-server init`

    -   `rpk connect mcp-server lint`



## [](#version-4-87-0)Version 4.87.0

[See the full release notes](https://github.com/redpanda-data/connect/releases/tag/v4.87.0).

### [](#new-field-support-5)New field support

This release adds support for the following new fields:

| Field | Description | Affected components |
| --- | --- | --- |
| checkpoint_cache_connection_string | An optional connection string for a remote Microsoft SQL Server to use for the checkpoint cache. When set, the checkpoint cache table is created on this remote server instead of the source database. | Inputs:microsoft_sql_server_cdc |
| wallet_path | Path to the Oracle Wallet directory. When set, SSL is enabled automatically. | Inputs:oracledb_cdc |
| wallet_password | Password for the ewallet.p12 PKCS#12 wallet file. Only required when the wallet directory contains ewallet.p12 rather than cwallet.sso. | Inputs:oracledb_cdc |
| message_properties_message_id | Set the message-id property on outgoing AMQP messages. The value is auto-detected as UUID, uint64, or string. | Outputs:amqp_1 |
| message_properties_correlation_id | Set the correlation-id property on outgoing AMQP messages. The value is auto-detected as UUID, uint64, or string. | Outputs:amqp_1 |
| message_properties_subject | Set the subject property on outgoing AMQP messages. This field supports Bloblang interpolation. | Outputs:amqp_1 |
| message_properties_reply_to | Set the reply-to property on outgoing AMQP messages. This field supports Bloblang interpolation. | Outputs:amqp_1 |
| message_properties_group_id | Set the group-id property on outgoing AMQP messages. This field supports Bloblang interpolation. | Outputs:amqp_1 |
| message_properties_group_sequence | Set the group-sequence property on outgoing AMQP messages. Must be a valid uint32 value. | Outputs:amqp_1 |
| message_properties_reply_to_group_id | Set the reply-to-group-id property on outgoing AMQP messages. This field supports Bloblang interpolation. | Outputs:amqp_1 |
| message_properties_user_id | Set the user-id property on outgoing AMQP messages. This field supports Bloblang interpolation. | Outputs:amqp_1 |
| message_properties_content_type | Set the content-type property on outgoing AMQP messages. This field supports Bloblang interpolation. | Outputs:amqp_1 |
| message_properties_content_encoding | Set the content-encoding property on outgoing AMQP messages. This field supports Bloblang interpolation. | Outputs:amqp_1 |

## [](#version-4-86-0)Version 4.86.0

[See the full release notes](https://github.com/redpanda-data/connect/releases/tag/v4.86.0).

### [](#component-updates-3)Component updates

This release adds the following new components:

| Component | Type | Status | Description |
| --- | --- | --- | --- |
| string_split | Processors | stable | Splits a string by a delimiter into an array. Generally, using bloblang’s split method is preferred. In some high performance use cases this processor can be faster than the equivalent bloblang if there is no additional logic. |

## [](#version-4-85-0)Version 4.85.0

[See the full release notes](https://github.com/redpanda-data/connect/releases/tag/v4.85.0).

### [](#bloblang-updates)Bloblang updates

This release adds the following new Bloblang capabilities:

-   Methods:

    -   [`escape_url_path`](https://docs.redpanda.com/connect/guides/bloblang/methods/#escape_url_path)

        Escapes a string so it can be safely placed inside a URL path segment, replacing special characters with percent-encoded sequences.

    -   [`parse_logfmt`](https://docs.redpanda.com/connect/guides/bloblang/methods/#parse_logfmt)

        Parses a logfmt-encoded string into an object of key-value pairs.

    -   [`unescape_url_path`](https://docs.redpanda.com/connect/guides/bloblang/methods/#unescape_url_path)

        Unescapes a URL path segment, converting percent-encoded sequences back to their original characters.



### [](#component-updates-4)Component updates

This release adds the following new components:

| Component | Type | Description |
| --- | --- | --- |
| oracledb_cdc | Inputs | Streams changes from an Oracle database for Change Data Capture (CDC). |
| salesforce_sink | Outputs | Consumes batches of messages and writes them to Salesforce. |
| salesforce | Processors | Fetches data from Salesforce based on input messages. |

### [](#new-field-support-6)New field support

This release adds support for the following new fields:

| Field | Description | Affected components |
| --- | --- | --- |
| client_name | Set the client name for the Redis connection. | Caches:redisInputs:redis_listredis_pubsubredis_scanredis_streamsOutputs:redis_hashredis_listredis_pubsubredis_streamsProcessors:redisredis_scriptRate-limits:redis |
| tables | List of table names to stream from. For single table mode, provide one table. | Inputs:aws_dynamodb_cdc |
| table_discovery_mode | Table discovery mode. | Inputs:aws_dynamodb_cdc |
| table_tag_filter | Multi-tag filter: 'key1:v1,v2;key2:v3,v4'. Matches tables with (key1=v1 OR key1=v2) AND (key2=v3 OR key2=v4). | Inputs:aws_dynamodb_cdc |
| table_discovery_interval | Interval for rescanning and discovering new tables when using tag or includelist mode. Set to 0 to disable periodic rescanning. | Inputs:aws_dynamodb_cdc |
| snapshot_mode | Snapshot behavior. | Inputs:aws_dynamodb_cdc |
| snapshot_segments | Number of parallel scan segments (1-10). Higher parallelism scans faster but consumes more RCUs. | Inputs:aws_dynamodb_cdc |
| snapshot_batch_size | Records per scan request during snapshot. Maximum 1000. | Inputs:aws_dynamodb_cdc |
| snapshot_throttle | Minimum time between scan requests per segment. Use this to limit RCU consumption during snapshot. | Inputs:aws_dynamodb_cdc |
| snapshot_deduplicate | Deduplicate records that appear in both snapshot and CDC stream. Requires buffering CDC events during snapshot. | Inputs:aws_dynamodb_cdc |
| snapshot_buffer_size | Maximum CDC events to buffer for deduplication (approximately 100 bytes per entry). If exceeded, deduplication is disabled and duplicates may be emitted. | Inputs:aws_dynamodb_cdc |
| create_stream | Whether to automatically create the stream if it doesn’t exist (requires the stream field to be set). | Inputs:nats_jetstream |
| extract_tracing_map | A Bloblang mapping that attempts to extract an object containing tracing propagation information, which will then be used as the root tracing span for the message. The specification of the extracted fields must match the format used by the service wide tracer. | Inputs:redpanda |
| id | The entry ID for the stream message. Allows function interpolations. | Outputs:redis_streams |
| inject_tracing_map | A Bloblang mapping used to inject an object containing tracing propagation information into outbound messages. The specification of the injected fields will match the format used by the service wide tracer. | Outputs:redpanda |
| sync_topic_interval | How often to synchronize topics from the source cluster to the destination. This creates destination topics for any new source topics, including empty topics with no message flow. | Outputs:redpanda_migrator |
| commit_backoff | Control how frequently Snowflake is polled to check if data has been committed. | Outputs:snowflake_streaming |
| timeout | HTTP request timeout. | Processors:jira |
| tls | Custom TLS settings can be used to override system defaults. | Processors:jira |
| proxy_url | HTTP proxy URL. Empty string disables proxying. | Processors:jira |
| disable_http2 | Disable HTTP/2 and force HTTP/1.1. | Processors:jira |
| tps_limit | Rate limit in requests per second. 0 disables rate limiting. | Processors:jira |
| tps_burst | Maximum burst size for rate limiting. | Processors:jira |
| backoff | Adaptive backoff configuration for 429 (Too Many Requests) responses. Always active. | Processors:jira |
| tcp | TCP socket configuration. | Processors:jira |
| http | HTTP transport settings controlling connection pooling, timeouts, and HTTP/2. | Processors:jira |
| access_log_level | Log level for HTTP request/response logging. Empty disables logging. | Processors:jira |
| access_log_body_limit | Maximum bytes of request/response body to include in logs. 0 to skip body logging. | Processors:jira |
| schema_metadata | When set, the processor reads a schema in benthos common schema format from this metadata key on each message, converts it to the format specified by format, registers it with the schema registry under the configured subject, and encodes the message. When empty (the default), the processor pulls the latest schema from the registry instead. | Processors:schema_registry_encode |
| format | The encoding format to use when converting a common schema from metadata. | Processors:schema_registry_encode |
| normalize | Whether to normalize the schema before registering with the schema registry (schema_metadata mode only). | Processors:schema_registry_encode |
| avro | Configuration for Avro encoding. | Processors:schema_registry_encode |
| continue | Indicates whether, if this case passes for a message, the next case should also be tested. | Processors:switch |

### [](#deprecations)Deprecations

The following fields are now deprecated:

| Field | Description | Affected components |
| --- | --- | --- |
| commit_timeout | Use max_elapsed_time instead. | Outputs:snowflake_streaming |
| avro_raw_json | Use avro.raw_json instead. | Processors:schema_registry_encode |

### [](#default-value-changes)Default value changes

This release includes the following default value changes:

| Field | Old default | New default | Description | Affected components |
| --- | --- | --- | --- | --- |
| target_address | none |  | The target address to write to. | Outputs:amqp_1 |
| commit_timeout | 60s |  | Use max_elapsed_time instead. | Outputs:snowflake_streaming |

### [](#removed-components)Removed components

The following deprecated components have been removed:

-   `legacy_redpanda_migrator` input and output

-   `legacy_redpanda_migrator_offsets` input and output

-   `redpanda_migrator_bundle` input and output


Use the unified [`redpanda_migrator`](https://docs.redpanda.com/connect/components/inputs/redpanda_migrator/) input and output instead.

## [](#version-4-81-0)Version 4.81.0

[See the full release notes](https://github.com/redpanda-data/connect/releases/tag/v4.81.0).

### [](#component-updates-5)Component updates

This release adds the following new components:

| Component | Type | Description |
| --- | --- | --- |
| aws_cloudwatch_logs | Input | Consumes log events from AWS CloudWatch Logs. |

### [](#new-field-support-7)New field support

This release adds support for the following new fields:

| Field | Description | Affected components |
| --- | --- | --- |
| timeout_seconds | The timeout in seconds, for querying the TigerBeetle cluster. | Inputs:tigerbeetle_cdc |
| subject | An optional subject to set for messages. | Outputs:aws_sns |
| shared_drives | Whether or not to include shared drives. | Processors:google_drive_downloadgoogle_drive_search |

## [](#version-4-80-0)Version 4.80.0

[See the full release notes](https://github.com/redpanda-data/connect/releases/tag/v4.80.0).

### [](#component-updates-6)Component updates

This release adds the following new components:

| Component | Type | Description |
| --- | --- | --- |
| iceberg | Output | Write data to Apache Iceberg tables via REST catalog. |

## [](#version-4-79-0)Version 4.79.0

[See the full release notes](https://github.com/redpanda-data/connect/releases/tag/v4.79.0).

### [](#component-updates-7)Component updates

This release adds the following new components:

| Component | Type | Description |
| --- | --- | --- |
| aws_dynamodb_cdc | Inputs | Consumes records from DynamoDB Streams with automatic checkpointing and shard management. |

### [](#new-field-support-8)New field support

This release adds support for the following new fields:

| Field | Description | Affected components |
| --- | --- | --- |
| encoding | Encoding format for messages in the batch. Options: 'protobuf' or 'json'. | Inputs:otlp_grpcotlp_http |
| schema_registry | Optional Schema Registry configuration for adding Schema Registry wire format headers to messages. | Inputs:otlp_grpcotlp_http |
| message_format | The format to expect incoming messages from the rest of the pipeline. | Outputs:snowflake_streaming |
| timestamp_format | The format to parse string values for TIMESTAMP, TIMESTAMP_LTZ and TIMESTAMP_NTZ columns. Should be a layout for time.Parse in Go. | Outputs:snowflake_streaming |

## [](#version-4-78-0)Version 4.78.0

[See the full release notes](https://github.com/redpanda-data/connect/releases/tag/v4.78.0).

### [](#new-field-support-9)New field support

This release adds support for the following new fields:

| Field | Description | Affected components |
| --- | --- | --- |
| tcp | TCP listener configuration for the HTTP server. | Inputs:http_server |

## [](#version-4-77-0)Version 4.77.0

[See the full release notes](https://github.com/redpanda-data/connect/releases/tag/v4.77.0).

### [](#component-updates-8)Component updates

This release adds the following new components:

| Component | Type | Description |
| --- | --- | --- |
| elasticsearch_v9 | Outputs | Publish messages into an Elasticsearch index. |

## [](#version-4-76-1)Version 4.76.1

[See the full release notes](https://github.com/redpanda-data/connect/releases/tag/v4.76.1).

## [](#version-4-76-0)Version 4.76.0

[See the full release notes](https://github.com/redpanda-data/connect/releases/tag/v4.76.0).

### [](#component-updates-9)Component updates

This release adds the following new components:

> 📝 **NOTE**
>
> Requires a cgo-enabled binary. See the [installation guides](https://docs.redpanda.com/connect/install/) for details.

### [](#new-field-support-10)New field support

This release adds support for the following new fields:

| Field | Description | Affected components |
| --- | --- | --- |
| tags | Global tags added to each metric. | Metrics:statsd |

## [](#version-4-75-0)Version 4.75.0

[See the full release notes](https://github.com/redpanda-data/connect/releases/tag/v4.75.0).

### [](#new-field-support-11)New field support

This release adds support for the following new fields:

| Field | Description | Affected components |
| --- | --- | --- |
| batching | Optional explicit batching policy for the output. Note that when batches are formed at the input level they can be expanded by this policy, but not contracted. | Outputs:redpanda |

## [](#version-4-74-0)Version 4.74.0

[See the full release notes](https://github.com/redpanda-data/connect/releases/tag/v4.74.0).

## [](#version-4-73-0)Version 4.73.0

[See the full release notes](https://github.com/redpanda-data/connect/releases/tag/v4.73.0).

### [](#new-field-support-12)New field support

This release adds support for the following new fields:

| Field | Description | Affected components |
| --- | --- | --- |
| tcp | TCP listener socket configuration. | Inputs:socket_server |
| ttl | An optional TTL to set for items. | Outputs:couchbaseProcessors:couchbase |
| schema_registry | Schema registry information to publish schemas for tracing data along with the data. | Tracers:redpanda |

## [](#version-4-72-0)Version 4.72.0

[See the full release notes](https://github.com/redpanda-data/connect/releases/tag/v4.72.0).

## [](#version-4-71-0)Version 4.71.0

[See the full release notes](https://github.com/redpanda-data/connect/releases/tag/v4.71.0).

### [](#component-updates-10)Component updates

This release adds the following new components:

| Component | Type | Description |
| --- | --- | --- |
| redpanda | Tracers | - |

### [](#new-field-support-13)New field support

This release adds support for the following new fields:

| Field | Description | Affected components |
| --- | --- | --- |
| aws | AWS IAM authentication configuration for PostgreSQL instances. When enabled, IAM credentials are used to generate temporary authentication tokens instead of a static password. | Inputs:pg_streampostgres_cdc |
| offset_header | Header name to add to migrated records containing the source offset for exact consumer group migration. If empty, no offset header is added and exact offset translation is disabled. | Outputs:redpanda_migrator |
| max_in_flight | Maximum number of batches to have in flight at any given time. For optimal throughput, set this to the total number of partitions being copied in parallel (up to all partitions in the cluster). | Outputs:redpanda_migrator |

## [](#version-4-70-0)Version 4.70.0

[See the full release notes](https://github.com/redpanda-data/connect/releases/tag/v4.70.0).

### [](#bloblang-updates-2)Bloblang updates

This release adds the following new Bloblang capabilities:

-   Functions:

    -   [`bytes`](https://docs.redpanda.com/connect/guides/bloblang/functions/#bytes): Create a new byte array that is zero initialized.


-   Methods:

    -   [`repeat`](https://docs.redpanda.com/connect/guides/bloblang/methods/#repeat): Creates a new array by repeating the elements of the input array a specified number of times.



### [](#new-field-support-14)New field support

This release adds support for the following new fields:

| Field | Description | Affected components |
| --- | --- | --- |
| tcp | Configure TCP socket-level settings to optimize network performance and reliability.Most users should keep the default values. Only modify these settings if you’re experiencing connection stability issues or have specific network requirements. | Config:redpandaCaches:aws_dynamodbaws_s3redpandaInputs:aws_kinesisaws_s3aws_sqskafka_franzlegacy_redpanda_migratorlegacy_redpanda_migrator_offsetsredpandaredpanda_migratorOutputs:aws_dynamodbaws_kinesisaws_kinesis_firehoseaws_s3aws_snsaws_sqskafka_franzlegacy_redpanda_migratorlegacy_redpanda_migrator_offsetsredpandaredpanda_migratorProcessors:aws_bedrock_chataws_bedrock_embeddingsaws_dynamodb_partiqlaws_lambdaMetrics:aws_cloudwatch |
| regexp_topics_include | A list of regular expression patterns for matching topics to consume from. When specified, the client will periodically refresh the list of matching topics based on the metadata_max_age interval. | Inputs:kafka_franzlegacy_redpanda_migratorredpandaredpanda_commonredpanda_migrator |
| regexp_topics_exclude | A list of regular expression patterns for excluding topics. Topics matching any of these patterns will be excluded from consumption, even if they match include patterns. | Inputs:kafka_franzlegacy_redpanda_migratorredpandaredpanda_commonredpanda_migrator |
| max_parallel_snapshot_tables | The number of tables that will be processed in parallel during the snapshot processing stage. | Inputs:microsoft_sql_server_cdc |
| tls | Custom TLS settings to override system defaults. | Inputs:pg_streampostgres_cdc |
| persistent | If set to true, the message is marked as persistent, ensuring it is stored durably and not lost if an intermediary (such as a broker) restarts. By default, messages are not durable. | Outputs:amqp_1 |
| target_capabilities | Lists the extension capabilities the sender desires from the target, such as support for queues, topics, durability, sharing, or temporary destinations. | Outputs:amqp_1 |
| message_properties_to | The node that is the intended destination of the message, which may differ from the node currently receiving the transfer. | Outputs:amqp_1 |
| provenance_header | Header name to add to migrated records indicating their source cluster. When set, each migrated message receives a header with this name containing the source cluster’s seed broker addresses, enabling downstream systems to track message origins for auditing, debugging, or multi-cluster orchestration workflows. | Outputs:redpanda_migrator |

### [](#deprecations-2)Deprecations

The following fields are now deprecated:

| Field | Description | Affected components |
| --- | --- | --- |
| regexp_topics | This boolean field is deprecated in favor of regexp_topics_include and regexp_topics_exclude, which provide more explicit control over topic pattern matching. To migrate, replace regexp_topics: true with regexp_topics_include containing your topic patterns, and optionally add regexp_topics_exclude to filter out specific topics. For example, if you had topics: ["events_."] with regexp_topics: true, change to regexp_topics_include: ["events_."]. | Inputs:kafka_franzlegacy_redpanda_migratorredpandaredpanda_commonredpanda_migrator |

### [](#default-value-changes-2)Default value changes

This release includes the following default value changes:

| Field | Old default | New default | Description | Affected components |
| --- | --- | --- | --- | --- |
| metadata_max_age | 5m | 1m | The default changed from 5m to 1m to provide more responsive topic and partition discovery. This means metadata refreshes occur more frequently by default. If you experience increased broker load or want to maintain the previous behavior, explicitly set this field to 5m. | Config:redpandaCaches:redpandaInputs:kafka_franzlegacy_redpanda_migratorlegacy_redpanda_migrator_offsetsredpandaredpanda_migratorOutputs:kafka_franzlegacy_redpanda_migratorlegacy_redpanda_migrator_offsetsredpandaredpanda_migrator |

## [](#version-4-68-0)Version 4.68.0

[See the full release notes](https://github.com/redpanda-data/connect/releases/tag/v4.68.0).

### [](#component-updates-11)Component updates

This release adds the following new components:

-   Processors:

    -   [`jira`](https://docs.redpanda.com/connect/components/processors/jira/): Executes Jira API queries based on input messages and returns structured results. The processor handles pagination, retries, and field expansion automatically.



This release adds support for the following new fields:

-   Inputs components

    -   [`redpanda`](https://docs.redpanda.com/connect/components/inputs/redpanda/):

        -   [`unordered_processing`](https://docs.redpanda.com/connect/components/inputs/redpanda/#unordered_processing) - Configures partition consumers to allow parallel and therefore unordered processing of messages of any given partition. This allows for better utilization of processing threads and asynchronous publishing at the output level. The maximum parallelization of each partition is determined by the checkpoint\_limit field.




### [](#deprecations-3)Deprecations

The `kafka`, `kafka_franz`, and `redpanda_common` inputs and outputs are now deprecated. Their functionality has been consolidated into the unified `redpanda` input and output components. Migrate existing configurations to use the new `redpanda` components for continued support and access to the latest features.

## [](#version-4-67-5)Version 4.67.5

[See the full release notes](https://github.com/redpanda-data/connect/releases/tag/v4.67.5).

### [](#component-updates-12)Component updates

This release adds the following new components:

-   Inputs:

    -   [`microsoft_sql_server_cdc`](https://docs.redpanda.com/connect/components/inputs/microsoft_sql_server_cdc/): Streams change data from a Microsoft SQL Server database into Redpanda Connect using Change Data Capture (CDC).



This release adds support for the following new fields:

-   Inputs components

    -   [`redpanda_migrator`](https://docs.redpanda.com/connect/components/inputs/redpanda_migrator/)

        -   [`schema_registry`](https://docs.redpanda.com/connect/components/inputs/redpanda_migrator/#schema_registry) - Configuration for schema registry integration. Enables migration of schema subjects, versions, and compatibility settings between clusters.



-   Outputs components

    -   [`redpanda_migrator`](https://docs.redpanda.com/connect/components/outputs/redpanda_migrator/)

        -   [`schema_registry`](https://docs.redpanda.com/connect/components/outputs/redpanda_migrator/#schema_registry) - Configuration for schema registry integration. Enables migration of schema subjects, versions, and compatibility settings between clusters.

        -   [`consumer_groups`](https://docs.redpanda.com/connect/components/outputs/redpanda_migrator/#consumer_groups) - Whether consumer group offset migration is enabled. When disabled, no consumer group operations are performed.

        -   [`topic_replication_factor`](https://docs.redpanda.com/connect/components/outputs/redpanda_migrator/#topic_replication_factor) - The replication factor for created topics. If not specified, inherits the replication factor from source topics. Useful when migrating to clusters with different sizes.

        -   [`sync_topic_acls`](https://docs.redpanda.com/connect/components/outputs/redpanda_migrator/#sync_topic_acls) - Whether to synchronize topic ACLs from source to destination cluster. ACLs are transformed safely: ALLOW WRITE permissions are excluded, and ALLOW ALL is downgraded to ALLOW READ to prevent conflicts.

        -   [`serverless`](https://docs.redpanda.com/connect/components/outputs/redpanda_migrator/#serverless) - Enable serverless mode for Redpanda Cloud serverless clusters. This restricts topic configurations and schema features to those supported by Redpanda Serverless environments.




### [](#deprecations-4)Deprecations

This release deprecates the individual migrator components and the bundle wrapper in favor of the unified `redpanda_migrator` architecture.

**Deprecated components:**

-   `redpanda_migrator` input and output (renamed to `legacy_redpanda_migrator`)

-   `redpanda_migrator_offsets` input and output (renamed to `legacy_redpanda_migrator_offsets`)

-   `redpanda_migrator_bundle` input and output (now deprecated; these are part of the legacy migration architecture and internally depend on the deprecated `legacy_redpanda_migrator` and `legacy_redpanda_migrator_offsets` components)


These components have been renamed from their previous versions (without the `legacy_` prefix) to preserve backward compatibility. The new `redpanda_migrator` components introduced in this release contain breaking changes. Existing configurations using the previous `redpanda_migrator` components should use these `legacy_` prefixed versions to maintain current functionality.

Users should migrate from deprecated components to the new unified `redpanda_migrator` input/output pair. For detailed migration instructions, see [Migrate to the Unified Redpanda Migrator](https://docs.redpanda.com/connect/guides/migration/migrate-unified-redpanda-migrator/).

## [](#version-4-66-0)Version 4.66.0

[See the full release notes](https://github.com/redpanda-data/connect/releases/tag/v4.66.0).

### [](#component-updates-13)Component updates

This release adds the following new components:

-   Outputs:

    -   [`cyborgdb`](https://docs.redpanda.com/connect/components/outputs/cyborgdb/): This output allows you to write vectors to a CyborgDB encrypted index. CyborgDB provides end-to-end encrypted vector storage with automatic dimension detection and index optimization.



All vector data is encrypted client-side before being sent to the server, ensuring complete data privacy. The encryption key never leaves your infrastructure.

-   Bloblang-functions:

    -   [`with_schema_registry_header`](https://docs.redpanda.com/connect/guides/bloblang/functions/#with_schema_registry_header): Prepends a 5-byte Schema Registry header to a message. The header consists of a magic byte (0x00) followed by a 4-byte big-endian schema ID.



This release adds support for the following new fields:

-   Inputs components

    -   [`cassandra`](https://docs.redpanda.com/connect/components/inputs/cassandra/)

        -   [`reconnect_interval`](https://docs.redpanda.com/connect/components/inputs/cassandra/#reconnect_interval) - Attempts to reconnect known DOWN nodes in every ReconnectInterval.

        -   [`exponential_reconnection`](https://docs.redpanda.com/connect/components/inputs/cassandra/#exponential_reconnection) - Optional exponential reconnection policy, this replaces the default constant policy of the driver.



-   Outputs components

    -   [`cassandra`](https://docs.redpanda.com/connect/components/outputs/cassandra/)

        -   [`reconnect_interval`](https://docs.redpanda.com/connect/components/outputs/cassandra/#reconnect_interval) - Attempts to reconnect known DOWN nodes in every ReconnectInterval.

        -   [`exponential_reconnection`](https://docs.redpanda.com/connect/components/outputs/cassandra/#exponential_reconnection) - Optional exponential reconnection policy, this replaces the default constant policy of the driver.




## [](#version-4-65-0)Version 4.65.0

[See the full release notes](https://github.com/redpanda-data/connect/releases/tag/v4.65.0).

### [](#component-updates-14)Component updates

This release adds the following new components:

-   Inputs:

    -   [`tigerbeetle_cdc`](https://docs.redpanda.com/connect/components/inputs/tigerbeetle_cdc/): Streams change data from a TigerBeetle database into Redpanda Connect.

        > 📝 **NOTE**
        >
        > The `tigerbeetle_cdc` input requires a CGO-enabled build of Redpanda Connect.
        >
        > For instructions, see:
        >
        > -   [Download a CGO-enabled binary](https://docs.redpanda.com/connect/install/prebuilt-binary/)
        >
        > -   [Build Redpanda Connect from source](https://docs.redpanda.com/connect/install/build-from-source/)


-   Scanners:

    -   [`json_array`](https://docs.redpanda.com/connect/components/scanners/json_array/): Scans a JSON array and emits each element as a separate message.



### [](#model-context-protocol-mcp-server)Model Context Protocol (MCP) server

You can now build and run an MCP server directly in Redpanda Connect. The MCP server lets you expose your Redpanda Connect configurations as AI-consumable HTTP endpoints, making them discoverable and callable by AI clients such as Claude Code and other compatible agents.

## [](#version-4-64-0)Version 4.64.0

[See the full release notes](https://github.com/redpanda-data/connect/releases/tag/v4.64.0).

### [](#component-updates-15)Component updates

This release adds support for the following new fields and improvements:

-   Schema registry decode processor:

    -   [`default_schema_id`](https://docs.redpanda.com/connect/components/processors/schema_registry_decode/#default_schema_id) field for specifying a fallback schema ID when decoding messages without an explicit schema reference.



## [](#version-4-62-0)Version 4.62.0

### [](#component-updates-16)Component updates

This release adds support for the following new fields and improvements:

-   Kafka, Redpanda, and Franz input components:

    -   [`timely_nacks_maximum_wait`](https://docs.redpanda.com/connect/components/inputs/kafka/#timely_nacks_maximum_wait) field for improved message delivery guarantees and SLA enforcement.

    -   [`timely_nacks_maximum_wait`](https://docs.redpanda.com/connect/components/inputs/kafka_franz/#timely_nacks_maximum_wait) field for improved message delivery guarantees and SLA enforcement.

    -   [`timely_nacks_maximum_wait`](https://docs.redpanda.com/connect/components/inputs/redpanda/#timely_nacks_maximum_wait) field for improved message delivery guarantees and SLA enforcement.


-   Redpanda Migrator and Redpanda Common input components:

    -   [`timely_nacks_maximum_wait`](https://docs.redpanda.com/connect/components/inputs/redpanda_migrator/#timely_nacks_maximum_wait) field for consistent negative acknowledgement handling.

    -   [`timely_nacks_maximum_wait`](https://docs.redpanda.com/connect/components/inputs/redpanda_common/#timely_nacks_maximum_wait) field for consistent negative acknowledgement handling.


-   Schema Registry output component:

    -   [`subject_compatibility_level`](https://docs.redpanda.com/connect/components/outputs/schema_registry/#subject_compatibility_level) field for explicit subject compatibility configuration.


-   Parquet Encode processor:

    -   [`schema_metadata`](https://docs.redpanda.com/connect/components/processors/parquet_encode/#schema_metadata) field for dynamic schema assignment during encoding.


-   Socket output component:

    -   [`Full TLS configuration support`](https://docs.redpanda.com/connect/components/outputs/socket/#tls), including all standard and mTLS fields, now deduplicated and centrally documented.


-   Bloblang:

    -   [`infer_schema`](https://docs.redpanda.com/connect/guides/bloblang/methods/#infer_schema) method attempts to infer the schema of a given value. The resulting schema can then be used as an input to schema conversion and enforcement methods.



## [](#version-4-61-0)Version 4.61.0

### [](#component-updates-17)Component updates

This release adds support for the following new fields:

-   Cassandra input and output components

    -   Input: [`host_selection_policy`](https://docs.redpanda.com/connect/components/inputs/cassandra/#host_selection_policy)

    -   Output: [`host_selection_policy`](https://docs.redpanda.com/connect/components/outputs/cassandra/#host_selection_policy)


-   Schema Registry output component

    -   [`normalize`](https://docs.redpanda.com/connect/components/outputs/schema_registry/#normalize)

    -   [`remove_metadata`](https://docs.redpanda.com/connect/components/outputs/schema_registry/#remove_metadata)

    -   [`remove_rule_set`](https://docs.redpanda.com/connect/components/outputs/schema_registry/#remove_rule_set)



## [](#version-4-60-0)Version 4.60.0

### [](#component-updates-18)Component updates

The 4.60.0 release adds support for the following fields:

-   NATS components

    -   `tls_handshake_first` - Enhanced TLS configuration option for NATS connections that require the initial TLS handshake to be performed before sending the NATS INFO protocol message. This is required when connecting to some NATS servers that expect TLS to be established immediately after connection, before any protocol negotiation.



This field is available in the following NATS components:

-   [`nats` input](https://docs.redpanda.com/connect/components/inputs/nats/#tls_handshake_first)

-   [`nats_jetstream` input](https://docs.redpanda.com/connect/components/inputs/nats_jetstream/#tls_handshake_first)

-   [`nats_kv` input](https://docs.redpanda.com/connect/components/inputs/nats_kv/#tls_handshake_first)

-   [`nats_stream` input](https://docs.redpanda.com/connect/components/inputs/nats_stream/#tls_handshake_first)

-   [`nats` output](https://docs.redpanda.com/connect/components/outputs/nats/#tls_handshake_first)

-   [`nats_jetstream` output](https://docs.redpanda.com/connect/components/outputs/nats_jetstream/#tls_handshake_first)

-   [`nats_kv` output](https://docs.redpanda.com/connect/components/outputs/nats_kv/#tls_handshake_first)

-   [`nats_stream` output](https://docs.redpanda.com/connect/components/outputs/nats_stream/#tls_handshake_first)

-   [`nats_kv` processor](https://docs.redpanda.com/connect/components/processors/nats_kv/#tls_handshake_first)

-   [`nats_request_reply` processor](https://docs.redpanda.com/connect/components/processors/nats_request_reply/#tls_handshake_first)

-   [`nats_kv` cache](https://docs.redpanda.com/connect/components/caches/nats_kv/#tls_handshake_first)


## [](#version-4-59-0)Version 4.59.0

### [](#redpanda-connect-in-redpanda-cloud-ga)Redpanda Connect in Redpanda Cloud: GA

Redpanda Connect is now generally available (GA) in all Redpanda Cloud clusters: BYOC (including BYOVPC/BYOVNet), Dedicated, and Serverless.

Redpanda Connect has been GA in Redpanda Streaming clusters since version 4.29.0.

### [](#component-updates-19)Component updates

This release adds support for the following fields:

-   SFTP input components

    -   [`connection_timeout`](https://docs.redpanda.com/connect/components/inputs/sftp/#connection_timeout)

    -   [`credentials.host_public_key`](https://docs.redpanda.com/connect/components/inputs/sftp/#credentials-host_public_key)

    -   [`credentials.host_public_key_file`](https://docs.redpanda.com/connect/components/inputs/sftp/#credentials-host_public_key_file)

    -   [`max_sftp_sessions`](https://docs.redpanda.com/connect/components/inputs/sftp/#max_sftp_sessions)


-   SFTP output components

    -   [`connection_timeout`](https://docs.redpanda.com/connect/components/outputs/sftp/#connection_timeout)

    -   [`credentials.host_public_key`](https://docs.redpanda.com/connect/components/outputs/sftp/#credentials-host_public_key)

    -   [`credentials.host_public_key_file`](https://docs.redpanda.com/connect/components/outputs/sftp/#credentials-host_public_key_file)


-   GCP Pub/Sub output components

    -   [`validate_topic`](https://docs.redpanda.com/connect/components/outputs/gcp_pubsub/#validate_topic)


-   Redpanda cache components

    -   [`allow_auto_topic_creation`](https://docs.redpanda.com/connect/components/caches/redpanda/#allow_auto_topic_creation)



## [](#version-4-58-2)Version 4.58.2

This release introduces an experimental Slack output and expands support for automatic topic creation across Redpanda-related components.

### [](#new-components)New components

-   [`slack_reaction`](https://docs.redpanda.com/connect/components/outputs/slack_reaction/): Adds or removes emoji reactions from Slack messages by channel ID and timestamp.


### [](#component-updates-20)Component updates

This release adds support for the `allow_auto_topic_creation` field in the following components:

-   [`redpanda`](https://docs.redpanda.com/connect/components/redpanda/about/) configuration block.

-   [`kafka_franz`](https://docs.redpanda.com/connect/components/outputs/kafka_franz/) output.

-   [`redpanda`](https://docs.redpanda.com/connect/components/outputs/redpanda/) output.

-   [`redpanda_migrator`](https://docs.redpanda.com/connect/components/outputs/redpanda_migrator/) output.


This field allows components to create topics automatically when publishing data, if the underlying Kafka/Redpanda broker is configured to allow it.

## [](#version-4-57-0)Version 4.57.0

This release adds support for the following fields:

-   `protobuf.use_proto_names`, `protobuf.use_enum_numbers`, `protobuf.emit_unpopulated`, and `protobuf.emit_default_values` in the [`schema_registry_decode` processor](https://docs.redpanda.com/connect/components/processors/schema_registry_decode/).


## [](#version-4-56-0)Version 4.56.0

This release introduces a dynamic [plugins](https://docs.redpanda.com/connect/plugins/about/) framework. It enables you to create and load custom plugins at runtime using any programming language that supports gRPC, with initial SDKs for Go and Python.

### [](#new-components-2)New components

-   [`gcp_spanner_cdc`](https://docs.redpanda.com/connect/components/inputs/gcp_spanner_cdc/): Streams change data from a Google Cloud Spanner instance.


### [](#component-updates-21)Component updates

This release adds support for the following fields:

-   `scope` in the [`couchbase`](https://docs.redpanda.com/connect/components/caches/couchbase/) cache.

-   `poll_interval` and `max_yield_batch_bytes` in the `redpanda_migrator_offsets` input.

-   `consumer_group_offsets_poll_interval` in the `redpanda_migrator_bundle` input.

-   `input_bundle_label` in the `redpanda_migrator_bundle` output.

-   `object_canned_acl` in the [`aws_s3`](https://docs.redpanda.com/connect/components/outputs/aws_s3/) output.

-   `history`, `max_tool_calls`, and `tools` in the [`gcp_vertex_ai_chat`](https://docs.redpanda.com/connect/components/processors/gcp_vertex_ai_chat/) processor.


## [](#version-4-55-1)Version 4.55.1

This release adds support for the following fields:

-   `is_serverless` in the [`redpanda_migrator`](https://docs.redpanda.com/connect/components/outputs/redpanda_migrator/) output.


## [](#version-4-55-0)Version 4.55.0

This release introduces a new beta Redpanda cache component and new fields across several inputs and outputs.

### [](#new-components-3)New components

-   [`redpanda`](https://docs.redpanda.com/connect/components/caches/redpanda/): A new cache that stores key/value pairs in a compacted Redpanda topic.


### [](#component-updates-22)Component updates

This release adds support for the following fields:

-   `steal_grace_period` in the [`aws_kinesis`](https://docs.redpanda.com/connect/components/inputs/aws_kinesis/) input.

-   `max_yield_batch_bytes` in:

    -   [`redpanda`](https://docs.redpanda.com/connect/components/inputs/redpanda/)

    -   [`redpanda_common`](https://docs.redpanda.com/connect/components/inputs/redpanda_common/)

    -   [`redpanda_migrator`](https://docs.redpanda.com/connect/components/inputs/redpanda_migrator/) input

    -   [`redpanda_migrator`](https://docs.redpanda.com/connect/components/outputs/redpanda_migrator/) output


-   `extras` in the [`sentry_capture`](https://docs.redpanda.com/connect/components/processors/sentry_capture/) processor.


### [](#removed-components-2)Removed components

The deprecated `elasticsearch` output has been removed. Use the [`elasticsearch_v8`](https://docs.redpanda.com/connect/components/outputs/elasticsearch_v8/) output instead.

### [](#new-bloblang-features)New Bloblang features

-   [`bitwise_and`](https://docs.redpanda.com/connect/guides/bloblang/methods/#bitwise_and), [`bitwise_or`](https://docs.redpanda.com/connect/guides/bloblang/methods/#bitwise_or), and [`bitwise_xor`](https://docs.redpanda.com/connect/guides/bloblang/methods/#bitwise_xor) methods added for performing bitwise operations on integers.


## [](#version-4-54-0-to-4-54-1)Version 4.54.0 to 4.54.1

These releases introduce the [`qdrant` processor](https://docs.redpanda.com/connect/components/processors/qdrant/), which allows you to query items within a Qdrant collection and filter the returned results.

### [](#component-updates-23)Component updates

These releases add:

-   The `topic_lag_refresh_period` field to the [`kafka_franz`](https://docs.redpanda.com/connect/components/inputs/kafka_franz/) and [`ockam_kafka`](https://docs.redpanda.com/connect/components/inputs/ockam_kafka/) inputs.

-   The `cache_duration` field to the [`schema_registry_decode` processor](https://docs.redpanda.com/connect/components/processors/schema_registry_decode/).

-   The `client_auth` field to the [`socket_server` input](https://docs.redpanda.com/connect/components/inputs/socket_server/).


You can also now use Bloblang to generate a [name-based UUID (version 5)](https://docs.redpanda.com/connect/guides/bloblang/methods/#uuid_v5) for a given string.

## [](#version-4-53-0)Version 4.53.0

This release introduces three new Google Drive processors:

-   [`google_drive_search` processor](https://docs.redpanda.com/connect/components/processors/google_drive_search/): Searches Google Drive for files that match a specified query and emits the results as a batch of messages.

-   [`google_drive_download` processor](https://docs.redpanda.com/connect/components/processors/google_drive_download/): Downloads files from Google Drive that contain matching file IDs.

-   [`google_drive_list_labels` processor](https://docs.redpanda.com/connect/components/processors/google_drive_list_labels/): Lists labels for files on a Google Drive.


The release also adds the [`cohere_rerank` processor](https://docs.redpanda.com/connect/components/processors/cohere_rerank/), which sends document strings to the Cohere API, and returns them ranked by their relevance to a specified query.

### [](#component-updates-24)Component updates

This release adds:

-   The `transaction_isolation_level` field to the following inputs: [`kafka_franz`](https://docs.redpanda.com/connect/components/inputs/kafka_franz/), [`ockam_kafka`](https://docs.redpanda.com/connect/components/inputs/ockam_kafka/), [`redpanda`](https://docs.redpanda.com/connect/components/inputs/redpanda/), [`redpanda_common`](https://docs.redpanda.com/connect/components/inputs/redpanda_common/), [`redpanda_migrator`](https://docs.redpanda.com/connect/components/inputs/redpanda_migrator/).

-   The `request_timeout_overhead` and `conn_idle_timeout` fields to the following components: [`kafka_franz` input](https://docs.redpanda.com/connect/components/inputs/kafka_franz/), [`redpanda` input](https://docs.redpanda.com/connect/components/inputs/redpanda/), [`redpanda_migrator` input](https://docs.redpanda.com/connect/components/inputs/redpanda_migrator/), [`kafka_franz` output](https://docs.redpanda.com/connect/components/outputs/kafka_franz/), [`redpanda` output](https://docs.redpanda.com/connect/components/outputs/redpanda/), [`redpanda_migrator` output](https://docs.redpanda.com/connect/components/outputs/redpanda_migrator/), `redpanda_migrator_offsets` output, [`redpanda` configuration service](https://docs.redpanda.com/connect/components/redpanda/about/).

-   The `start_offset` field to the following components: [`kafka_franz` input](https://docs.redpanda.com/connect/components/inputs/kafka_franz/), [`ockam_kafka` input](https://docs.redpanda.com/connect/components/inputs/ockam_kafka/), [`redpanda` input](https://docs.redpanda.com/connect/components/inputs/redpanda/), [`redpanda_common` input](https://docs.redpanda.com/connect/components/inputs/redpanda_common/), [`redpanda_migrator` input](https://docs.redpanda.com/connect/components/inputs/redpanda_migrator/).

-   The `topic_prefix` field to the [`redpanda_migrator` output](https://docs.redpanda.com/connect/components/outputs/redpanda_migrator/), and the `offset_topic_prefix` field to the `redpanda_migrator_offsets` output, to more easily identify migrated topics.

-   The `use_enum_numbers` field to the [`protobuf` processor](https://docs.redpanda.com/connect/components/processors/protobuf/).

-   The `dimensions` field to the [`cohere_embeddings` processor](https://docs.redpanda.com/connect/components/processors/cohere_embeddings/).

-   The `region`, `endpoint`, and `credentials` fields to the `dynamodb` section of the [`aws_kinesis` input](https://docs.redpanda.com/connect/components/inputs/aws_kinesis/).

-   A `tools` section to the [`cohere_chat` processor](https://docs.redpanda.com/connect/components/processors/cohere_chat/) to enhance response generation with agentic-like behavior.


### [](#deprecations-5)Deprecations

This release deprecates the `start_from_oldest` field from the following components: [`kafka_franz` input](https://docs.redpanda.com/connect/components/inputs/kafka_franz/), [`ockam_kafka` input](https://docs.redpanda.com/connect/components/inputs/ockam_kafka/), [`redpanda` input](https://docs.redpanda.com/connect/components/inputs/redpanda/), [`redpanda_common` input](https://docs.redpanda.com/connect/components/inputs/redpanda_common/), [`redpanda_migrator` input](https://docs.redpanda.com/connect/components/inputs/redpanda_migrator/). Now, you must use the `start_offset` field instead, which defaults to `earliest`. Redpanda recommends upgrading to benefit from this update.

## [](#version-4-52-0)Version 4.52.0

This release introduces three new Slack components:

-   [`slack_users` input](https://docs.redpanda.com/connect/components/inputs/slack_users/): Reads the full profiles of users in a Slack organization.

-   [`slack_thread` processor](https://docs.redpanda.com/connect/components/processors/slack_thread/): Reads all messages in a Slack thread.

-   [`slack_post` output](https://docs.redpanda.com/connect/components/outputs/slack_post/): Posts messages to Slack channel.


## [](#version-4-51-0)Version 4.51.0

Highlights of this update include the introduction of three new components that you could use as part of an AI toolchain:

-   [`git` input](https://docs.redpanda.com/connect/components/inputs/git/)

-   [`text_chunker` processor](https://docs.redpanda.com/connect/components/processors/text_chunker/)

-   [`slack` input](https://docs.redpanda.com/connect/components/inputs/slack/)


You can also now [install a FIPS-compliant version of Redpanda Connect](https://docs.redpanda.com/connect/get-started/quickstarts/rpk/#fips-compliance) (for RHEL/Debian Ubuntu).

### [](#component-updates-25)Component updates

This release adds:

-   The `private_key` field to the [`sftp` input](https://docs.redpanda.com/connect/components/inputs/sftp/) and [output](https://docs.redpanda.com/connect/components/outputs/sftp/)

-   The `history` field to the [`ollama_chat`](https://docs.redpanda.com/connect/components/processors/ollama_chat/) and [`openai_chat_completion`](https://docs.redpanda.com/connect/components/processors/openai_chat_completion/) processors, which allows you to include historical messages in a chat request.

-   The `handle_logical_types` fields to the [`parquet_decode` processor](https://docs.redpanda.com/connect/components/processors/parquet_decode/).

-   The `aggregate` operation to the [`mongodb` processor](https://docs.redpanda.com/connect/components/processors/mongodb/), which provides support for aggregation pipelines.

-   The `headers` option to the `type` field in the [`amqp_0_9` output](https://docs.redpanda.com/connect/components/outputs/amqp_0_9/).


## [](#version-4-50-0)Version 4.50.0

This release introduces agentic behavior to the [`openai_chat_completion` processor](https://docs.redpanda.com/connect/components/processors/openai_chat_completion/). You can now specify external tools to enrich the responses of OpenAI large language models.

### [](#component-updates-26)Component updates

This release:

-   Adds a set of `tools` fields to the [`openai_chat_completion` processor](https://docs.redpanda.com/connect/components/processors/openai_chat_completion/).

-   Extends support for FLOAT values in the [`snowflake_streaming` output](https://docs.redpanda.com/connect/components/outputs/snowflake_streaming/) to include special values, such as NaN (Not a Number), -inf (negative infinity), and inf (positive infinity).


Redpanda Connect also now supports the [`unicode_segments` Bloblang method](https://docs.redpanda.com/connect/guides/bloblang/methods/#unicode_segments), which splits a string into segments using [Unicode text segmentation rules](https://hexdocs.pm/unicode_string/readme.html#segmentation).

## [](#version-4-49-1)Version 4.49.1

This release introduces further updates to the [`postgres_cdc` input](https://docs.redpanda.com/connect/components/inputs/postgres_cdc/) and [`snowflake_streaming` output](https://docs.redpanda.com/connect/components/outputs/snowflake_streaming/).

### [](#component-updates-27)Component updates

This release adds:

-   Two new metrics to the [`snowflake_streaming` output](https://docs.redpanda.com/connect/components/outputs/snowflake_streaming/): `snowflake_register_latency_ns` and `snowflake_commit_latency_ns`.

-   An `ignore_nulls` option for schema evolution in the [`snowflake_streaming` output](https://docs.redpanda.com/connect/components/outputs/snowflake_streaming/).

-   The `translate_ids` field to the [`schema_registry` output](https://docs.redpanda.com/connect/components/outputs/schema_registry/).

-   The `translate_schema_ids` field to the `redpanda_migrator_bundle` output.


Also, the `translate_schema_ids` field in the [`redpanda_migrator` output](https://docs.redpanda.com/connect/components/outputs/redpanda_migrator/) now defaults to `false`.

#### [](#deprecations-6)Deprecations

This release deprecates the `snapshot_memory_factor` field from the [`postgres_cdc` input](https://docs.redpanda.com/connect/components/inputs/postgres_cdc/). Now, you must set a batch size, which defaults to `1000` messages. Redpanda recommends upgrading to benefit from this update.

## [](#version-4-48-1)Version 4.48.1

This release introduces a [change data capture (CDC) input for MongoDB](https://docs.redpanda.com/connect/components/inputs/mongodb_cdc/) on Cloud and Self-Managed Redpanda Connect, along with improvements to the [`postgres_cdc` input](https://docs.redpanda.com/connect/components/inputs/postgres_cdc/) and [`snowflake_streaming` output](https://docs.redpanda.com/connect/components/outputs/snowflake_streaming/).

### [](#component-updates-28)Component updates

This release adds:

-   The `heartbeat_interval` field to the [`postgres_cdc` input](https://docs.redpanda.com/connect/components/inputs/postgres_cdc/), which helps manage the size of the Write-Ahead Log when you subscribe to data changes from tables with low activity.

-   The `commit_timeout` field to the [`snowflake_streaming` output](https://docs.redpanda.com/connect/components/outputs/snowflake_streaming/).

-   The `url` field to the [`snowflake_streaming` output](https://docs.redpanda.com/connect/components/outputs/snowflake_streaming/), which allows you to override the default connection URL.

-   The `is_high_watermark` field to the `redpanda_migrator_offsets` output.

-   The `kafka_is_high_watermark` metadata field to the `redpanda_migrator_offsets` input.


Other changes:

-   You can now [load an Enterprise Edition license](https://docs.redpanda.com/connect/get-started/licensing/) using the `REDPANDA_LICENSE` environment variable.

-   The [`postgres_cdc` input](https://docs.redpanda.com/connect/components/inputs/postgres_cdc/) no longer adds the prefix `_rs` to the replication slots it creates.

-   The `clickhouse` driver is now supported in Redpanda Cloud for all components with the prefix `sql_`.

-   The [`redpanda migrator` output](https://docs.redpanda.com/connect/components/outputs/redpanda_migrator/) now attempts to transfer access control lists for topics that already exist on the destination broker.


## [](#version-4-47-0-to-4-47-1)Version 4.47.0 to 4.47.1

This release introduces:

-   The [`elasticsearch_v8` output](https://docs.redpanda.com/connect/components/outputs/elasticsearch_v8/): A certified, up-to-date alternative to the existing `elasticsearch` output.

-   The [`crash` processor](https://docs.redpanda.com/connect/components/processors/crash/): A tool for detecting unhandled pipeline errors during development and testing.


### [](#component-updates-29)Component updates

This release adds:

-   The `arguments` field to the [`amqp_0_9` input](https://docs.redpanda.com/connect/components/inputs/amqp_0_9/) and [output](https://docs.redpanda.com/connect/components/outputs/amqp_0_9/).

-   The `mapping` field (for Avro messages) to the [`schema_registry_decode` processor](https://docs.redpanda.com/connect/components/processors/schema_registry_decode/).

-   The `disable_http2` field to the [`http_client` input](https://docs.redpanda.com/connect/components/inputs/http_client/), [output](https://docs.redpanda.com/connect/components/outputs/http_client/), and [`http` processor](https://docs.redpanda.com/connect/components/processors/http/).

-   The `retry_on_conflict` field to the [`elasticsearch` output](https://docs.redpanda.com/connect/components/outputs/elasticsearch_v8/).


Redpanda Connect also now supports the [`uuid_v7` Bloblang function](https://docs.redpanda.com/connect/guides/bloblang/functions/#uuid_v7), which is useful for scenarios when the exact timing of events is important, such as during data migration or replication.

## [](#version-4-46-0)Version 4.46.0

This release introduces a [change data capture (CDC) input for MySQL](https://docs.redpanda.com/connect/components/inputs/mysql_cdc/), and enhancements to the [Bloblang playground](https://docs.redpanda.com/connect/guides/bloblang/playground/), making it easier to test and debug your pipeline configurations. The enhancements include:

-   A **Run** button in Bloblang code snippets, which opens each snippet in the playground with a pre-filled input and mapping ready for testing.

-   A **Get help from AI** button, which appears in the playground when an error occurs.


### [](#components-for-cloud-and-self-managed-redpanda-connect-beta)Components for Cloud and Self-Managed Redpanda Connect (beta)

-   [`mysql_cdc` input](https://docs.redpanda.com/connect/components/inputs/mysql_cdc/)


### [](#component-updates-30)Component updates

This release adds:

-   The `instance_id` field to the [`kafka`](https://docs.redpanda.com/connect/components/inputs/kafka/), [`kafka_franz`](https://docs.redpanda.com/connect/components/inputs/kafka_franz/), [`ockam_kafka`](https://docs.redpanda.com/connect/components/inputs/ockam_kafka/), [`redpanda`](https://docs.redpanda.com/connect/components/inputs/redpanda/), [`redpanda_common`](https://docs.redpanda.com/connect/components/inputs/redpanda_common/), and [`redpanda_migrator`](https://docs.redpanda.com/connect/components/inputs/redpanda_migrator/) inputs.

-   The `rebalance_timeout`, `session_timeout`, and `heartbeat_interval` fields to the [`kafka_franz`](https://docs.redpanda.com/connect/components/inputs/kafka_franz/), [`ockam_kafka`](https://docs.redpanda.com/connect/components/inputs/ockam_kafka/), [`redpanda`](https://docs.redpanda.com/connect/components/inputs/redpanda/), [`redpanda_common`](https://docs.redpanda.com/connect/components/inputs/redpanda_common/), and [`redpanda_migrator`](https://docs.redpanda.com/connect/components/inputs/redpanda_migrator/) inputs.

-   The `preserve_logical_types` and `raw_unions` fields (for Avro messages), and a `schema_id` metadata field to the [`schema_registry_decode`](https://docs.redpanda.com/connect/components/processors/schema_registry_decode/) processor.

-   The `unchanged_toast_value` field to the [`postgres_cdc` input](https://docs.redpanda.com/connect/components/inputs/postgres_cdc/).

-   A `processors` field to the `schema_evolution` object in the [`snowflake_streaming` output](https://docs.redpanda.com/connect/components/outputs/snowflake_streaming/).

-   New default values to the `max_message_bytes` and `broker_write_max_bytes` fields in the [`kafka_franz`](https://docs.redpanda.com/connect/components/outputs/kafka_franz/), [`ockam_kafka`](https://docs.redpanda.com/connect/components/outputs/ockam_kafka/), [`redpanda`](https://docs.redpanda.com/connect/components/outputs/redpanda/), [`redpanda_migrator`](https://docs.redpanda.com/connect/components/outputs/redpanda_migrator/), and `redpanda_migrator_offsets` outputs, using IEC instead of SI units.


Other changes:

-   The [`postgres_cdc` input](https://docs.redpanda.com/connect/components/inputs/postgres_cdc/) no longer supports PostgreSQL 10 or 11.


#### [](#deprecations-7)Deprecations

All changes are backward-compatible. No action is required if you are using an earlier version of Redpanda Connect.

| Deprecated fields | Affected components |
| --- | --- |
| new_column_type_mapping | snowflake_streaming output |

## [](#version-4-45-0)Version 4.45.0

Highlights of this update include the beta release of two components for Self-Managed and Cloud Redpanda Connect, and [a new cookbook](https://docs.redpanda.com/connect/cookbooks/snowflake_ingestion/) that explains how to ingest data from a Redpanda topic into Snowflake using Snowpipe Streaming. You can also now share links to code snippets in the [Bloblang playground](https://docs.redpanda.com/connect/guides/bloblang/playground/) using the **Share link** button.

### [](#components-for-cloud-and-self-managed-redpanda-connect-beta-2)Components for Cloud and Self-Managed Redpanda Connect (beta)

-   `ollama_moderation` processor ([Self-Managed](https://docs.redpanda.com/connect/components/processors/ollama_moderation/), [Cloud](https://docs.redpanda.com/cloud-data-platform/develop/connect/components/processors/ollama_moderation/))

-   `redpanda_migrator_offsets` input (`Self-Managed`, `Cloud`)


### [](#component-updates-31)Component updates

This release adds:

-   The `max_outstanding_messages` and `message_timeout` fields to the [`aws_sqs` input](https://docs.redpanda.com/connect/components/inputs/aws_sqs/).

-   The `content_type` field to the [`amqp_1` output](https://docs.redpanda.com/connect/components/outputs/amqp_1/).

-   The `offset_token` field to the [`snowflake_streaming` output](https://docs.redpanda.com/connect/components/outputs/snowflake_streaming/).

-   The `save_prompt_metadata`, `max_tool_calls` fields and `tools` object to the [`ollama_chat` processor](https://docs.redpanda.com/connect/components/processors/ollama_chat/).

-   The `offset_topic`, `offset_group`, `offset_partition`, `offset_commit_timestamp` and `offset_metadata` fields to the `redpanda_migrator_offsets` output.

-   The `topic_lag_refresh_period` field to the [`redpanda`](https://docs.redpanda.com/connect/components/inputs/redpanda/) and [`redpanda_common`](https://docs.redpanda.com/connect/components/inputs/redpanda_common/) inputs.

-   The `redpanda_lag` metric to the [`redpanda`](https://docs.redpanda.com/connect/components/inputs/redpanda/) and [`redpanda_common`](https://docs.redpanda.com/connect/components/inputs/redpanda_common/) inputs.

-   The `fetch_max_wait` field to the [`kafka_franz`](https://docs.redpanda.com/connect/components/inputs/kafka_franz/), [`ockam_kafka`](https://docs.redpanda.com/connect/components/inputs/ockam_kafka/), [`redpanda`](https://docs.redpanda.com/connect/components/inputs/redpanda/), [`redpanda_common`](https://docs.redpanda.com/connect/components/inputs/redpanda_common/), and [`redpanda_migrator`](https://docs.redpanda.com/connect/components/inputs/redpanda_migrator/) inputs.

-   The `kafka_lag` metadata field to the [`redpanda`](https://docs.redpanda.com/connect/components/inputs/redpanda/) and [`redpanda_common`](https://docs.redpanda.com/connect/components/inputs/redpanda_common/) inputs.

-   The `avro_schema` and `avro_schema_fingerprint` metadata fields to the [`avro` scanner](https://docs.redpanda.com/connect/components/scanners/avro/).

-   The `label` field to [template test definitions](https://docs.redpanda.com/connect/configuration/templating/).

-   The `bloblang` scalar type to [template fields](https://docs.redpanda.com/connect/configuration/templating/).


Redpanda Connect now supports:

-   Interpolation functions for channel and table names in the [`snowflake_streaming` output](https://docs.redpanda.com/connect/components/outputs/snowflake_streaming/).

-   Calls to external tools when using the [`ollama_chat` processor](https://docs.redpanda.com/connect/components/processors/ollama_chat/).

-   The execution of multiple database queries as transactions when using the [`sql_raw` input](https://docs.redpanda.com/connect/components/inputs/sql_raw/), [output](https://docs.redpanda.com/connect/components/outputs/sql_raw/) and [processor](https://docs.redpanda.com/connect/components/processors/sql_raw/).

-   Using the [`label` metadata field](https://docs.redpanda.com/connect/configuration/templating/) within a template mapping to retrieve the template component `label` set in the corresponding configuration.

-   The following Bloblang functions for error handling: [`error_source_name`](https://docs.redpanda.com/connect/guides/bloblang/functions/#error_source_name), [`error_source_label`](https://docs.redpanda.com/connect/guides/bloblang/functions/#error_source_label), and [`error_source_path`](https://docs.redpanda.com/connect/guides/bloblang/functions/#error_source_path).


#### [](#deprecations-8)Deprecations

All changes are backward-compatible. No action is required if you are using an earlier version of Redpanda Connect.

| Deprecated fields | Affected components |
| --- | --- |
| batching | redpanda_migrator input, redpanda_migrator output |
| kafka_key, max_in_flight | redpanda_migrator_offsets output |
| batch_size, multi_header, replication_factor, replication_factor_override, output_resource | redpanda_migrator input |

## [](#version-4-44-0)Version 4.44.0

This release extends the functionality of the [`openai_chat_completion` processor](https://docs.redpanda.com/connect/components/processors/openai_chat_completion/) to include the following fields: `max_tokens`, `temperature`, `user`, `top_p`, `frequency_penalty`, `presence_penalty`, `seed`, and `stop`.

## [](#version-4-43-1)Version 4.43.1

This release introduces support for [trial licenses](https://docs.redpanda.com/connect/get-started/licensing/) for Self-Managed Redpanda Connect.

## [](#version-4-43-0)Version 4.43.0

This release renames the `pg_stream` input to [`postgres_cdc`](https://docs.redpanda.com/connect/components/inputs/postgres_cdc/).

The `postgres_cdc` input also no longer emits `mode` metadata, but sets the `operation` metadata field to `read` when a snapshot of a database is processed.

## [](#version-4-42-0)Version 4.42.0

This release introduces a [Bloblang playground](https://docs.redpanda.com/connect/guides/bloblang/playground/) where you can try out your Bloblang syntax and get immediate feedback. It also updates Redpanda Connect licensing checks for Redpanda Connect. Starting from version 4.42.0, you must [add your Enterprise Edition license](https://docs.redpanda.com/connect/get-started/licensing/) to Redpanda Connect before using any Enterprise connectors.

### [](#component-updates-32)Component updates

Redpanda Connect now supports:

-   A Google Cloud `spanner` driver for all SQL plugins.

-   The following complex data types for the [`pg_stream` input](https://docs.redpanda.com/connect/components/inputs/postgres_cdc/): JSONB, TEXT\[\], INET, TSVECTOR, TSRANGE, POINT, INTEGER\[\].

-   Parquet files for the [`bigquery` output](https://docs.redpanda.com/connect/components/inputs/gcp_bigquery_select/).


This release also adds an `exists` operator to the [`cache` processor](https://docs.redpanda.com/connect/components/processors/cache/).

## [](#version-4-41-0)Version 4.41.0

This release adds the `max_records_per_request` field to the [`aws_sqs` output](https://docs.redpanda.com/connect/components/outputs/aws_sqs/).

### [](#packaging-update)Packaging update

Starting from version 4.41.0, the `-cgo` suffixed Docker image is no longer available due to low demand and the unacceptable cadence with which the image base (Debian) receives security updates.

To create your own CGO builds, run the following command:

```bash
CGO_ENABLED=1 make TAGS=x_benthos_extra redpanda-connect.
```

## [](#version-4-40-0)Version 4.40.0

This update includes a beta release of:

-   The [`pg_stream` input](https://docs.redpanda.com/connect/components/inputs/postgres_cdc/), which captures data changes made to a PostgreSQL database in real time and streams them to Redpanda Connect.

-   The [`benchmark` processor](https://docs.redpanda.com/connect/components/processors/benchmark/), which provides message throughput statistics for a data pipeline.


It also introduces a new [Bloblang method for timestamps](https://docs.redpanda.com/connect/guides/bloblang/methods/#timestamp).

### [](#components-for-cloud-and-self-managed-redpanda-connect-beta-3)Components for Cloud and Self-Managed Redpanda Connect (beta)

-   [`pg_stream` input](https://docs.redpanda.com/connect/components/inputs/postgres_cdc/)

-   [`benchmark` processor](https://docs.redpanda.com/connect/components/processors/benchmark/)


### [](#component-updates-33)Component updates

This release adds:

-   The `metadata_max_age` field to the `redpanda_migrator_offsets` output.

-   The `timestamp_ms` field to the following outputs: [`ockam_kafka`](https://docs.redpanda.com/connect/components/outputs/ockam_kafka/), [`kafka`](https://docs.redpanda.com/connect/components/outputs/kafka/), [`kafka_franz`](https://docs.redpanda.com/connect/components/outputs/kafka_franz/), [`redpanda`](https://docs.redpanda.com/connect/components/outputs/redpanda/), [`redpanda_common`](https://docs.redpanda.com/connect/components/outputs/redpanda_common/), [`redpanda_migrator`](https://docs.redpanda.com/connect/components/outputs/redpanda_migrator/).

-   The `kafka_timestamp_ms` metadata field, which uses a Unix timestamp with millisecond precision, to the following inputs: [`kafka`](https://docs.redpanda.com/connect/components/inputs/kafka/), [`kafka_franz`](https://docs.redpanda.com/connect/components/inputs/kafka_franz/), [`redpanda`](https://docs.redpanda.com/connect/components/inputs/redpanda/), [`redpanda_common`](https://docs.redpanda.com/connect/components/inputs/redpanda_common/), [`redpanda_migrator`](https://docs.redpanda.com/connect/components/inputs/redpanda_migrator/).

-   The `translate_schema_ids` and `schema_registry_output_resource` to the [`redpanda_migrator` output](https://docs.redpanda.com/connect/components/outputs/redpanda_migrator/).

-   The `backfill_dependencies` and `input_resource` fields to the [`schema_registry` output](https://docs.redpanda.com/connect/components/outputs/schema_registry/).

-   Options to optimize the build of the data output from the [`snowflake_streaming` output](https://docs.redpanda.com/connect/components/outputs/snowflake_streaming/).


Other changes:

-   The following components now use the [Franz Kafka Schema Registry client library](https://github.com/twmb/franz-go/tree/master/pkg/sr): [`schema_registry` input](https://docs.redpanda.com/connect/components/inputs/schema_registry/) and [output](https://docs.redpanda.com/connect/components/outputs/schema_registry/), and the [`schema_registry_encode`](https://docs.redpanda.com/connect/components/processors/schema_registry_encode/) and [`schema_registry_decode`](https://docs.redpanda.com/connect/components/processors/schema_registry_decode/) processors.

-   The [`snowflake_streaming` output](https://docs.redpanda.com/connect/components/outputs/snowflake_streaming/) can now automatically create tables in Snowflake, when the `schema_evolution.enabled` field is set to `true`.


#### [](#deprecations-9)Deprecations

**Deprecated field**: `kafka_timestamp` metadata field

**Affected components**:

-   [`redpanda` input](https://docs.redpanda.com/connect/components/inputs/redpanda/)

-   [`redpanda_common` input](https://docs.redpanda.com/connect/components/inputs/redpanda_common/)


**Replaced by**: `kafka_timestamp_ms` metadata field

**Deprecated field**: `timestamp`

**Affected components**:

-   [`ockam_kafka` output](https://docs.redpanda.com/connect/components/outputs/ockam_kafka/)

-   [`kafka` output](https://docs.redpanda.com/connect/components/outputs/kafka/)

-   [`kafka_franz` output](https://docs.redpanda.com/connect/components/outputs/kafka_franz/)

-   [`redpanda` output](https://docs.redpanda.com/connect/components/outputs/redpanda/)

-   [`redpanda_common` output](https://docs.redpanda.com/connect/components/outputs/redpanda_common/)

-   [`redpanda_migrator` output](https://docs.redpanda.com/connect/components/outputs/redpanda_migrator/)


**Replaced by**: `timestamp_ms` field

**Action required**: Modify all systems that process these fields to ensure compatibility with the new field names.

## [](#version-4-39-0)Version 4.39.0

Highlights of this update include the beta release of three new components for Self-Managed and Cloud, including a new `snowflake_streaming` output. This release also includes additions to the `redpanda` family of components and introduces new features for Self-Managed.

### [](#components-for-cloud-and-self-managed-beta)Components for Cloud and Self-Managed (beta)

-   [`snowflake_streaming` output](https://docs.redpanda.com/connect/components/outputs/snowflake_streaming/)

-   [`timeplus` input](https://docs.redpanda.com/connect/components/inputs/timeplus/)

-   [`spicedb_watch` input](https://docs.redpanda.com/connect/components/inputs/spicedb_watch/)


### [](#additional-redpanda-components-beta)Additional `redpanda` components (beta)

-   `redpanda` ([input](https://docs.redpanda.com/connect/components/inputs/redpanda/) and [output](https://docs.redpanda.com/connect/components/outputs/redpanda/)): Consume message data from or send message data to Kafka brokers.

-   `redpanda_common` ([input](https://docs.redpanda.com/connect/components/inputs/redpanda_common/) and [output](https://docs.redpanda.com/connect/components/outputs/redpanda_common/)): Consume message data from or send message data to a Redpanda Kafka broker, using credentials from a common [`redpanda` configuration block](https://docs.redpanda.com/connect/components/redpanda/about/) (Self-Managed only).


### [](#features-in-self-managed)Features in Self-Managed

You can now:

-   Create an [allow list or deny list](https://docs.redpanda.com/connect/configuration/allow_and_deny_lists/) for a Redpanda Connect instance

-   Use the [`rpk connect` CLI flag `--secrets`](https://docs.redpanda.com/connect/configuration/secrets/#look-up-secrets-on-a-remote-system-at-runtime) to look up secrets on a remote system

-   Use the [`rpk connect` CLI flag `--disable-telemetry`](https://docs.redpanda.com/connect/configuration/telemetry/#disable-the-telemetry-service) to block the telemetry service


### [](#component-updates-34)Component updates

This release adds:

-   The `follow_redirects` field to the [`http` processor](https://docs.redpanda.com/connect/components/processors/http/).

-   The following fields to the [`redpanda` configuration service](https://docs.redpanda.com/connect/components/redpanda/about/):

    -   `metadata_max_age`

    -   `partitioner`

    -   `idempotent_write`

    -   `compression`

    -   `broker_write_max_bytes`


-   The `metadata_max_age` field to the [`kafka_franz` output](https://docs.redpanda.com/connect/components/outputs/kafka_franz/).

-   The following fields to the [`kafka_franz`](https://docs.redpanda.com/connect/components/inputs/kafka_franz/) and [`ockam_kafka`](https://docs.redpanda.com/connect/components/inputs/ockam_kafka/) inputs:

    -   `fetch_max_bytes`

    -   `fetch_min_bytes`

    -   `fetch_max_partition_bytes`


-   The `url` field of the [`aws_sqs` output](https://docs.redpanda.com/connect/components/outputs/aws_sqs/) now supports interpolation functions.


#### [](#deprecations-10)Deprecations

All changes are backward-compatible. No action is required if you are using an earlier version of Redpanda Connect.

| Deprecated fields | Affected components |
| --- | --- |
| auto_replay_nacks, sasl, metadata_max_age | ockam_kafka input |
| client_id, rack_id, sasl | ockam_kafka output |
| rack_id | kafka_franz output |

## [](#version-4-38-0)Version 4.38.0

This update includes the beta release of two new outputs for Cloud and Self-Managed, and the introduction of a [telemetry service](https://docs.redpanda.com/connect/configuration/telemetry/), which collects and sends anonymized usage statistics to Redpanda.

### [](#new-tooling)New tooling

A new Helm chart for deploying Redpanda Connect in Kubernetes is now available. This chart simplifies the deployment and configuration of Redpanda Connect, allowing you to manage and scale Redpanda Connect instances in Kubernetes environments.

To get started with the Helm chart, see [Get Started with the Redpanda Connect Helm Chart](https://docs.redpanda.com/connect/get-started/quickstarts/helm-chart/).

Or, see the release notes for the chart on [GitHub](https://github.com/redpanda-data/helm-charts/releases/tag/connect-3.0.0).

### [](#new-outputs-beta)New outputs (beta)

-   [`azure_data_lake_gen2`](https://docs.redpanda.com/connect/components/outputs/azure_data_lake_gen2/) (certified)

-   [`timeplus`](https://docs.redpanda.com/connect/components/outputs/timeplus/) (community)


### [](#component-updates-35)Component updates

This release adds:

-   The `checksum_algorithm` to the [`aws_s3` output](https://docs.redpanda.com/connect/components/outputs/aws_s3/).

-   The `private_key` field to the [`snowflake_put` output](https://docs.redpanda.com/connect/components/outputs/snowflake_put/).

-   The `nkey` field to the following components:

    -   `nats` ([input](https://docs.redpanda.com/connect/components/inputs/nats/), [output](https://docs.redpanda.com/connect/components/outputs/nats/))

    -   `nats_jetstream` ([input](https://docs.redpanda.com/connect/components/inputs/nats_jetstream/), [output](https://docs.redpanda.com/connect/components/outputs/nats_jetstream/))

    -   `nats_kv` ([input](https://docs.redpanda.com/connect/components/inputs/nats_kv/), [output](https://docs.redpanda.com/connect/components/outputs/nats_kv/), [processor](https://docs.redpanda.com/connect/components/processors/nats_kv/))

    -   `nats_stream` ([input](https://docs.redpanda.com/connect/components/inputs/nats_stream/), [output](https://docs.redpanda.com/connect/components/outputs/nats_stream/))

    -   `nats_request_reply` ([processor](https://docs.redpanda.com/connect/components/processors/nats_request_reply/))



Other changes:

-   The `collection` field of the [`mongodb` output](https://docs.redpanda.com/connect/components/outputs/mongodb/) now supports interpolation functions.

-   All components that used the deprecated `count` function, with a default value for the `path` field, now use the `counter` function.

    > 📝 **NOTE**
    >
    > If you have multiple components that execute a mapping using the deprecated `count` function with the original default value, and these counters need to cascade, there may be a change in behavior. To avoid this, explicitly define a value for the `path` field.


## [](#version-4-37-0)Version 4.37.0

Redpanda Connect has new bundled [Redpanda Migrator components](#redpanda-migrator-components-beta), more [AI processors](#ai-processors-beta) for Self-Managed and Cloud platforms, and three new [outputs](#certified-and-community-outputs-beta).

### [](#redpanda-migrator-components-beta)Redpanda Migrator components (beta)

You can now move workloads from any Apache Kafka system to Redpanda using the `redpanda_migrator_bundle` input and `output`.

For full details, see the Redpanda Migrator Cookbook for [Self-Managed](https://docs.redpanda.com/connect/cookbooks/redpanda_migrator/) and [Cloud](https://docs.redpanda.com/cloud-data-platform/develop/connect/cookbooks/redpanda_migrator/).

### [](#ai-processors-beta)AI processors (beta)

Some new additions to Redpanda Connect’s growing list of AI processors:

-   [`aws_bedrock_embeddings`](https://docs.redpanda.com/connect/components/processors/aws_bedrock_embeddings/)

-   [`cohere_chat`](https://docs.redpanda.com/connect/components/processors/cohere_chat/)

-   [`cohere_embeddings`](https://docs.redpanda.com/connect/components/processors/cohere_embeddings/)

-   [`gcp_vertex_ai_embeddings`](https://docs.redpanda.com/connect/components/processors/gcp_vertex_ai_embeddings/)


### [](#certified-and-community-outputs-beta)Certified and community outputs (beta)

-   [`couchbase`](https://docs.redpanda.com/connect/components/outputs/couchbase/) (community)

-   [`cypher`](https://docs.redpanda.com/connect/components/outputs/cypher/) (community)

-   [`questdb`](https://docs.redpanda.com/connect/components/outputs/questdb/) (certified)


### [](#component-updates-36)Component updates

This release adds:

-   The `metadata_max_age` field to [`kafka_franz`](https://docs.redpanda.com/connect/components/inputs/kafka_franz/) and [`redpanda_migrator`](https://docs.redpanda.com/connect/components/inputs/redpanda_migrator/) inputs.

-   The `fetch_in_order` field to the [`schema_registry` input](https://docs.redpanda.com/connect/components/inputs/schema_registry/).

-   The `encrypted_fields` fields to the `ockam_kafka` [input](https://docs.redpanda.com/connect/components/inputs/ockam_kafka/) and [output](https://docs.redpanda.com/connect/components/outputs/ockam_kafka/).


## [](#version-4-36-0)Version 4.36.0

You can now use the `replication_factor_override` and `replication_factor` fields of the [`redpanda_migrator` input](https://docs.redpanda.com/connect/components/inputs/redpanda_migrator/) and [output](https://docs.redpanda.com/connect/components/outputs/redpanda_migrator/) to set a replication factor for migrated topics.

## [](#versions-4-35-1-to-4-35-3)Versions 4.35.1 to 4.35.3

Redpanda Connect is now fully integrated with the Redpanda Cloud platform. This release adds Azure and GCP components to the growing list of available components. For a full list of components supported in Redpanda Cloud, see the [Connector Catalog](https://docs.redpanda.com/cloud-data-platform/develop/connect/components/about/).

## [](#version-4-35-0)Version 4.35.0

Redpanda Connect now includes beta versions of Redpanda Migrator components:

-   [`redpanda_migrator` input](https://docs.redpanda.com/connect/components/inputs/redpanda_migrator/) and [output](https://docs.redpanda.com/connect/components/outputs/redpanda_migrator/)

-   `redpanda_migrator_bundle` input and `output`

-   `redpanda_migrator_offsets` output


For full details, see the Redpanda Migrator Cookbook for [Self-Managed](https://docs.redpanda.com/connect/cookbooks/redpanda_migrator/) and [Cloud](https://docs.redpanda.com/cloud-data-platform/develop/connect/cookbooks/redpanda_migrator/).

### [](#component-updates-37)Component updates

This release adds:

-   OAuth, basic authentication, and JSON Web Token fields to the [`schema_registry` input](https://docs.redpanda.com/connect/components/inputs/schema_registry/) and [output](https://docs.redpanda.com/connect/components/outputs/schema_registry/).

-   The `job_project` field to the [`gcp_bigquery` output](https://docs.redpanda.com/connect/components/outputs/gcp_bigquery/).

-   The `broker_write_max_bytes` field to the [`kafka_franz`](https://docs.redpanda.com/connect/components/outputs/kafka_franz/) and [`ockam_kafka`](https://docs.redpanda.com/connect/components/outputs/ockam_kafka/) outputs.


## [](#version-4-34-0)Version 4.34.0

Redpanda Connect now includes beta versions of two new AI processors for Cloud and Self-Managed platforms:

-   [`aws_bedrock_chat`](https://docs.redpanda.com/connect/components/processors/aws_bedrock_chat/)

-   [`gcp_vertex_ai_chat`](https://docs.redpanda.com/connect/components/processors/gcp_vertex_ai_chat/)


## [](#version-4-33-0)Version 4.33.0

Redpanda Connect now includes beta versions of four new components.

### [](#for-self-managed-and-cloud-platforms)For Self-Managed and Cloud platforms

-   [`schema_registry` input](https://docs.redpanda.com/connect/components/inputs/schema_registry/) and [output](https://docs.redpanda.com/connect/components/outputs/schema_registry/)

-   [`qdrant` output](https://docs.redpanda.com/connect/components/outputs/qdrant/)


### [](#for-self-managed-only)For Self-Managed only

-   [`ockam_kafka` input](https://docs.redpanda.com/connect/components/inputs/ockam_kafka/) and [output](https://docs.redpanda.com/connect/components/outputs/ockam_kafka/)


You can also use the new Bloblang [`vector`](https://docs.redpanda.com/connect/guides/bloblang/methods/) method to create vector embeddings for SQL databases.

### [](#component-updates-38)Component updates

This release adds:

-   The `credentials_json` field to all GCP components.

-   The `content_md5` field to the [`aws_s3` output](https://docs.redpanda.com/connect/components/outputs/aws_s3/).

-   The `send_ack` field to the [`nats` input](https://docs.redpanda.com/connect/components/inputs/nats/).


## [](#version-4-32-1)Version 4.32.1

Redpanda Connect has a new batch of beta AI processors for Self-Managed and Cloud platforms.

### [](#for-self-managed-and-cloud-platforms-2)For Self-Managed and Cloud platforms

-   [`openai_chat_completion`](https://docs.redpanda.com/connect/components/processors/openai_chat_completion/)

-   [`openai_embeddings`](https://docs.redpanda.com/connect/components/processors/openai_embeddings/)

-   [`openai_image_generation`](https://docs.redpanda.com/connect/components/processors/openai_image_generation/)

-   [`openai_speech`](https://docs.redpanda.com/connect/components/processors/openai_speech/)

-   [`openai_transcription`](https://docs.redpanda.com/connect/components/processors/openai_transcription/)

-   [`openai_translation`](https://docs.redpanda.com/connect/components/processors/openai_translation/)


### [](#for-self-managed-only-2)For Self-Managed only

-   [`ollama_chat`](https://docs.redpanda.com/connect/components/processors/ollama_chat/)

-   [`ollama_embeddings`](https://docs.redpanda.com/connect/components/processors/ollama_embeddings/)


## [](#version-4-31-0)Version 4.31.0

Redpanda Connect now includes beta versions of two new components:

-   [`pinecone` output](https://docs.redpanda.com/connect/components/outputs/pinecone/) - Redpanda Connect’s first AI component

-   [`redpanda_data_transform` processor](https://docs.redpanda.com/connect/components/processors/redpanda_data_transform/)


### [](#component-updates-39)Component updates

This release adds:

-   Custom TLS fields for the [`splunk` input](https://docs.redpanda.com/connect/components/inputs/splunk/) and [`splunk_hec` output](https://docs.redpanda.com/connect/components/outputs/splunk_hec/).

-   The `timestamp` field to [`kafka`](https://docs.redpanda.com/connect/components/outputs/kafka/) and [`kafka_franz`](https://docs.redpanda.com/connect/components/outputs/kafka_franz/) outputs.

-   The `status_topic` field to the [`redpanda` component](https://docs.redpanda.com/connect/components/redpanda/about/).


## [](#version-4-30-0-to-4-30-1)Version 4.30.0 to 4.30.1

Redpanda Connect now includes a beta version of the [`splunk` input](https://docs.redpanda.com/connect/components/inputs/splunk/).

## [](#version-4-29-0)Version 4.29.0

Redpanda Connect now separates packages into an enterprise bundle and a free bundle, which contains community and selected certified connectors. To learn more about licensing and support levels, see [components:about.adoc#support-levels](https://docs.redpanda.com/connect/components/about/#support-levels).

### [](#component-updates-40)Component updates

This release adds:

-   The `auth.oauth2.scope` field to the [`pulsar` input](https://docs.redpanda.com/connect/components/inputs/pulsar/) and [output](https://docs.redpanda.com/connect/components/outputs/pulsar/).

-   The `subscription_initial_position` field to the [`pulsar` input](https://docs.redpanda.com/connect/components/inputs/pulsar/).