What’s New in Redpanda
This topic includes new content added in version 26.2. For a complete list of all product updates, see the Redpanda release notes. See also:
Shadowing: migrate schemas from Confluent Schema Registry
Shadowing can now replicate schemas over the Schema Registry HTTP API, including from a Confluent Schema Registry. Both Confluent Cloud and Confluent Platform are supported. A shadow link continuously replicates subjects, versions, and compatibility settings into the shadow cluster’s Schema Registry, so your applications keep working after cutover without a separate schema migration step. You can also replicate only selected contexts or subjects, and map source contexts to different destination contexts.
Shadowing: role synchronization
Shadow links can now replicate cluster roles from the source cluster to the shadow cluster, alongside topics, ACLs, consumer group offsets, and Schema Registry data. This ensures equivalent RBAC is in place on the shadow cluster prior to failover. Configure role filters to select which roles to sync.
See Configure Shadowing.
Shadowing support for Cloud Topics
Shadow links now support Cloud Topics, so you can include Cloud Topics in disaster recovery replication alongside standard topics.
See Configure Shadowing.
Kafka 4.x client compatibility
Redpanda version 26.2 validates a broader set of non-Java Apache Kafka® clients at their current versions that support Kafka 4.x, in addition to the Apache Kafka Java client. Newly validated clients include confluent-kafka-go and Sarama for Go, and kafka-python and confluent-kafka-python for Python. Validation confirms connectivity and correctness across core Kafka APIs, such as produce, consume, and transaction operations.
See Kafka Compatibility for the full list of validated clients and known exceptions.
Deferred upgrade finalization
You can now keep a feature-release upgrade open, soak testing the new version with a guaranteed rollback path, and finalize the upgrade when you are ready. For clusters in a Shadowing topology, new guidance covers upgrade order: upgrade the shadow cluster before the source cluster, and use deferred finalization for bidirectional topologies.
Fetch read coalescing
When many consumers fetch the same partitions, each broker repeats the same read work for every consumer. Fetch read coalescing merges these redundant reads on each shard, reducing read CPU and memory consumption under high consumer fan-out. This Enterprise feature is disabled by default: enable it with the kafka_fetch_read_coalescing_enabled cluster property.
Per-entity client quota metrics
Aggregate quota metrics can confirm that throttling is happening at a broker level, but don’t reveal which user, client, or group of clients is utilizing a quota, or being throttled. Redpanda can now label throttle-time and throughput metrics with the identity of the throttled entity, so you can identify throttled users and clients by name and right-size quota values based on observed use. These metrics are disabled by default: enable them with the kafka_per_entity_quota_metrics cluster property.
See Manage Throughput.
Cloud Topics enabled by default
Cloud Topics no longer require a separate cluster property. When cloud storage is enabled for your cluster (cloud_storage_enabled set to true), you can create Cloud Topics immediately by setting the storage mode during topic creation. The cloud_topics_enabled cluster property is deprecated.
See Manage Cloud Topics.
Schema Registry context for Iceberg translation
Bind a topic’s Iceberg translation to a specific Schema Registry context using the new redpanda.schema.registry.context topic property, instead of always using the default context. This is useful for multi-tenant or per-environment schema isolation.
Iceberg key and header translation
Independently control how Redpanda translates a record’s key, value, and headers into the Iceberg table with a new section-based syntax for the redpanda.iceberg.mode topic property. You can decode keys and values using a schema registered in the Schema Registry, store keys or values as UTF-8 strings, or decode header values from raw bytes to strings. The key_value, value_schema_id_prefix, and value_schema_latest modes continue to work as shorthand for common combinations.
Iceberg health monitoring
Monitor the health of Iceberg topics with a new Admin API endpoint, including connectivity to the external REST catalog and per-partition commit lag. Use it to test the catalog connection and find the partitions with the highest commit lag.
Cluster health metrics
Redpanda can now export a cluster health summary as Prometheus metrics, so you can alert on overall cluster health, such as brokers down, leaderless partitions, or a missing controller, directly from your metrics system instead of polling rpk cluster health. The metrics mirror the output of rpk cluster health and are disabled by default.
To enable them, set health_monitor_metrics_enabled to true and restart your brokers. See Cluster health for the available metrics and query patterns.
Tiered Storage v2 (beta)
Tiered Storage v2 is a beta feature. It is not supported for production deployments. Beta features are available for users to test and provide feedback.
Tiered Storage is now available in two versions. Tiered Storage v2 (tiered_v2) adds full compaction support for topics stored in object storage: compaction runs on the data in object storage rather than on local data only, eventually retains only the latest value for each key across the entire partition, and removes tombstone records after the retention period configured by delete.retention.ms. Topics using Tiered Storage v2 can also be converted to and from Cloud Topics.
You enable both versions the same way, by setting redpanda.storage.mode=tiered on a topic. The default_redpanda_storage_mode_tiered_impl cluster property selects the version for new topics (tiered_v1 remains the default), and existing topics keep the version they were created with.
Redpanda CLI (rpk)
Redpanda 26.2 introduces the following rpk changes:
-
Deferred upgrade finalization commands: The new
rpk cluster upgradecommand group addsstatusandfinalize, so you can check whether an upgrade is pending finalization and finalize it when you are ready. See Defer Upgrade Finalization. -
rpk redpanda admincommands moved torpk cluster: The old commands keep working in this release as deprecated aliases, and each prints its replacement when you run it. See Deprecated Features for the full command migration table. -
New
k8smanaged plugin: Therpk k8splugin adds therpk k8s multiclustercommands to bootstrap TLS certificates and peer configuration, check deployment health, and collect diagnostics bundles for Stretch Clusters. Install it withrpk k8s install. -
New
checkmanaged plugin: Therpk checkplugin runs production readiness checks for a Redpanda deployment. Install it withrpk check install.
New configuration properties
Shadowing:
-
schema_registry_sync_memory_bytes: Maximum bytes of schema bodies held in memory while a schema registry link reconciles from the source -
schema_registry_sync_parallelism: Maximum number of schemas imported concurrently while a schema registry link reconciles from the source -
shadow_link_failover_batch_size: Maximum number of mirror topics in a single batched failover controller command
Schema Registry:
-
schema_registry_use_rpc: Use internal Redpanda RPCs for Schema Registry internal topic I/O
Metrics and monitoring:
-
health_monitor_metrics_enabled: Export the cluster health summary ascluster_health_*metrics -
kafka_per_entity_quota_metrics: Label quota throttle-time and throughput metrics with the identity of the throttled entity -
kafka_handler_latency_all: Enable latency histograms for all Kafka API handlers, instead of only the most important ones
Performance:
-
kafka_fetch_read_coalescing_enabled: Coalesce concurrent fetches of the same partition offset into one shared read -
code_hugepages_enabled: Map the Redpanda binary into hugepages
Tiered Storage:
-
default_redpanda_storage_mode_tiered_impl: Select Tiered Storage v1 or v2 for new topics that use thetieredstorage mode -
redpanda.storage.mode.impl: Report the Tiered Storage version of a topic, and optionally select it at topic creation
Iceberg:
-
redpanda.schema.registry.context: Bind a topic’s Iceberg translation to a specific Schema Registry context
Cloud Topics:
| Cloud Topics requires an Enterprise license. For more information, contact Redpanda sales. |
-
cloud_topics_compaction_disabled: Disable compaction of cloud topics -
cloud_topics_l1_reader_cache_eviction_timeout_ms: Time after which idle L1 readers are evicted from the per-shard reader cache -
cloud_topics_l1_reader_cache_max_size: Maximum number of L1 readers cached per shard -
cloud_topics_l1_streaming_read_chunk_size: Maximum bytes buffered in memory by a cache-bypassing L1 streaming read -
cloud_topics_leveling_disabled: Disable leveling of cloud topics -
cloud_topics_leveling_interval_ms: How often to scan managed cloud-topic partitions for leveling work -
cloud_topics_leveling_max_range_bytes: Maximum total bytes per leveling job -
cloud_topics_leveling_min_extent_size_ratio: Size ratio below which an L1 extent is considered undersized and eligible for leveling -
cloud_topics_max_concurrent_leveling_jobs_per_shard: Maximum number of leveling jobs that may run concurrently on a single shard -
cloud_topics_metastore_block_cache_size: Size of the per-database uncompressed-block cache for the L1 metastore LSM database -
cloud_topics_metastore_max_pre_open_fibers: Number of fibers used to pre-open metastore SST files at database open time -
cloud_topics_metastore_retry_timeout_ms: Overall deadline for retrying an L1 metastore operation on transport errors -
cloud_topics_metastore_rpc_timeout_ms: Timeout for a single L1 metastore RPC to the metastore partition leader -
cloud_topics_metastore_sst_chunk_size: Size of the byte ranges used to read metastore SST files from object storage -
cloud_topics_metastore_write_buffer_size: Memtable size for the L1 metastore LSM database
Object storage I/O:
-
cloud_io_admission_control_policy: Admission policy for object storage I/O -
cloud_io_admission_control_reservation: Per-group reserved slots for thereservationadmission control policy
Changed property defaults
-
min_cleanable_dirty_ratioand the equivalentmin.cleanable.dirty.ratiotopic property: the default increased from0.2to0.5. Compaction now waits for a higher proportion of dirty bytes before a partition becomes eligible, reducing background compaction work on write-heavy clusters. -
schema_registry_enable_qualified_subjects: the default changed fromfalsetotrue. Schema Registry now accepts context-qualified subject names by default.
Deprecated properties
-
cloud_topics_enabled: Cloud Topics no longer require a separate enablement property and can be created whenever object storage is enabled for the cluster. -
space_management_enable_override: now formally deprecated. This property has been ignored since v23.3.
See Deprecated features for the complete list of deprecated properties.
Properties not available in this release
The following cluster properties were introduced in Redpanda v26.1.14 but are not included in v26.2.1. They are available starting in v26.2.2:
-
log_eviction_exempt_topics -
schema_registry_deferred_recovery -
schema_registry_replay_on_startup
If you upgrade from v26.1.14 to v26.2.1, any values you set for these properties are not honored until you upgrade to v26.2.2.
Simplified cluster administration commands: rpk redpanda admin deprecated
Cluster administration moves fully under rpk cluster: broker decommissioning, recommissioning, logger control, and per-broker configuration and partition listings now live alongside the other cluster commands, and rpk cluster info -b --detailed reports broker membership, liveness, and versions. The rpk redpanda admin command tree is deprecated and hidden from help output. The old commands still work and print a pointer to their replacements, but they are planned for removal in a future major release.
See Deprecated Features for the full command migration table.