Tunable Configuration Properties

abort_index_segment_size

Capacity (in number of txns) of an abort index segment.

Default: 50000

abort_timed_out_transactions_interval_ms

How often to look for the inactive transactions and abort them.

Default: 60000

alter_topic_cfg_timeout_ms

Time to wait for entries replication in controller log when executing alter configuration request.

Default: 5000

append_chunk_size

Size of direct write operations to disk.

Default: 16384 (16KB)

cloud_storage_cache_check_interval

Timeout to check if cache eviction should be triggered.

Default: 30000

cloud_storage_enable_remote_read

Enable remote read for all topics.

Default: false

cloud_storage_enable_remote_write

Enable remote write for all topics.

Default: false

cloud_storage_initial_backoff_ms

Initial backoff time for exponetial backoff algorithm (ms).

Default: 100

cloud_storage_manifest_upload_timeout_ms

Manifest upload timeout (ms).

Default: 10000

cloud_storage_max_connection_idle_time_ms

Max https connection idle time (ms).

Default: 5000

cloud_storage_reconciliation_interval_ms

Interval at which the archival service runs reconciliation (ms).

Default: 10000

cloud_storage_segment_max_upload_interval_sec

Time that segment can be kept locally without uploading it to the remote storage (sec).

Default: Null

cloud_storage_segment_upload_timeout_ms

Log segment upload timeout (ms).

Default: 30000

cloud_storage_upload_ctrl_d_coeff

Derivative coefficient for upload PID controller.

Default: 0.0

cloud_storage_upload_ctrl_max_shares

Maximum number of IO and CPU shares that archival upload can use.

Default: 1000

cloud_storage_upload_ctrl_min_shares

Minimum number of IO and CPU shares that archival upload can use.

Default: 100

cloud_storage_upload_ctrl_p_coeff

Proportional coefficient for upload PID controller.

Default: -2.0

cloud_storage_upload_ctrl_update_interval_ms

No description.

Default: 60000

compacted_log_segment_size

How large in bytes should each compacted log segment be (default 256 MB).

Default: 268435456 (256 MB) Minimum = 1048576 (1 MB)

compaction_ctrl_backlog_size

Target backlog size for compaction controller. if not set compaction target compaction backlog would be equal to.

Default: Null

compaction_ctrl_d_coeff

Derivative coefficient for compaction PID controller.

Default: 0.2

compaction_ctrl_i_coeff

Integral coefficient for compaction PID controller.

Default: 0.0

compaction_ctrl_max_shares

Maximum number of IO and CPU shares that compaction process can use.

Default: 1000

compaction_ctrl_min_shares

Minimum number of IO and CPU shares that compaction process can use.

Default: 10

compaction_ctrl_p_coeff

Proportional coefficient for compaction PID controller. This has to be negative since compaction backlog should decrease when number of compaction shares increases.

Default: -12.5

compaction_ctrl_update_interval_ms

No description.

Default: 30000

controller_backend_housekeeping_interval_ms

Interval between iterations of controller backend housekeeping loop.

Default: 1000

coproc_max_batch_size

Maximum amount of bytes to read from one topic read.

Default: 32768 (32 KB)

coproc_max_inflight_bytes

Maximum amountt of inflight bytes when sending data to wasm engine.

Default: 10485760 (10 MB)

coproc_max_ingest_bytes

Maximum amount of data to hold from input logs in memory.

Default: 655360 (640 KB)

coproc_offset_flush_interval_ms

Interval for which all coprocessor offsets are flushed to disk.

Default: 300000

create_topic_timeout_ms

Timeout (ms) to wait for new topic creation.

Default: 2000

default_num_windows

Default number of quota tracking windows.

Default: 10 Minimum = 1

default_window_sec

Default quota tracking window size in milliseconds.

Default: 1000

developer_mode

Skips most of the checks performed at startup are not recommended for production use.

Default: false

disable_batch_cache

Disable batch cache in log manager.

Default: false

election_timeout_ms

Election timeout expressed in milliseconds.

Default: 1500

enable_pid_file

Enable pid file. You probably don’t want to change this.

Default: true

features_auto_enable

Whether new feature flags may auto-activate after upgrades (true) or must wait for manual activation via the admin API (false).

Default: true

fetch_reads_debounce_timeout

Time to wait for next read in fetch request when requested min bytes wasn’t reached.

Default: 1

fetch_session_eviction_timeout_ms

Minimum time before which unused session will get evicted from sessions. Maximum time after which inactive session will be deleted is two time given configuration value cache.

Default: 60000

full_raft_configuration_recovery_pattern

Recover raft configuration on start for NTPs matching pattern.

Default: Null

group_initial_rebalance_delay

Extra delay (ms) added to rebalance phase to wait for new members.

Default: 300

group_new_member_join_timeout

Timeout for new member joins.

Default: 30000

group_topic_partitions

Number of partitions in the internal group membership topic.

Default: 16

health_manager_tick_interval

How often the health manager runs.

Default: 180000

health_monitor_max_metadata_age

Max age of metadata cached in the health monitor of non controller node.

Default: 10000

health_monitor_tick_interval

How often health monitor refresh cluster state.

Default: 10000

id_allocator_batch_size

Id allocator allocates messages in batches (each batch is a one log record) and then serves requests from memory without touching the log until the batch is exhausted.

Default: 1000

id_allocator_log_capacity

Capacity of the id_allocator log in number of messages. Once it reached id_allocator_stm should compact the log.

Default: 100

join_retry_timeout_ms

Time between cluster join retries in milliseconds.

Default: 5000

kafka_max_bytes_per_fetch

Limit fetch responses to this many bytes even if total of partition bytes limits is higher.

Default: 67108864 (64 MB)

kafka_qdc_depth_alpha

Smoothing factor for kafka queue depth control depth tracking.

Default: 0.8

kafka_qdc_depth_update_ms

Update frequency for kafka queue depth control.

Default: 7000

kafka_qdc_idle_depth

Queue depth when idleness is detected in kafka queue depth control.

Default: 10

kafka_qdc_latency_alpha

Smoothing parameter for kafka queue depth control latency tracking.

Default: 0.002

kafka_qdc_max_depth

Maximum queue depth used in kafka queue depth control.

Default: 100

kafka_qdc_min_depth

Minimum queue depth used in kafka queue depth control.

Default: 1

kafka_qdc_window_count

Number of windows used in kafka queue depth control latency tracking.

Default: 12

kafka_qdc_window_size_ms

Window size for kafka queue depth control latency tracking.

Default: 1500

kvstore_flush_interval

Key-value store flush interval (ms).

Default: 10

kvstore_max_segment_size

Key-value maximum segment size (bytes).

Default: 16777216 (16 MB)

leader_balancer_idle_timeout

Leadership rebalancing idle timeout.

Default: 120000

leader_balancer_mute_timeout

Leadership rebalancing mute timeout.

Default: 300000

leader_balancer_mute_timeout

Leadership rebalancing node mute timeout.

Default: 20000

log_segment_size

How large in bytes should each log segment be (default 1 GB).

Default: 1048576000 (1 GB) Minimum = 1048576 (1 MB)

max_compacted_log_segment_size

Max compacted segment size after consolidation.

Default: 5242880000 (5 GB)

max_kafka_throttle_delay_ms

Fail-safe maximum throttle delay on kafka requests.

Default: 60000

members_backend_retry_ms

Time between members backend reconciliation loop retries.

Default: 5000

metadata_dissemination_interval_ms

Interaval for metadata dissemination batching.

Default: 3000

metadata_dissemination_retries

Number of attempts of looking up a topic’s meta data like shard before failing a request.

Default: 30

metadata_dissemination_retry_delay_ms

Delay before retry a topic lookup in a shard or other meta tables.

Default: 0500

metadata_status_wait_timeout_ms

Maximum time to wait in metadata request for cluster health to be refreshed.

Default: 2000

metrics_reporter_report_interval

Cluster metrics reporter report interval.

Default: 864000000

metrics_reporter_tick_interval

Cluster metrics reporter tick interval.

Default: 60000

node_management_operation_timeout_ms

Timeout for executing node management operations.

Default: 5000

quota_manager_gc_sec

Quota manager GC frequency in milliseconds.

Default: 30000

raft_heartbeat_disconnect_failures

After how many failed heartbeats to forcibly close an unresponsive TCP connection. Set to 0 to disable force disconnection.

Default: 3

raft_heartbeat_interval_ms

The interval in ms between raft leader heartbeats.

Default: 150

raft_heartbeat_timeout_ms

Raft heartbeat RPC timeout.

Default: 3000
Minimum = milliseconds(1)

raft_io_timeout_ms

Raft I/O timeout.

Default: 10000

raft_max_concurrent_append_requests_per_follower

Maximum number of concurrent append entries requests sent by leader to one follower.

Default: 16

raft_max_recovery_memory

Maximum memory that can be used for reads in the raft recovery process.

Default: 15% of total memory Minimum = 33554432 (32 MB)

raft_recovery_default_read_size

Default size of read issued during raft follower recovery.

Default: 524288 (512 KB) Minimum = 128 Maximum = 5242880 (5 MB)

raft_replicate_batch_window_size

Maximum size of requests cached for replication.

Default: 1048576 (1 MB)

raft_smp_max_non_local_requests

Maximum number of x-core requests pending in Raft seastar::smp group. (for more details look at seastar::smp_service_group documentation).

Default: The maximum number of x-core pending in Raft relies on the total number of cores that your environment is executing.

raft_timeout_now_timeout_ms

Timeout for a timeout now request.

Default: 1000

raft_transfer_leader_recovery_timeout_ms

Timeout waiting for follower recovery when transferring leadership.

Default: 10000

readers_cache_eviction_timeout_ms

Duration after which inactive readers will be evicted from cache.

Default: 30000

reclaim_batch_cache_min_free

Free memory limit that will be kept by batch cache background reclaimer.

Default: 67108864 (64 MB)

reclaim_growth_window

Length of time in which reclaim sizes grow.

Default: 3000

reclaim_max_size

Maximum batch cache reclaim size.

Default: 4194304 (4 MB)

reclaim_min_size

Minimum batch cache reclaim size.

Default: 131072 (128 KB)

reclaim_stable_window

Length of time above which growth is reset.

Default: 10000

recovery_append_timeout_ms

Timeout for append entries requests issued while updating stale follower.

Default: 5000

release_cache_on_segment_roll

Free cache when segments roll.

Default: false

replicate_append_timeout_ms

Timeout for append entries requests issued while replicating entries.

Default: 3000

segment_appender_flush_timeout_ms

Maximum delay until buffered data is written.

Default: 1000

segment_fallocation_step

Size for segments fallocation.

Default: 33554432 (32 MB)

storage_read_buffer_size

Size of each read buffer (one per in-flight read, per log segment).

Default: 131072 (128 KB)

storage_read_readahead_count

How many additional reads to issue ahead of current read location.

Default: 10

storage_space_alert_free_threshold_bytes

Threshold of minimim bytes free space before setting storage space alert.

Default: 1048576000 (1 GB) Minimum = 1048576000 ( 1 GB)

storage_space_alert_free_threshold_percent

Threshold of minimim percent free space before setting storage space alert.

Default: 5 Minimum = 1 Maximum = 50

topic_fds_per_partition

Required file handles per partition when creating topics.

Default: 10 Minimum = 1 Maximum = 1000

topic_memory_per_partition

Required memory per partition when creating topics.
Default: 1048576 (1 MB) Minimum = 1 Maximum = 104857600 (100 MB)

transaction_coordinator_log_segment_size

How large in bytes should each log segment be (default 1 GB).

Default: 1048576000 (1 GB)

wait_for_leader_timeout_ms

Timeout (ms) to wait for leadership in metadata cache.

Default: 5000

zstd_decompress_workspace_bytes

Size of the zstd decompression workspace.

Default: 8388608 (8 MB)