# Connect

> Index of Connect documentation pages. Each link points to the page's markdown version.
> For the full documentation index, see https://docs.redpanda.com/llms.txt

## Pages

- [Configuration](https://docs.redpanda.com/connect/configuration/about.md): Learn about different options for configuring Redpanda Connect.
- [Configure an Allow or Deny List](https://docs.redpanda.com/connect/configuration/allow_and_deny_lists.md): Learn how to configure an allow or deny list for a Redpanda Connect instance.
- [Message Batching](https://docs.redpanda.com/connect/configuration/batching.md): Learn how message batching works in Redpanda Connect, including batch policies and how batches flow between inputs, processors, and outputs.
- [Dynamic Inputs and Outputs](https://docs.redpanda.com/connect/configuration/dynamic_inputs_and_outputs.md): Learn how to add, update, and remove inputs and outputs at runtime with the dynamic fan-in and fan-out components and their REST APIs.
- [Error Handling](https://docs.redpanda.com/connect/configuration/error_handling.md): Learn how to handle processing errors in Redpanda Connect, including error checks, retries, and dead-letter queue patterns.
- [Field Paths](https://docs.redpanda.com/connect/configuration/field_paths.md): Learn the dot path syntax that Redpanda Connect components use to target fields within messages and configuration.
- [Interpolation](https://docs.redpanda.com/connect/configuration/interpolation.md): Learn how to use environment variables and function interpolations to insert dynamic values into Redpanda Connect configurations.
- [Metadata](https://docs.redpanda.com/connect/configuration/metadata.md): Learn how message metadata works in Redpanda Connect, including how to get, set, and delete key/value pairs that travel with each message.
- [Processing Pipelines](https://docs.redpanda.com/connect/configuration/processing_pipelines.md): Learn how the pipeline section applies processors to all messages and how to scale processing across parallel threads.
- [Resources](https://docs.redpanda.com/connect/configuration/resources.md): Learn how to declare components as named resources in Redpanda Connect so one configured instance can be referenced throughout a configuration.
- [Secrets](https://docs.redpanda.com/connect/configuration/secrets.md): Learn how to add secrets to a Redpanda Connect configuration without exposing them.
- [Telemetry](https://docs.redpanda.com/connect/configuration/telemetry.md): Learn what anonymized usage data the Redpanda Connect telemetry service sends, and how to inspect or disable it.
- [Templating](https://docs.redpanda.com/connect/configuration/templating.md): Learn how templates work.
- [Unit Testing](https://docs.redpanda.com/connect/configuration/unit_testing.md): Learn how to write and run unit tests for Redpanda Connect configuration files with the rpk connect test command.
- [Using CUE](https://docs.redpanda.com/connect/configuration/using_cue.md): Learn how to use CUE to define, type-check, and generate Redpanda Connect configurations.
- [Windowed Processing](https://docs.redpanda.com/connect/configuration/windowed_processing.md): Learn how to process periodic windows of messages with Redpanda Connect.
- [Cookbooks](https://docs.redpanda.com/connect/cookbooks.md): Explore step-by-step cookbooks that walk through real-world Redpanda Connect configurations.
- [CDC Schema Registry Patterns](https://docs.redpanda.com/connect/cookbooks/cdc_schema_registry.md): Register schemas from database change data capture (CDC) events in a schema registry and stream schema-encoded messages to Redpanda with Redpanda Connect.
- [Custom Metrics](https://docs.redpanda.com/connect/cookbooks/custom_metrics.md): Learn how to emit custom metrics from messages.
- [Create a Discord Bot](https://docs.redpanda.com/connect/cookbooks/discord_bot.md): Learn how to use Redpanda Connect to create a Discord bot.
- [DynamoDB CDC Patterns](https://docs.redpanda.com/connect/cookbooks/dynamodb_cdc.md): Learn how to capture, filter, transform, and route DynamoDB change data capture (CDC) events with Redpanda Connect.
- [Enrichment Workflows](https://docs.redpanda.com/connect/cookbooks/enrichments.md): How to configure Redpanda Connect to process a workflow of enrichment services.
- [Filtering and Sampling](https://docs.redpanda.com/connect/cookbooks/filtering.md): Configure Redpanda Connect to conditionally drop messages.
- [Stream data to BigQuery with the Storage Write API](https://docs.redpanda.com/connect/cookbooks/gcp_bigquery_write_api.md): Configure Redpanda Connect to stream, upsert, and delete data in BigQuery using the Storage Write API.
- [Google Cloud Spanner CDC Patterns](https://docs.redpanda.com/connect/cookbooks/gcp_spanner_cdc.md): Learn how to capture, filter, transform, and route Google Cloud Spanner change data capture (CDC) events with Redpanda Connect.
- [Work with Jira Issues](https://docs.redpanda.com/connect/cookbooks/jira.md): Learn how to use the Jira processor as both an input and output in Redpanda Connect.
- [Joining Streams](https://docs.redpanda.com/connect/cookbooks/joining_streams.md): How to hydrate documents by joining multiple streams.
- [Message Routing Patterns](https://docs.redpanda.com/connect/cookbooks/message_routing.md): Learn how to route, filter, and discard messages in Redpanda Connect pipelines.
- [SQL Server CDC Patterns](https://docs.redpanda.com/connect/cookbooks/microsoft_sql_server_cdc.md): Learn how to capture, filter, transform, and route Microsoft SQL Server change data capture (CDC) events with Redpanda Connect.
- [MongoDB CDC Patterns](https://docs.redpanda.com/connect/cookbooks/mongodb_cdc.md): Learn how to capture, filter, transform, and route MongoDB change data capture (CDC) events with Redpanda Connect.
- [MySQL CDC Patterns](https://docs.redpanda.com/connect/cookbooks/mysql_cdc.md): Learn how to capture, filter, transform, and route MySQL change data capture (CDC) events with Redpanda Connect.
- [Oracle Database CDC Patterns](https://docs.redpanda.com/connect/cookbooks/oracledb_cdc.md): Learn how to capture, filter, transform, and route Oracle Database change data capture (CDC) events with Redpanda Connect.
- [PostgreSQL CDC Patterns](https://docs.redpanda.com/connect/cookbooks/postgres_cdc.md): Learn how to capture, filter, transform, and route PostgreSQL change data capture (CDC) events with Redpanda Connect.
- [Retrieval-Augmented Generation (RAG)](https://docs.redpanda.com/connect/cookbooks/rag.md): How to configure Redpanda Connect to create a RAG pipeline, using PostgreSQL and PGVector.
- [Redpanda Migrator](https://docs.redpanda.com/connect/cookbooks/redpanda_migrator.md): Move your workloads from any Kafka system to Redpanda using a single command. Redpanda Migrator lets you migrate Kafka messages, schemas, and ACLs quickly and efficiently. It's Redpanda's alternative...
- [Ingest data into Snowflake](https://docs.redpanda.com/connect/cookbooks/snowflake_ingestion.md): Configure Redpanda Connect to ingest data from a Redpanda topic into Snowflake using Snowpipe Streaming.
- [TigerBeetle CDC Patterns](https://docs.redpanda.com/connect/cookbooks/tigerbeetle_cdc.md): Learn how to capture, filter, transform, and route TigerBeetle change data capture (CDC) events with Redpanda Connect.
- [Get Started](https://docs.redpanda.com/connect/get-started.md): Explore these topics to get started with Redpanda Connect.
- [Introduction to Redpanda Connect](https://docs.redpanda.com/connect/get-started/about.md): Learn about Redpanda Connect, a declarative connector framework for building data pipelines with simple, chained, stateless processing steps.
- [Enterprise Licensing](https://docs.redpanda.com/connect/get-started/licensing.md): Learn how to purchase and apply an Enterprise Edition license.
- [Quickstarts](https://docs.redpanda.com/connect/get-started/quickstarts.md): Use your preferred tool to spin up a local instance of Redpanda Connect and get hands-on experience building your first pipelines.
- [Get Started with the Redpanda Connect Helm Chart](https://docs.redpanda.com/connect/get-started/quickstarts/helm-chart.md): Deploy Redpanda Connect on Kubernetes using Helm.
- [Get Started with Redpanda Connect using rpk](https://docs.redpanda.com/connect/get-started/quickstarts/rpk.md): Deploy your first pipelines using Redpanda Connect and rpk.
- [Redpanda Connect Versioning](https://docs.redpanda.com/connect/get-started/versioning.md): Learn how Redpanda Connect implements versioning.
- [What’s New in Redpanda Connect](https://docs.redpanda.com/connect/get-started/whats-new.md): Summary of new features in Redpanda Connect.
- [Guides](https://docs.redpanda.com/connect/guides.md): Explore guides for installing, configuring, and running Redpanda Connect.
- [Bloblang](https://docs.redpanda.com/connect/guides/bloblang/about.md): Learn what Bloblang is and how to use the native mapping language.
- [Advanced Bloblang](https://docs.redpanda.com/connect/guides/bloblang/advanced.md): Some advanced Bloblang patterns
- [Bloblang Arithmetic](https://docs.redpanda.com/connect/guides/bloblang/arithmetic.md): How arithmetic works within Bloblang
- [Bloblang Functions](https://docs.redpanda.com/connect/guides/bloblang/functions.md): A list of Bloblang functions
- [Bloblang Methods](https://docs.redpanda.com/connect/guides/bloblang/methods.md): A list of Bloblang methods
- [Bloblang Playground](https://docs.redpanda.com/connect/guides/bloblang/playground.md): Experiment with Bloblang in this interactive playground. Test mappings, process JSON inputs, and explore examples of real-time data transformations.
- [Bloblang Walkthrough](https://docs.redpanda.com/connect/guides/bloblang/walkthrough.md): A step by step introduction to Bloblang
- [Change Data Capture (CDC)](https://docs.redpanda.com/connect/guides/cdc.md): Capture database changes in real time and stream them to Redpanda topics using native CDC inputs.
- [Cloud Credentials](https://docs.redpanda.com/connect/guides/cloud.md): Explore how to deploy and manage Redpanda Connect in the cloud, including setup, configuration, and optimization tips.
- [Authenticate to Amazon Aurora using IAM roles](https://docs.redpanda.com/connect/guides/cloud/aws-iam-aurora.md): Configure IAM roles to authenticate self-hosted Redpanda Connect pipelines to Amazon Aurora on AWS without static credentials.
- [Amazon Web Services](https://docs.redpanda.com/connect/guides/cloud/aws.md): Find out about AWS components in Redpanda Connect.
- [Google Cloud Platform](https://docs.redpanda.com/connect/guides/cloud/gcp.md): Find out about GCP components in Redpanda Connect.
- [Message Delivery Semantics](https://docs.redpanda.com/connect/guides/delivery_semantics.md): Learn about Redpanda Connect's transactional model and error handling
- [Tune the Iceberg output for throughput](https://docs.redpanda.com/connect/guides/iceberg-output-tuning.md): Configure the Redpanda Connect Iceberg output for high write throughput using tested recipes for append-only and keyed CDC workloads.
- [Migration](https://docs.redpanda.com/connect/guides/migration.md): Migrate between different Redpanda Connect versions, including preparation steps and best practices.
- [Migrate to the Unified Redpanda Migrator](https://docs.redpanda.com/connect/guides/migration/migrate-unified-redpanda-migrator.md): Learn how to migrate from legacy migrator components to the unified redpanda_migrator input/output pair in Redpanda Connect 4.67.5+.
- [Migrating to Version 2](https://docs.redpanda.com/connect/guides/migration/v2.md): Learn how to migrate to Redpanda Connect v2.
- [Migrating to Version 3](https://docs.redpanda.com/connect/guides/migration/v3.md): Learn how to migrate to Redpanda Connect v3.
- [Migrating to Version 4](https://docs.redpanda.com/connect/guides/migration/v4.md): Learn how to migrate to Redpanda Connect v4, with insights into new functionalities and migration tips.
- [Monitor Pipeline Status](https://docs.redpanda.com/connect/guides/monitor-pipeline-status.md): Monitor Redpanda Connect pipeline health using status events, set up alerts for connection failures, and troubleshoot common issues.
- [Monitoring](https://docs.redpanda.com/connect/guides/monitoring.md): Learn how to monitor Redpanda Connect, including setting up metrics and alerts to ensure system health and performance.
- [Performance Tuning](https://docs.redpanda.com/connect/guides/performance_tuning.md): Discover best practices for tuning Redpanda Connect performance, optimizing configurations, and achieving maximum throughput.
- [Serverless](https://docs.redpanda.com/connect/guides/serverless/about.md): Learn about serverless architecture in Redpanda Connect, including benefits, use cases, and implementation details.
- [Lambda](https://docs.redpanda.com/connect/guides/serverless/lambda.md): Deploying as an AWS Lambda function
- [Streams Mode](https://docs.redpanda.com/connect/guides/streams_mode/about.md): Get an overview of streams mode in Redpanda Connect, detailing its features, use cases, and setup instructions.
- [Streams API](https://docs.redpanda.com/connect/guides/streams_mode/streams_api.md): Get an overview of streams mode in Redpanda Connect, detailing its features, use cases, and setup instructions.
- [Streams Via Config Files](https://docs.redpanda.com/connect/guides/streams_mode/using_config_files.md): Learn how to run Redpanda Connect in streams mode with a static configuration file for each stream.
- [Streams Via REST API](https://docs.redpanda.com/connect/guides/streams_mode/using_rest_api.md): Learn how to create, update, and remove Redpanda Connect streams at runtime using the streams mode REST API.
- [Synchronous Responses](https://docs.redpanda.com/connect/guides/sync_responses.md): Understand synchronous response handling in Redpanda Connect, ensuring reliable and efficient data processing.
- [Install or Upgrade Redpanda Connect](https://docs.redpanda.com/connect/install.md): Discover all ways to install or upgrade Redpanda Connect.
- [Build or Upgrade from Source](https://docs.redpanda.com/connect/install/build-from-source.md): Build or upgrade Redpanda Connect from source.
- [Install or Upgrade with the Helm Chart](https://docs.redpanda.com/connect/install/helm-chart.md): Deploy or upgrade Redpanda Connect on Kubernetes using Helm.
- [Run Pipelines with the Redpanda Operator](https://docs.redpanda.com/connect/install/kubernetes-operator.md): Run Redpanda Connect pipelines declaratively on Kubernetes with the Redpanda Operator's Pipeline resource.
- [Install or Upgrade from a Prebuilt Binary](https://docs.redpanda.com/connect/install/prebuilt-binary.md): Download, install, or upgrade Redpanda Connect from a prebuilt binary.
- [Install or Upgrade with rpk](https://docs.redpanda.com/connect/install/rpk.md): Install or upgrade Redpanda Connect using the Redpanda CLI.
- [Plugins](https://docs.redpanda.com/connect/plugins/about.md): Create and load dynamic plugins at runtime with gRPC.
- [Reference](https://docs.redpanda.com/connect/reference.md): The following topics provide reference material for Redpanda Connect.
- [Redpanda Connect Chart Specification](https://docs.redpanda.com/connect/reference/k-connect-helm-spec.md): Find the default values and descriptions of settings in the Redpanda Connect Helm chart.