# Inputs

> For the complete documentation index, see [llms.txt](https://docs.redpanda.com/llms.txt). Component-specific: [connect-full.txt](https://docs.redpanda.com/connect-full.txt)

---
title: Inputs
latest-connect-version: 4.93.0
latest-operator-version: v26.1.4
latest-console-tag: v3.7.3
latest-redpanda-tag: v26.1.9
docname: inputs/about
page-component-name: connect
page-version: master
page-component-version: master
page-component-title: Connect
page-relative-src-path: inputs/about.adoc
page-edit-url: https://github.com/redpanda-data/rp-connect-docs/edit/main/modules/components/pages/inputs/about.adoc
page-git-created-date: "2024-05-24"
page-git-modified-date: "2024-09-09"
---

<!-- Source: https://docs.redpanda.com/connect/components/inputs/about.md -->

An input is a source of data piped through an array of optional [processors](https://docs.redpanda.com/connect/components/processors/about/):

```yaml
input:
  label: my_redis_input

  redis_streams:
    url: tcp://localhost:6379
    streams:
      - benthos_stream
    body_key: body
    consumer_group: benthos_group

  # Optional list of processing steps
  processors:
   - mapping: |
       root.document = this.without("links")
       root.link_count = this.links.length()
```

Some inputs have a logical end, for example a [`csv` input](https://docs.redpanda.com/connect/components/inputs/csv/) ends once the last row is consumed, when this happens the input gracefully terminates and Redpanda Connect will shut itself down once all messages have been processed fully.

It’s also possible to specify a logical end for an input that otherwise doesn’t have one with the [`read_until` input](https://docs.redpanda.com/connect/components/inputs/read_until/), which checks a condition against each consumed message in order to determine whether it should be the last.

## [](#brokering)Brokering

Only one input is configured at the root of a Redpanda Connect config. However, the root input can be a [broker](https://docs.redpanda.com/connect/components/inputs/broker/) which combines multiple inputs and merges the streams:

```yaml
input:
  broker:
    inputs:
      - kafka:
          addresses: [ TODO ]
          topics: [ foo, bar ]
          consumer_group: foogroup

      - redis_streams:
          url: tcp://localhost:6379
          streams:
            - benthos_stream
          body_key: body
          consumer_group: benthos_group
```

## [](#labels)Labels

Inputs have an optional field `label` that can uniquely identify them in observability data such as metrics and logs. This can be useful when running configs with multiple inputs, otherwise their metrics labels will be generated based on their composition. For more information check out the [metrics documentation](https://docs.redpanda.com/connect/components/metrics/about/).

### [](#sequential-reads)Sequential reads

Sometimes it’s useful to consume a sequence of inputs, where an input is only consumed once its predecessor is drained fully, you can achieve this with the [`sequence` input](https://docs.redpanda.com/connect/components/inputs/sequence/).

## [](#generating-messages)Generating messages

It’s possible to generate data with Redpanda Connect using the [`generate` input](https://docs.redpanda.com/connect/components/inputs/generate/), which is also a convenient way to trigger scheduled pipelines.

## [](#categories)Categories

### Services

Inputs that consume from storage or message streaming services.

[**RabbitMQ**](https://docs.redpanda.com/connect/components/inputs/amqp_0_9/) [**RabbitMQ**](https://docs.redpanda.com/connect/components/inputs/amqp_1/) [**AWS CloudWatch Logs**](https://docs.redpanda.com/connect/components/inputs/aws_cloudwatch_logs/) [**Amazon DynamoDB CDC**](https://docs.redpanda.com/connect/components/inputs/aws_dynamodb_cdc/) [**AWS Kinesis**](https://docs.redpanda.com/connect/components/inputs/aws_kinesis/) [**AWS S3**](https://docs.redpanda.com/connect/components/inputs/aws_s3/) [**AWS SQS**](https://docs.redpanda.com/connect/components/inputs/aws_sqs/) [**Azure Blob Storage**](https://docs.redpanda.com/connect/components/inputs/azure_blob_storage/) [**Azure Queue Storage**](https://docs.redpanda.com/connect/components/inputs/azure_queue_storage/) [**Azure Table Storage**](https://docs.redpanda.com/connect/components/inputs/azure_table_storage/) [**beanstalkd**](https://docs.redpanda.com/connect/components/inputs/beanstalkd/) [**Apache Cassandra**](https://docs.redpanda.com/connect/components/inputs/cassandra/) [**discord**](https://docs.redpanda.com/connect/components/inputs/discord/) [**GCP BigQuery**](https://docs.redpanda.com/connect/components/inputs/gcp_bigquery_select/) [**GCP Cloud Storage**](https://docs.redpanda.com/connect/components/inputs/gcp_cloud_storage/) [**GCP PubSub**](https://docs.redpanda.com/connect/components/inputs/gcp_pubsub/) [**Google Cloud**](https://docs.redpanda.com/connect/components/inputs/gcp_spanner_cdc/) [**git**](https://docs.redpanda.com/connect/components/inputs/git/) [**hdfs**](https://docs.redpanda.com/connect/components/inputs/hdfs/) [**microsoft\_sql\_server\_cdc**](https://docs.redpanda.com/connect/components/inputs/microsoft_sql_server_cdc/) [**MongoDB**](https://docs.redpanda.com/connect/components/inputs/mongodb/) [**MongoDB CDC**](https://docs.redpanda.com/connect/components/inputs/mongodb_cdc/) [**mqtt**](https://docs.redpanda.com/connect/components/inputs/mqtt/) [**mysql\_cdc**](https://docs.redpanda.com/connect/components/inputs/mysql_cdc/) [**NATS**](https://docs.redpanda.com/connect/components/inputs/nats/) [**NATS JetStream**](https://docs.redpanda.com/connect/components/inputs/nats_jetstream/) [**NATS KV**](https://docs.redpanda.com/connect/components/inputs/nats_kv/) [**NATS Stream**](https://docs.redpanda.com/connect/components/inputs/nats_stream/) [**nsq**](https://docs.redpanda.com/connect/components/inputs/nsq/) [**ockam\_kafka**](https://docs.redpanda.com/connect/components/inputs/ockam_kafka/) [**Oracle CDC**](https://docs.redpanda.com/connect/components/inputs/oracledb_cdc/) [**OpenTelemetry**](https://docs.redpanda.com/connect/components/inputs/otlp_grpc/) [**OpenTelemetry**](https://docs.redpanda.com/connect/components/inputs/otlp_http/) [**postgres\_cdc**](https://docs.redpanda.com/connect/components/inputs/postgres_cdc/) [**Apache Pulsar**](https://docs.redpanda.com/connect/components/inputs/pulsar/) [**Redis List**](https://docs.redpanda.com/connect/components/inputs/redis_list/) [**Redis PubSub**](https://docs.redpanda.com/connect/components/inputs/redis_pubsub/) [**Redis**](https://docs.redpanda.com/connect/components/inputs/redis_scan/) [**Redis Streams**](https://docs.redpanda.com/connect/components/inputs/redis_streams/) [**redpanda**](https://docs.redpanda.com/connect/components/inputs/redpanda/) [**redpanda\_common**](https://docs.redpanda.com/connect/components/inputs/redpanda_common/) [**redpanda\_migrator**](https://docs.redpanda.com/connect/components/inputs/redpanda_migrator/) [**Salesforce**](https://docs.redpanda.com/connect/components/inputs/salesforce/) [**Salesforce**](https://docs.redpanda.com/connect/components/inputs/salesforce_cdc/) [**Salesforce**](https://docs.redpanda.com/connect/components/inputs/salesforce_graphql/) [**spicedb\_watch**](https://docs.redpanda.com/connect/components/inputs/spicedb_watch/) [**splunk**](https://docs.redpanda.com/connect/components/inputs/splunk/) [**SQL**](https://docs.redpanda.com/connect/components/inputs/sql_raw/) [**SQL**](https://docs.redpanda.com/connect/components/inputs/sql_select/) [**tigerbeetle\_cdc**](https://docs.redpanda.com/connect/components/inputs/tigerbeetle_cdc/) [**timeplus**](https://docs.redpanda.com/connect/components/inputs/timeplus/) [**twitter\_search**](https://docs.redpanda.com/connect/components/inputs/twitter_search/)

### AWS

Inputs that consume from Amazon Web Services products.

[**AWS CloudWatch Logs**](https://docs.redpanda.com/connect/components/inputs/aws_cloudwatch_logs/) [**AWS Kinesis**](https://docs.redpanda.com/connect/components/inputs/aws_kinesis/) [**AWS S3**](https://docs.redpanda.com/connect/components/inputs/aws_s3/) [**AWS SQS**](https://docs.redpanda.com/connect/components/inputs/aws_sqs/)

### Azure

Inputs that consume from Microsoft Azure services.

[**Azure Blob Storage**](https://docs.redpanda.com/connect/components/inputs/azure_blob_storage/) [**Microsoft Azure**](https://docs.redpanda.com/connect/components/inputs/azure_cosmosdb/) [**Azure Queue Storage**](https://docs.redpanda.com/connect/components/inputs/azure_queue_storage/) [**Azure Table Storage**](https://docs.redpanda.com/connect/components/inputs/azure_table_storage/)

### Utility

Inputs that provide utility by generating data or combining/wrapping other inputs.

[**batched**](https://docs.redpanda.com/connect/components/inputs/batched/) [**broker**](https://docs.redpanda.com/connect/components/inputs/broker/) [**dynamic**](https://docs.redpanda.com/connect/components/inputs/dynamic/) [**generate**](https://docs.redpanda.com/connect/components/inputs/generate/) [**inproc**](https://docs.redpanda.com/connect/components/inputs/inproc/) [**read\_until**](https://docs.redpanda.com/connect/components/inputs/read_until/) [**resource**](https://docs.redpanda.com/connect/components/inputs/resource/) [**sequence**](https://docs.redpanda.com/connect/components/inputs/sequence/) [**subprocess**](https://docs.redpanda.com/connect/components/inputs/subprocess/)

### Integration

[**cockroachdb\_changefeed**](https://docs.redpanda.com/connect/components/inputs/cockroachdb_changefeed/) [**schema\_registry**](https://docs.redpanda.com/connect/components/inputs/schema_registry/)

### Local

Inputs that consume from the local machine/filesystem.

[**CSV**](https://docs.redpanda.com/connect/components/inputs/csv/) [**file**](https://docs.redpanda.com/connect/components/inputs/file/) [**parquet**](https://docs.redpanda.com/connect/components/inputs/parquet/) [**stdin**](https://docs.redpanda.com/connect/components/inputs/stdin/)

### Social

Inputs that consume from social applications and services.

[**discord**](https://docs.redpanda.com/connect/components/inputs/discord/) [**twitter\_search**](https://docs.redpanda.com/connect/components/inputs/twitter_search/)

### GCP

Inputs that consume from Google Cloud Platform services.

[**GCP BigQuery**](https://docs.redpanda.com/connect/components/inputs/gcp_bigquery_select/) [**GCP Cloud Storage**](https://docs.redpanda.com/connect/components/inputs/gcp_cloud_storage/) [**GCP PubSub**](https://docs.redpanda.com/connect/components/inputs/gcp_pubsub/) [**Google Cloud**](https://docs.redpanda.com/connect/components/inputs/gcp_spanner_cdc/)

### Network

Inputs that consume directly from low level network protocols.

[**HTTP**](https://docs.redpanda.com/connect/components/inputs/http_client/) [**HTTP**](https://docs.redpanda.com/connect/components/inputs/http_server/) [**nanomsg**](https://docs.redpanda.com/connect/components/inputs/nanomsg/) [**OpenTelemetry**](https://docs.redpanda.com/connect/components/inputs/otlp_grpc/) [**OpenTelemetry**](https://docs.redpanda.com/connect/components/inputs/otlp_http/) [**sftp**](https://docs.redpanda.com/connect/components/inputs/sftp/) [**socket**](https://docs.redpanda.com/connect/components/inputs/socket/) [**socket\_server**](https://docs.redpanda.com/connect/components/inputs/socket_server/) [**websocket**](https://docs.redpanda.com/connect/components/inputs/websocket/) [**zmq4**](https://docs.redpanda.com/connect/components/inputs/zmq4/)