Develop

• Supported Kafka Clients

  Redpanda is Kafka API-compatible, which means that despite Redpanda being a new streaming data platform, you can leverage the countless client libraries that have been created for Kafka.

• Use Redpanda with Kafka Client Libraries

• Use Redpanda with NodeJS

  Redpanda is Kafka API-compatible, which means that despite Redpanda being a new streaming data platform, you can leverage the countless client libraries that have been created for Kafka.

• Use Redpanda with the HTTP Proxy API

  Redpanda HTTP Proxy (pandaproxy) allows access to your data through a REST API. For example, you can list topics or brokers, get events, produce events, subscribe to events from topics using consumer groups, and commit offsets for a consumer.

• Produce Data

  • Configure Producers

    Along with brokers, topics, and consumers, producers are one of the essential components of a Redpanda deployment. Within streaming applications, producers are responsible for sending data to brokers, where the data is stored in topics made up of partitions.

  • Idempotent Producers

    When a producer writes messages to a topic, each message should be recorded only once in the order in which it was sent. However, network issues such as a connection failure can result in a timeout, which prevents a write request from succeeding. Idempotent producers prevent this problem by assigning a unique ID to every write request.

• Consume Data

  • Consumer Offsets

    Redpanda supports __consumer_offsets, which is a private topic on a Redpanda node. The __consumer_offsets topic stores committed offsets from each Kafka consumer that is attached to Redpanda.

• Transactions

  Redpanda supports Apache Kafka®-compatible transaction semantics and APIs. For example, you can fetch messages starting from the last consumed offset and transactionally process them one by one, updating the last consumed offset and producing events at the same time.