Redpanda Cloud Quickstart

Spin up a Dedicated cluster with Redpanda Cloud, create a basic streaming application using the rpk command-line tool, and explore your cluster in Redpanda Console.

Prerequisites

Sign up for a trial of Redpanda Cloud - Dedicated Clusters.

Deploy Redpanda

To deploy a Dedicated cluster in Redpanda Cloud, create a namespace, then follow the steps for creating a Dedicated cluster.

To create a namespace:

  1. Go to Redpanda Cloud and click Log in.

  2. Enter your organization name, and click Continue.

  3. Click Add namespace.

    Namespaces help you organize clusters by owner, team, or project for example.

  4. Enter a name for your namespace, and click Create.

To create a cluster:

  1. Click Create Dedicated cluster.

  2. For cluster settings, enter redpandaquickstart for the cluster name. Use default values for the remaining properties, and click Next.

  3. On the Networking page, use the default Public connection type, and click Create.

  4. Wait for your network and your cluster to be created.

Start streaming

To start building a basic streaming application, you can use rpk, Redpanda’s CLI, to create a topic, produce messages to it, and consume messages from it.

  1. Install rpk on your local machine:

    The rpk binary is not supported on Windows.
    • Linux

    • macOS

    1. Download the rpk archive for Linux, and make sure the version matches your Redpanda version.

      • To download the latest version of rpk:

        curl -LO https://github.com/redpanda-data/redpanda/releases/latest/download/rpk-linux-amd64.zip
      • To download a version other than the latest:

        curl -LO https://github.com/redpanda-data/redpanda/releases/download/v<version>/rpk-linux-amd64.zip
    2. Ensure that you have the folder ~/.local/bin:

      mkdir -p ~/.local/bin
    3. Add it to your $PATH:

      export PATH="~/.local/bin:$PATH"
    4. Unzip the rpk files to your ~/.local/bin/ directory:

      unzip rpk-linux-amd64.zip -d ~/.local/bin/
    5. Run rpk version to display the version of the rpk binary:

      rpk version
      23.2.21 (rev fd1019b)
    1. If you don’t have Homebrew installed, install it.

    2. Install rpk:

      brew install redpanda-data/tap/redpanda
    3. Run rpk version to display the version of the rpk binary:

      rpk version
      23.2.21 (rev fd1019b)
      This method installs the latest version of rpk, which is supported only with the latest version of Redpanda.
  2. On the Overview page of Redpanda Cloud, copy your bootstrap server address and set it as an environment variable on your local machine:

    export RPK_BROKERS="<bootstrap-server-address>"
  3. In Redpanda Cloud, go to Security and create a user called redpanda-chat-account that uses the SCRAM-SHA-256 mechanism.

  4. Copy the password, and set the following environment variables on your local machine:

    export REDPANDA_SASL_USERNAME="redpanda-chat-account"
    export REDPANDA_SASL_PASSWORD="<password>"
    export REDPANDA_SASL_MECHANISM="SCRAM-SHA-256"
  5. In Redpanda Cloud, click the name of your user and add the following permissions to the ACL (access control list):

    • Host: *

    • Topic name: chat-room

    • Operations: All

  6. Click Create.

  7. Use rpk on your local machine to authenticate to Redpanda as the redpanda-chat-account user and get information about the cluster:

    rpk cluster info -X tls.enabled=true
  8. Create a topic called chat-room.

    You granted permissions to the redpanda-chat-account user to access only this topic.

    rpk topic create chat-room -X tls.enabled=true

    Output:

    TOPIC       STATUS
    chat-room  OK
  9. Produce a message to the topic:

    rpk topic produce chat-room -X tls.enabled=true
  10. Enter a message, then press Enter:

    Pandas are fabulous!

    Example output:

    Produced to partition 0 at offset 0 with timestamp 1663282629789.
  11. Press Ctrl+C to finish producing messages to the topic.

  12. Consume one message from the topic:

    rpk topic consume chat-room --num 1 -X tls.enabled=true

    Your message is displayed along with its metadata:

    {
      "topic": "chat-room",
      "value": "Pandas are fabulous!",
      "timestamp": 1663282629789,
      "partition": 0,
      "offset": 0
    }

Explore your topic

In Redpanda Cloud, go to Topics > chat-room.

The message that you produced to the topic is displayed along with some other details about the topic.

Clean up

If you don’t want to continue experimenting with your cluster, you can delete it.

Go to Cluster settings and click Delete cluster.

Suggested reading

Explore the rpk commands that you used in this quickstart: