Deploy
Learn about Redpanda in Kubernetes and the tools that are available.
Production Deployment Workflow
The production deployment tasks involve Kubernetes administrators (admins) as well as Kubernetes users. The admin prepares the cluster with the prerequisites and tunes the worker nodes. The user deploys and configures Redpanda.
Find a guide for setting up a three-broker Redpanda cluster in different Kubernetes platforms.
You can use
rpm
to setup a production cluster of Redpanda using our default deployment or writing a custom deployment script.Automate Deployment for Production
You can use automation tools in your environment such as Terraform and Ansible to deploy Redpanda for production.
When you install Redpanda, a
redpanda.yaml
file is installed on each node in/etc/redpanda
. This file contains node configuration properties. A node property is one that can be set differently from node to node, such asdata_directory
ornode_id
(when specified).Redpanda is designed to ensure data integrity and high availability (HA), even at high-throughput levels. This section explains the trade-offs with different configurations.
The following scenarios provide estimates and advice for sizing Redpanda clusters for different throughput and retention use cases in your data center and in the cloud.
For best performance, size your Redpanda cluster to handle the volume of data being produced, replicated, and consumed.
A high-level overview about the features that Redpanda Cloud offers.
Redpanda Dedicated
To create a Redpanda cluster in the Dedicated cloud, log in to the Redpanda Cloud, add a namespace, then follow the steps for creating a Dedicated cluster.
A VPC peering connection is a networking connection between two VPCs. This connection allows the VPCs to communicate with each other as if they were within the same network. A route table routes traffic between the two VPCs using private IPv4 addresses.
To create a Redpanda cluster in your own AWS cloud, log in to the Redpanda Cloud UI and create a namespace, then follow the steps for creating a Bring your own cloud (BYOC) cluster.
To create a Redpanda cluster in your own GCP cloud, log in to the Redpanda Cloud UI and create a namespace, then follow the steps for creating a Bring your own cloud (BYOC) cluster.
Create a Topic for your cluster.
Managed Connectors
The Amazon S3 Sink connector stores Apache Kafka messages in an AWS S3 bucket.