Create a BYOC Cluster on Azure

To unlock this feature for your account, contact Redpanda support.

Prerequisites

Before you deploy a BYOC cluster on Azure, follow the prerequisites to ensure that your Azure subscription meets requirements.

Verify rpk version

Confirm you have a minimum version of Redpanda rpk v24.1. See rpk version or Introduction to rpk.

Prepare your Azure subscription

In the Azure Portal, confirm that the dedicated subscription you intend to use with Redpanda includes the following:

  • Role: The Azure user must have the Owner role in the subscription.

  • Resources: The subscription must be registered for the following resource providers. See the Microsoft documentation.

    • Microsoft.Compute

    • Microsoft.ManagedIdentity

    • Microsoft.Storage

    • Microsoft.KeyVault

    • Microsoft.Network

    To check if a resource provider is registered, run the following command using the Azure CLI or in the Azure Cloud Shell. For example, to check for Microsoft.Compute, run:

    az provider show -n Microsoft.Compute

    If it is not registered, run:

    az provider register --namespace 'Microsoft.Compute'
  • Feature: The subscription must be registered for Microsoft.Compute/EncryptionAtHost. See the Microsoft documentation.

    To register EncryptionAtHost, run:

    az feature register --name EncryptionAtHost  --namespace Microsoft.Compute
  • Quota: The subscription must have the following quota in the region where you will use Redpanda. See the Microsoft documentation.

    • Standard LASv3-series vCPUs: 24

    • Standard DADSv5-series vCPUs: 8

  • Monitoring: The subscription must have Azure Network Watcher enabled in the NetworkWatcherRG resource group and the region where you will use Redpanda. Network Watcher lets you monitor and diagnose conditions at a network level. See the Microsoft documentation. To enable it, run:

    # Create the NetworkWatcherRG resource group
    az group create --name 'NetworkWatcherRG' --location '<region_name>'
    
    # Enable Network Watcher in <region_name>
    az network watcher configure --resource-group 'NetworkWatcherRG' --locations '<region_name>' --enabled

Check Azure SKU restrictions

Check to ensure that the Azure subscription does not have any SKU restrictions for the VM sizes in the region where you will use Redpanda. Using the Azure CLI or in the Azure Cloud Shell, run:

az vm list-skus -l eastus2 --zone --size Standard_L8as_v3 --output table
az vm list-skus -l eastus2 --zone --size Standard_D2s_v3 --output table
az vm list-skus -l eastus2 --zone --size Standard_D2ads_v5 --output table

If you see restrictions, open a Microsoft support request to remove the restrictions. For example, checking the Standard_L8as_v3 VM SKU restriction in the eastus2 region for all zones could show:

ResourceType     Locations    Name              Zones    Restrictions
---------------  -----------  ---------------   -------  ------------
virtualMachines  eastus2      Standard_L8as_v3   1,2,3    NotAvailableForSubscription, type: Zone, locations: eastus2, zones: 2,3

Create a BYOC cluster

To create a Redpanda cluster in your Azure Virtual Network, follow the prerequisites then follow the instructions in the Redpanda Cloud UI. The UI contains the parameters necessary to successfully run rpk cloud byoc apply.

  1. Log in to Redpanda Cloud.

  2. On the Clusters page, click Create cluster, then click Create BYOC cluster.

  3. Enter a cluster name, then select the resource group, provider (Azure), region, tier, availability, and Redpanda version.

    • If you plan to create a private network in your own virtual network, select the region where your Azure Virtual Network is located.

    • Multi-AZ is the default configuration. Three AZs provide two backups in case one availability zone goes down.

    Optionally, click Advanced settings to specify up to five key-value custom tags. After the cluster is created, the tags are applied to all Azure resources associated with this cluster. For details, see the Microsoft documentation.

  4. Click Next.

  5. On the Network page, enter the connection type: either Public or Private. For BYOC clusters, Private using Azure Private Link is best-practice.

    • Your network name is used to identify this network.

    • For a CIDR range, choose one that does not overlap with your existing VPCs or your Redpanda network.

  6. Click Next.

  7. On the Deploy page, follow the steps to log in to Redpanda Cloud and deploy the agent.

    As part of agent deployment, Redpanda assigns the permissions required to run the agent. For details about these permissions, see Azure IAM policies.