rpk ai llm-provider create

string

Human-readable name for display in the UI.

stringArray

Model identifiers available through this provider. Leave empty to allow all models. (repeatable; name (bare values comma-split) or protojson object; replaces the full list on update).

bool

Whether this provider is active and accepting requests. (true when set; pass --enabled=false to disable).

string

Override the default API endpoint. Leave empty for the standard OpenAI API.

string

Secret store reference for the API key. Leave empty for no-auth endpoints (Ollama, vLLM, local models).

string

Override the default API endpoint. Leave empty for the standard Anthropic API.

string

Secret store reference for the API key. Leave empty when using authorization passthrough.

bool

Forward the client’s Authorization header to Anthropic instead of using a server-side API key. Used for enterprise/Max plan OAuth passthrough. (true when set; pass --anthropic-config.authorization-passthrough=false to disable).

string

Override the default API endpoint. Leave empty for the standard Google AI API.

string

Secret store reference for the Google AI API key.

string

AWS region where the Bedrock endpoint is deployed. (required in its group) (alias: --region).

string

Override the default Bedrock endpoint URL. Leave empty for the standard regional endpoint.

string

Secret store reference for the AWS access key ID. (required in its group) (alias: --access-key-id-ref).

string

Secret store reference for the AWS secret access key. (required in its group) (alias: --secret-access-key-ref).

string

ARN of the IAM role to assume for Bedrock access. (required in its group) (alias: --role-arn).

string

External ID for cross-account role assumption. Required when the role’s trust policy mandates it.

string

Session name for CloudTrail audit logging.

string

Override the default API endpoint. Leave empty for the standard OpenAI API.

string

Secret store reference for the API key. Leave empty for no-auth endpoints (Ollama, vLLM, local models).

bool

Capture full request bodies (prompts) on observability traces. (true when set; pass --transcripts.record-input-messages=false to disable).

bool

Capture full response bodies (completions) on observability traces. (true when set; pass --transcripts.record-output-messages=false to disable).

string

Name of a Guardrail to attach to this provider. Leave empty for no guardrail. For Bedrock provider the guardrail uses AWS Bedrock Guardrail directly. For all other providers the proxy evaluates user input against the Bedrock Guardrail’s standalone backend. In both cases a guardrail intervention short-circuits the request.

stringArray

Tags. (repeatable key=value; replaces the full map on update). (New in 0.2.33)

string

manifest to create from (YAML or JSON; "-" for stdin); flags override file values.

bool

print the request that would be sent (with the computed update mask) and exit without calling the server.

stringArray

per-model pricing override in USD per million tokens (repeatable). Keys: model (required), input, output, cached, cache_write_5m, cache_write_1h; for example, model=gpt-4o,input=2.50,output=10.00,cached=1.25. Omitted rates keep the catalog default; 0 means an explicit free rate. Merges into --provider-models by model name; on update it replaces the whole model list. (New in 0.2.41)

string

Redpanda or rpk config file; default search paths are ~/.config/rpk/rpk.yaml, $PWD/redpanda.yaml, and /etc/redpanda/redpanda.yaml.

stringArray

Override rpk configuration settings; -X help for detail or -X list for terser detail.

bool

Ignore rpk.yaml and redpanda.yaml; use default settings.

string

rpk profile to use.

bool

Enable verbose logging.