# Monitor Agent Activity

> For the complete documentation index, see [llms.txt](https://docs.redpanda.com/llms.txt). Component-specific: [agentic-data-plane-full.txt](https://docs.redpanda.com/agentic-data-plane-full.txt)

---
title: Monitor Agent Activity
latest-operator-version: v26.1.5
latest-console-tag: v3.7.4
latest-connect-version: 4.96.1
latest-redpanda-tag: v26.1.10
docname: monitor-agents
page-component-name: agentic-data-plane
page-version: master
page-component-version: master
page-component-title: Agentic Data Plane
page-relative-src-path: monitor-agents.adoc
page-edit-url: https://github.com/redpanda-data/adp-docs/edit/main/modules/monitor/pages/monitor-agents.adoc
description: Monitor agent execution, analyze conversation history, track token usage, and debug issues using Inspector, Transcripts, and agent data topics.
page-topic-type: how-to
personas: agent_builder, platform_engineer, domain_evaluator
learning-objective-1: Verify agent behavior using the <strong>Inspector</strong> tab
learning-objective-2: Track token usage and performance metrics
learning-objective-3: Debug agent execution using <strong>Transcripts</strong>
page-git-created-date: "2026-05-28"
page-git-modified-date: "2026-06-10"
---

<!-- Source: https://docs.redpanda.com/agentic-data-plane/monitor/monitor-agents.md -->

Use monitoring to track agent performance, analyze conversation patterns, debug execution issues, and optimize token costs.

After reading this page, you will be able to:

-   Verify agent behavior using the **Inspector** tab

-   Track token usage and performance metrics

-   Debug agent execution using **Transcripts**


For conceptual background on traces and observability, see [How Observability Works](https://docs.redpanda.com/agentic-data-plane/monitor/concepts/).

## [](#prerequisites)Prerequisites

You must have a running agent. If you do not have one, see [Redpanda ADP Quickstart](https://docs.redpanda.com/agentic-data-plane/get-started/adp-quickstart/).

## [](#debug-agent-execution-with-transcripts)Debug agent execution with Transcripts

An agent’s **Transcripts** tab shows each conversation with timing, errors, and token usage. Use it to debug issues, verify agent behavior, and monitor performance.

### [](#navigate-an-agents-transcripts)Navigate an agent’s transcripts

1.  Open **Agents** in the sidebar and select your agent.

2.  Open the **Transcripts** tab.


The tab lists the agent’s recent conversations, one row per conversation:

-   `Conversation`: The conversation ID, with the conversation title when one exists.

-   `Started`: When the conversation began.

-   `Duration`: End-to-end wall-clock time.

-   `Turns`: Number of turns in the conversation.

-   `Status`: `Completed`, `Error`, or `Running`.

-   `Tokens`: Total tokens across the conversation.


Use the search box to match a conversation ID or title, and the status dropdown to narrow the list to `Completed`, `Error`, or `Running` conversations. The list loads in pages; click **Load more** to fetch older conversations.

#### [](#conversation-detail)Conversation detail

Click a row to open the conversation. The header shows the conversation ID with a status badge, the start time, duration, and turn count, plus a total-tokens chip. Toggle between two views:

-   **Chat**: The user-visible exchange, as a conversation.

-   **Detailed**: Adds per-turn metadata: latency, input/output token splits, and each tool call with its arguments, result, latency, and status.


If any turns were rebuilt from LLM message context after their original spans were evicted, those turns carry a _reconstructed_ marker. For the mechanics, see [Reconstructed transcript history](https://docs.redpanda.com/agentic-data-plane/monitor/concepts/#history-reconstruction).

### [](#check-agent-health)Check agent health

Use the **Transcripts** tab to verify your agent is healthy. Recent conversations should show `Completed` status, duration within your expected range, and stable token usage without unexpected growth.

Several warning signs indicate problems. Conversations with `Error` status need investigation. When duration increases over time, your context window may be growing or tool calls could be slowing down. Many LLM calls for simple requests often signal that the agent is stuck in loops or making unnecessary iterations. If you see no new transcripts, the agent may be stopped or encountering deployment issues.

Pay attention to patterns across multiple conversations. When all recent transcripts show errors, start by checking agent status, MCP server connectivity, and system prompt configuration. A list that alternates between success and error typically points to intermittent tool failures or external API issues. If duration increases steadily over a session, your context window is likely filling up. Clear the conversation history to reset it. High token usage combined with relatively few LLM calls usually means tool results are large or your system prompts are verbose.

### [](#debug-with-transcripts)Debug with Transcripts

Use the **Transcripts** tab to diagnose specific issues:

If the agent is not responding:

1.  Check the list for recent conversations. If none appear, the agent may be stopped.

2.  Verify agent status in the main **Agents** view.

3.  Look for error transcripts with deployment or initialization failures.


If the agent fails during execution:

1.  Set the status dropdown to `Error` and open the failed conversation.

2.  Switch to the **Detailed** view and find the turn carrying the error.

3.  Check the tool call’s arguments and result for error messages.

4.  Cross-reference with MCP server status.


If performance is slow:

1.  Compare the `Duration` column across recent conversations.

2.  Open a slow conversation in the **Detailed** view and scan per-turn latency to find the bottleneck.

3.  Check if LLM calls are taking longer than expected.

4.  Verify tool execution time on the nested tool calls.


### [](#track-token-usage-and-costs)Track token usage and costs

View token consumption in the conversation detail view. The **Detailed** view breaks each turn into input tokens (everything sent to the LLM including system prompt, conversation history, and tool results) and output tokens (what the LLM generates in agent responses); the header chip shows the conversation total.

Calculate cost per request:

Cost = (input\_tokens x input\_price) + (output\_tokens x output\_price)

Example: GPT-5.2 with 4,302 input tokens and 1,340 output tokens at $0.00000175 per input token and $0.000014 per output token costs $0.026 per request.

For cost optimization strategies, see [Cost calculation](https://docs.redpanda.com/agentic-data-plane/connect/concepts/#cost-calculation).

## [](#test-agent-behavior-with-inspector)Test agent behavior with Inspector

The **Inspector** tab provides real-time conversation testing. Use it to test agent responses interactively and verify behavior before deploying changes.

### [](#access-inspector)Access Inspector

1.  Open **Agents** in the sidebar.

2.  Click your agent name.

3.  Open the **Inspector** tab.

4.  Enter test queries and review responses.

5.  Check the conversation panel to see tool calls.

6.  Start a new session to test fresh conversations or click **Clear context** to reset history.


### [](#testing-best-practices)Testing best practices

Test your agents systematically by exploring edge cases and potential failure scenarios. Begin with boundary testing. Requests at the edge of agent capabilities verify that scope enforcement works correctly. Error handling becomes clear when you request unavailable data and observe whether the agent degrades gracefully. Even with proper system prompt constraints, testing confirms that your agent responds appropriately to edge cases.

Monitor iteration counts during complex requests to ensure they complete within your configured limits. Ambiguous or vague queries reveal whether the agent asks clarifying questions or makes risky assumptions. Throughout testing, track token usage per request to estimate costs and identify which query patterns consume the most resources.

## [](#next-steps)Next steps

-   [How Observability Works](https://docs.redpanda.com/agentic-data-plane/monitor/concepts/)

-   [Troubleshoot Agents](https://docs.redpanda.com/agentic-data-plane/monitor/troubleshoot-ai-agents/)