AI usage dashboard

The AI usage dashboard displays AI token usage across the entire organization for all relevant product surfaces that use AI, such as Sigma agents and Sigma Assistant.

For example, if you want to evaluate changes that you make to agent instructions or the configured AI provider, use the AI usage dashboard to review the resulting effects on usage and token consumption. If you want to evaluate changes that you make to the AI context for data models configured for Sigma Assistant or the configured AI provider, use the Assistant: Viewer tab to review the resulting effects on usage and token consumption.

User and system requirements

• You must be assigned the Admin account type.
• The dashboard must be configured. See Configure AI usage dashboards.

Review AI usage dashboard

The AI usage dashboard includes the following tabs:

If you want to customize the AI usage dashboard, click Add to workspace to open the dashboard for editing as a new workbook in your Documents folder.

Set up alerts for token consumption

If you want to monitor token consumption across your organization, you can set up a conditional alert on a customized version of the AI usage dashboard.

For example, send a notification when total token usage crosses a threshold of 10,000 tokens per day.

💡

You can alert on any data available in the dashboard, such as token consumption by product, or customize the data view to show different time granularity.

1. On the AI usage dashboard, click Add to workspace to open the dashboard as a new workbook in your Documents folder.

2. To notify on total tokens consumed, select the Total tokens consumed KPI chart on the Overview tab.

3. For the KPI chart, click More to open the element menu and select Alert when.

   The Schedule exports modal opens.

4. In this example, set up an email notification. For Recipient, enter one or more email addresses to be sent an email when token consumption exceeds the threshold.

5. For Subject, enter a subject for the email. For example, "Sigma AI usage over threshold". Optionally use dynamic text to specify a formula and display the threshold value in the subject. For example, use the formula: Max([Total tokens consumed 🔑/Total conversation tokens]).

6. For Message, enter a message for the email. Optionally use dynamic text to specify a formula and display the threshold details in the message. For example, "Token consumption for Sigma AI-powered features is over the alert threshold. Review the usage patterns.", and optional formulas like the following:

   • To show the total tokens consumed, use a formula like: Max([Total tokens consumed 🔑/Total conversation tokens]).
   • To show how many of those tokens are used by Sigma agents, use a formula like: If([Total tokens consumed 🔑/Product]="Agent", Max([Total tokens consumed 🔑/Total conversation tokens]), "N/A").

7. In the Attachments section, change the attachment to provide relevant details. For example, choose a CSV of the AI Usage Table element to more easily review product usage details, or choose a PNG of the KPI chart to make the token consumption more visible.

8. For Frequency, select the frequency at which you want the alert to trigger. Because the alert is conditional, the frequency is how often the conditions are evaluated before sending an email. In this example, you want to evaluate token consumption per day, so set a frequency of daily.

   Because you set up an alert, Send is set to If a condition is met.

9. In the Condition section, configure the threshold that triggers the alert:

   1. Leave the defaults for Send to If a condition is met and Data element to the Overview: Token usage by day element.
   2. Set Check if to Any value.
   3. For In column, select Total tokens consumed.
   4. For Is, select Greater than.
   5. For Value, enter the token threshold you want to be notified at. For example, 10000.

10. Turn on the Stop notifying after 1 occurrences in a day toggle to avoid getting multiple alerts for the same activity.

11. Filter the table to the last 24 hours of data:

    1. Select the checkbox for Customize control values, then select New-Control-37, the date control on the Overview tab.
    2. Modify the selection to Last 24 hours.

    💡

    If you want to alert on token consumption for Sigma agents specifically, choose another control to customize and select New-Control-35, the list values control that filters Product on the Overview tab, then specify a product. For example, Agent.

12. Click Create to save the alert.

For more options, see Schedule a conditional export or alert. Test your export by sending it to yourself to confirm that the data looks as you expect.

💡

You can use alerts to monitor consumption, but if possible, set spending limits or budgets in your AI provider.

If you use Snowflake as your AI provider, consider creating a custom budget to cap and track AI spending. See Custom budgets in the Snowflake documentation. For other AI providers, manage or limit consumption using the controls available in that provider.

AI usage table in connection browser

If you are granted access to the relevant schema, you can also explore the AI usage data in the relevant table in the connection browser.

AI usage is stored in a table called AI_USAGE_<ORGANIZATION_NAME> in the configured location.