For the complete documentation index, see llms.txt. This page is also available as Markdown.

LLM Configuration

Mosaic uses your AI capacity, not ours. Connect Azure AI Foundry (recommended) or any other LLM provider via API key.

Mosaic does not include AI inference in your subscription price. You bring your own LLM capacity, the same way you bring your own Power BI capacity. This is a deliberate design choice with three benefits:

  • You control cost. Token spend is on your invoice, with your provider, with your usage caps. No surprises hidden in Mosaic's pricing.

  • You control data. Chat content, page context, and DAX results are sent to the LLM endpoint you configure — staying in your Microsoft 365 / Azure environment if you choose Azure AI Foundry.

  • You control models. Pick the model that matches your compliance, latency, and quality requirements. Switch providers without changing Mosaic.

Two supported paths

1

Azure AI Foundry (recommended)

The cleanest path for Microsoft-native customers. Mosaic calls a Foundry-hosted model in your Azure subscription. Data never leaves your tenant. Aligns with your existing Azure governance, billing, and compliance posture.

Configure Azure AI Foundry →

2

Bring your own API key

If you already use Anthropic, OpenAI, or another supported provider directly, paste an API key into Mosaic and you're done. Useful for teams that don't yet have an Azure AI Foundry deployment.

Bring your own API key →

Who runs these steps

A user with Mosaic Tenant Admin access. The same person who configures Power BI typically does this in the same session — both are tenant-level setup.

How long it takes

  • Azure AI Foundry: ~20 minutes the first time, including deploying a model in Foundry and pasting the endpoint into Mosaic

  • BYO API key: ~2 minutes if you already have an active Anthropic / OpenAI account

What gets stored where

Item
Where it lives

API key / Foundry endpoint

Encrypted in your Mosaic tenant configuration. Visible only to Tenant Admins.

Chat content sent to the LLM

Routed through Mosaic's backend to your configured endpoint. Mosaic retains the request/response in your audit log; the inference itself happens at your provider.

AI session history

Mosaic's PostgreSQL database (in your Mosaic tenant scope), as today.

What's next

Pick one path:

Once your LLM is connected, return to Mosaic App Configurations to curate the Power BI resource catalog and finish onboarding.

Last updated