Edit

Share via


Viewing AI red teaming results in Azure AI Foundry project (preview)

Important

Items marked (preview) in this article are currently in public preview. This preview is provided without a service-level agreement, and we don't recommend it for production workloads. Certain features might not be supported or might have constrained capabilities. For more information, see Supplemental Terms of Use for Microsoft Azure Previews.

After your automated scan is finished running locally or remotely, the results also get logged to your Azure AI Foundry project which you specified in the creation of your AI red teaming agent.

View report of each scan

In your Azure AI Foundry project or hub based project, navigate to the Evaluations page and select the AI red teaming tab to view the comprehensive report with a detailed drill-down of each scan.

Screenshot of AI Red Teaming tab in Azure AI Foundry project page.

Once you select into the scan, you can view the report by risk categories, which shows you the overall number of successful attacks and a breakdown of successful attacks per risk categories:

Screenshot of AI Red Teaming report view by risk category in Azure AI Foundry.

Or by attack complexity classification:

Screenshot of AI Red Teaming report view by attack complexity category in Azure AI Foundry.

Drilling down further into the data tab provides a row-level view of each attack-response pair, enabling deeper insights into system issues and behaviors. For each attack-response pair, you can see additional information such as whether or not the attack was successful, what attack strategy was used and its attack complexity. There's also an option for a human in the loop reviewer to provide human feedback by selecting the thumbs up or thumbs down icon.

Screenshot of AI Red Teaming data page in Azure AI Foundry.

To view each conversation, selecting View more opens up the full conversation for more detailed analysis of the AI system's response.

Screenshot of AI Red Teaming data page with a conversation history opened in Azure AI Foundry.

Try out an example workflow in our GitHub samples.