ScenarioRunResult Class

Reference

Definition

Namespace:: Microsoft.Extensions.AI.Evaluation.Reporting

Assembly:: Microsoft.Extensions.AI.Evaluation.Reporting.dll

Package:: Microsoft.Extensions.AI.Evaluation.Reporting v9.5.0

Source:: ScenarioRunResult.cs

Important

Some information relates to prerelease product that may be substantially modified before it’s released. Microsoft makes no warranties, express or implied, with respect to the information provided here.

Represents the results of a single execution of a particular iteration of a particular scenario under evaluation. In other words, ScenarioRunResult represents the results of evaluating a ScenarioRun and includes the EvaluationResult that is produced when EvaluateAsync(IEnumerable<ChatMessage>, ChatResponse, IEnumerable<EvaluationContext>, CancellationToken) is invoked.

public ref class ScenarioRunResult sealed

public sealed class ScenarioRunResult

type ScenarioRunResult = class

Public NotInheritable Class ScenarioRunResult

Inheritance: Object
ScenarioRunResult

Remarks

Each execution of an evaluation run is assigned a unique ExecutionName. A single such evaluation run can contain evaluations for multiple scenarios each with a unique ScenarioName. The execution of each such scenario in turn can include multiple iterations each with a unique IterationName.

Constructors

ScenarioRunResult(String, String, String, DateTime, IEnumerable<ChatMessage>, ChatResponse, EvaluationResult, ChatDetails, IEnumerable<String>)	Initializes a new instance of the ScenarioRunResult class.
ScenarioRunResult(String, String, String, DateTime, IList<ChatMessage>, ChatResponse, EvaluationResult, ChatDetails, IList<String>, Nullable<Int32>)	Represents the results of a single execution of a particular iteration of a particular scenario under evaluation. In other words, ScenarioRunResult represents the results of evaluating a ScenarioRun and includes the EvaluationResult that is produced when EvaluateAsync(IEnumerable<ChatMessage>, ChatResponse, IEnumerable<EvaluationContext>, CancellationToken) is invoked.

Properties

ChatDetails	Gets or sets an optional ChatDetails object that contains details related to all LLM chat conversation turns involved in the execution of the ScenarioRun corresponding to this ScenarioRunResult.
CreationTime	Gets or sets the time at which this ScenarioRunResult was created.
EvaluationResult	Gets or sets the EvaluationResult for the ScenarioRun corresponding to this ScenarioRunResult.
ExecutionName	Gets or sets the ExecutionName.
FormatVersion	Gets or sets the version of the format used to persist the current ScenarioRunResult.
IterationName	Gets or sets the IterationName.
Messages	Gets or sets the conversation history including the request that produced the ModelResponse being evaluated in this ScenarioRunResult.
ModelResponse	Gets or sets the response being evaluated in this ScenarioRunResult.
ScenarioName	Gets or sets the ScenarioName.
Tags	Gets or sets a set of text tags applicable to this ScenarioRunResult.

Extension Methods

ContainsDiagnostics(ScenarioRunResult, Func<EvaluationDiagnostic,Boolean>)

Returns true if any EvaluationMetric contained in the supplied result contains an EvaluationDiagnostic matching the supplied predicate; false otherwise.

Applies to

通过