Azure AI Evaluation SDK for Python. Use for evaluating generative AI applications with quality, safety, and custom evaluators. Triggers: "azure-ai-evaluation", "evaluators", "GroundednessEvaluator", "evaluate", "AI quality metrics".
Azure AI Evaluation SDK for Python - Initial Release - Introduces built-in quality, safety, and composite evaluators for generative AI assessment. - Supports both AI-assisted (OpenAI model) and NLP-based evaluators. - Adds batch and single-row evaluation APIs with flexible data-column mapping. - Enables custom evaluators via code or prompts. - Integrates with Azure AI Foundry for evaluation result logging. - Provides best practices, reference guides, and CLI tool for batch evaluation.