AI-102 Study Series Exercise 7: Model Evaluation in Azure AI Foundry
Overview This exercise demonstrates how to evaluate generative AI model performance using manual and automated evaluations in Azure AI Foundry. The goal is to assess model responses based on predefined criteria. Steps & Configuration Details 1. Create an Azure AI Foundry Hub and Project Open Azure AI Foundry portal (https://ai.azure.com) and sign in. Navigate to Management Center → All Resources → Create → AI Hub Resource. Configuration Items: Subscription: Your Azure subscription. Resource Group: Select or create a resource group. Hub Name: A valid name. Location: Choose from: East US 2 France Central UK South Sweden Central (quota limits may require a different region). 2. Deploy Models Two models are required: ...