diff --git a/docs/content/patterns/artificial intelligence/Use Cases/index.md b/docs/content/patterns/artificial intelligence/_index.md similarity index 86% rename from docs/content/patterns/artificial intelligence/Use Cases/index.md rename to docs/content/patterns/artificial intelligence/_index.md index d831963cd..f78bb90fb 100644 --- a/docs/content/patterns/artificial intelligence/Use Cases/index.md +++ b/docs/content/patterns/artificial intelligence/_index.md @@ -1,7 +1,12 @@ -# Overview +--- +title: Artificial Intelligence +geekdocCollapseSection: true +--- + +## Overview There are numerous ways to implement AI solution on Azure, and each comes with its own monitoring solution. Monitoring AI solutions involves a combination of the infra or paas resources, along with monitoring any utilization metrics that can be exposed through the platform or other tooling. This page will summarize the recommended monitoring solutions for different scenarios. -## AI on Infrastructure (BYOM) +### AI on Infrastructure (BYOM) Running AI workloads on Azure infrastructure involves monitoring each of the components of the solution, including virtual machines, storage, and networking. Refer to the defined metrics in [HPC](../../specialized/hpc/Alerting-and-Monitoring.md). For monitoring the GPU/CPU metrics, use [Moneo](https://github.com/Azure/Moneo) diff --git a/docs/content/patterns/artificial intelligence/azureopenai/index.md b/docs/content/patterns/artificial intelligence/azureopenai/index.md new file mode 100644 index 000000000..849f09eaf --- /dev/null +++ b/docs/content/patterns/artificial intelligence/azureopenai/index.md @@ -0,0 +1,51 @@ +--- +title: Azure OpenAI +geekdocCollapseSection: false +geekdocHidden: true +--- + +## Deploy monitoring for AI Services + +### What is Azure AI Services? + +Azure AI services help developers and organizations rapidly create intelligent, cutting-edge, market-ready, and responsible applications with out-of-the-box and prebuilt and customizable APIs and models. Example applications include natural language processing for conversations, search, monitoring, translation, speech, vision, and decision-making. +The following is a comprehensive list of the services within Azure AI Services: +![alt text](<../../../static/img/Azure AI services.png>) + +### AzureOpen AI + +Azure OpenAI Service provides REST API access to OpenAI's powerful language models including GPT-4o, GPT-4o mini, GPT-4 Turbo with Vision, GPT-4, GPT-3.5-Turbo, and Embeddings model series. These models can be easily adapted to your specific task including but not limited to content generation, summarization, image understanding, semantic search, and natural language to code translation. Users can access the service through REST APIs, Python SDK, or our web-based interface in the Azure OpenAI Studio. + +### Responsible AI + +At Microsoft, we're committed to the advancement of AI driven by principles that put people first. Generative models such as the ones available in Azure OpenAI have significant potential benefits, but without careful design and thoughtful mitigations, such models have the potential to generate incorrect or even harmful content. Microsoft has made significant investments to help guard against abuse and unintended harm, which includes incorporating Microsoft’s principles for responsible AI use, adopting a Code of Conduct for use of the service, building content filters to support customers, and providing responsible AI information and guidance that customers should consider when using Azure OpenAI. + +## Azure Monitoring tools + +Before embarking on designing and deploying AzureOpen AI Monitoring, It`s important to familiarize yourself with the necessary Azure services and tools. These include: + +* Azure Monitor: This service provides comprehensive solutions for collecting, analyzing, and acting on telemetry from your cloud and on-premises environments. Additionally, this service provides an integrated management environment that includes Metrics, Insights, and Log Analytics workspaces. +* Azure Log Analytics workspace: Part of Azure monitor, it collects and analyzes data generated by resources in your cloud and on-premises environments. + +### Tools that allow for visualization + +* ***Dashboards*** that let you combine different kinds of data into a single pane in the Azure portal. +* ***Workbooks***, customizable reports that you can create in the Azure portal. Workbooks can include text, metrics, and log queries. +* ***Grafana***, an open platform tool that excels in operational dashboards. You can use Grafana to create dashboards that include data from multiple sources other than Azure Monitor. +* ***Power BI***, a business analytics service that provides interactive visualizations across various data sources. You can configure Power BI to automatically import log data from Azure Monitor to take advantage of these visualizations. + +## Azure OpenAI Insights + +This workbook offers deep insights into Azure OpenAI resources and usage (Platform Metrics and Logs) and can be powerful tool in analyzing & monitoring your AI initiatives. + +Insights usage: +Prior to using insights to monitoring your open AI instance you will need to configure diagnostic settings. + +Getting started: Step by step + +* Step 1: Download the workbook from [here](https://raw.githubusercontent.com/dolevshor/Azure-OpenAI-Insights/main/Workbook/Azure%20OpenAI%20Insights.workbook). +* Step 2: Import the workbook into your Azure Monitor workspace. Check out our repository for detailed steps. +* Step 3: Optional step; Enable diagnostic settings for your Azure OpenAI resource. This will allow you to view additional dimensions and logs in the workbook. More information on the level of details later in this post. +* Step 4: Explore the workbook. +![alt text](../../../static/img/aoai_insights_workbook_overview.png) +For full details on this workbook, check out the link [here](https://techcommunity.microsoft.com/t5/fasttrack-for-azure/azure-openai-insights-monitoring-ai-with-confidence/ba-p/4026850) diff --git a/docs/content/patterns/artificial intelligence/index.md b/docs/content/patterns/artificial intelligence/index.md deleted file mode 100644 index dcab696ae..000000000 --- a/docs/content/patterns/artificial intelligence/index.md +++ /dev/null @@ -1,4 +0,0 @@ ---- -title: Artificial Intelligence -geekdocCollapseSection: true ---- diff --git a/docs/static/img/Azure AI services.png b/docs/static/img/Azure AI services.png new file mode 100644 index 000000000..69512d1ba Binary files /dev/null and b/docs/static/img/Azure AI services.png differ diff --git a/docs/static/img/aoai_insights_workbook_overview.png b/docs/static/img/aoai_insights_workbook_overview.png new file mode 100644 index 000000000..8509edf40 Binary files /dev/null and b/docs/static/img/aoai_insights_workbook_overview.png differ diff --git a/services/CognitiveServices/accounts/_index.md b/services/CognitiveServices/accounts/_index.md index ddd26b99e..c158109b7 100644 --- a/services/CognitiveServices/accounts/_index.md +++ b/services/CognitiveServices/accounts/_index.md @@ -1,7 +1,7 @@ --- title: accounts geekdocCollapseSection: true -geekdocHidden: false +geekdocHidden: true --- -{{< alertList name="alertList" >}} \ No newline at end of file +{{< alertList name="alertList" >}} diff --git a/services/CognitiveServices/accounts/alerts.yaml b/services/CognitiveServices/accounts/alerts.yaml index 04ea3e507..9d8a784db 100644 --- a/services/CognitiveServices/accounts/alerts.yaml +++ b/services/CognitiveServices/accounts/alerts.yaml @@ -152,3 +152,1652 @@ criterionType: StaticThresholdCriterion threshold: 0.0 guid: ec8c928a-5206-4059-8aea-8486004dd30d +- name: ActionFeaturesIdOccurrences + description: NNumber of times each action feature appears. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: ActionFeaturesIdOccurrences + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: 397fef65-9192-4310-b9da-57cc1513c809 +- name: ActionFeaturesPerEvent + description: Average number of action features per event. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: ActionFeaturesPerEvent + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: 780c451d-bf30-4e36-b544-ea994ca32f43 +- name: ActionIfOccurrence + description: Number of times each action appears. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: ActionIfOccurrence + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: 69338f82-3e4a-4ff2-bb00-6aec7e84e3f4 +- name: ActionNamespacePerEvent + description: Average number of action namespaces per event. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: ActionNamespacePerEvent + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: 0db7da9c-960d-4122-9976-adc029da7b12 +- name: ActionPerEvent + description: Number of actions per event. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: ActionPerEvent + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: 1221f6e7-8f44-4d91-b0ed-d72920d4d496 +- name: ActiveTokens + description: Total tokens minus cached tokens over a period of time. Applies to PTU and PTU-managed deployments. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: ActiveTokens + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: ab9d016d-b31b-4144-9b76-f5b1c625fa9b +- name: AudioSecondsTranscribed + description: Number of seconds transcribed. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: AudioSecondsTranscribed + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: 43d8c4af-9534-4bda-8840-1513181fabb2 +- name: AudioSecondsTranslated + description: Number of seconds translated. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: AudioSecondsTranslated + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: d0bc3cdd-eade-4dfd-9b44-3ce8219a5e13 +- name: AvatarModelHostingSeconds + description: Number of seconds. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: AvatarModelHostingSeconds + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: 0fc4ed4a-068b-4144-b2b3-d34114577175 +- name: AzureOpenAIContextTokensCacheMatchRate + description: Percentage of the prompt tokens hit the cache, avaiable for PTU-managed. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: AzureOpenAIContextTokensCacheMatchRate + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: 81f8369c-65bf-4194-bfd2-ffdfa2470577 +- name: AzureOpenAIProvisionedManagedUtilization + description: Utilization % for a provisoned-managed deployment, calculated as (PTUs consumed / PTUs deployed) x 100. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: AzureOpenAIProvisionedManagedUtilization + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: 5ca4e110-09b4-4fe5-bb8f-4fa3f35f8fca +- name: AzureOpenAIProvisionedManagedUtilizationV2 + description: Utilization % for a provisoned-managed deployment, calculated as (PTUs consumed / PTUs deployed) x 100. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: AzureOpenAIProvisionedManagedUtilizationV2 + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: 693a3b37-1e2a-42d1-aaed-b1f374276d1c +- name: AzureOpenAIRequests + description: Number of calls made to the Azure OpenAI API over a period of time. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: AzureOpenAIRequests + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: a1528d17-f288-46b1-b084-8b8fe3af90fa +- name: AzureOpenAITimeToResponse + description: Recommended latency (responsiveness) measure for streaming requests. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: AzureOpenAITimeToResponse + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: 995cc12a-1887-4669-92c5-70a6ca8bfe70 +- name: BaselineEstimatorOverallReward + description: Baseline Estimator Overall Reward. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: BaselineEstimatorOverallReward + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: a27171ed-8c6c-4995-b3e4-ff1f1dd0cc90 +- name: BaselineEstimatorSlotReward + description: Baseline Estimator Reward by slot. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: BaselineEstimatorSlotReward + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: cd9ba872-2f2d-4cf8-8957-e7ffa6b7e5fc +- name: BaselineRandomEstimatorOverallReward + description: Baseline Random Estimator Overall Reward. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: BaselineRandomEstimatorOverallReward + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: 8081760a-4b0c-4ae8-86a0-5b7cc418d2bb +- name: BaselineRandomEstimatorSlotReward + description: Baseline Random Estimator Reward by slot. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: BaselineRandomEstimatorSlotReward + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: 7fd0ac93-49e5-4ecd-96dd-5a1b91c27ce1 +- name: BaselineRandomEventCount + description: Estimation for baseline random event count. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: BaselineRandomEventCount + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: b34ff46a-3335-485d-8955-3c12b89e0429 +- name: BaselineRandomReward + description: Estimation for baseline random reward. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: BaselineRandomReward + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: d4666cca-c55a-4c38-9c83-35184d82dbb0 +- name: BlockedCalls + description: Number of calls that exceeded rate or quota limit. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: BlockedCalls + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: 64af1ec3-218f-4348-a91d-101b48453477 +- name: CarnegieInferenceCount + description: Inference Count of Carnegie Frontdoor Service. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: CarnegieInferenceCount + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: 87cf02fd-d12a-4c8d-85b7-01f616866f8c +- name: ClientErrors + description: Number of calls with client side error (HTTP response code 4xx). Do not use for Azure OpenAI service. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: ClientErrors + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: 05d55a15-cc87-42c7-a6b1-0042e3fac3f2 +- name: ComputerVisionTransactions + description: Number of Computer Vision Transactions. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: ComputerVisionTransactions + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: 493511fe-f9a1-450d-a5c6-c4062fb0d2c9 +- name: ContentSafetyImageAnalyzeRequestCount + description: Number of calls for image moderation. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: ContentSafetyImageAnalyzeRequestCount + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: 404c9224-ecfd-4f11-b6de-9439f5c4ff9b +- name: ContentSafetyTextAnalyzeRequestCount + description: Number of calls for text moderation. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: ContentSafetyTextAnalyzeRequestCount + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: 4be881a1-a702-481c-a1ad-399b100cabdb +- name: ContextFeatureIdOccurrences + description: Number of times each context feature appears. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: ContextFeatureIdOccurrences + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: a86c358c-5603-4e66-b5f7-87c19ddd5e9f +- name: ContextFeaturesPerEvent + description: Number of context features per event. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: ContextFeaturesPerEvent + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: 0704975d-f5fb-4031-8d07-18a79f4788da +- name: ContextNamespacesPerEvent + description: Number of context namespaces per event. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: ContextNamespacesPerEvent + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: 60aa78cd-66d4-421b-92a4-e20f138518d9 +- name: CustomVisionTrainingTime + description: Custom Vision training time. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: CustomVisionTrainingTime + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: 1de7e287-53d0-41e4-b37c-701470e82543 +- name: CustomVisionTransactions + description: Number of Custom Vision prediction transactions. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: CustomVisionTransactions + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: e7d44227-8e9b-4698-a398-24e2afe25408 +- name: DataIn + description: Size of incoming data in bytes. Do not use for Azure OpenAI service. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: DataIn + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: 0fd9d459-4d84-422c-ad72-ce8788a13f4d +- name: DataOut + description: Size of outgoing data in bytes. Do not use for Azure OpenAI service. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: DataOut + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: 0e4e5a62-95e2-4fc0-97e0-b6b6574fe1f5 +- name: DocumentCharactersTranslated + description: Number of characters in document translation request. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: DocumentCharactersTranslated + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: fe4eba6e-8488-4d69-8c5b-b247fe556012 +- name: DocumentCustomCharactersTranslated + description: Number of custom characters in document translation request. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: DocumentCustomCharactersTranslated + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: 7fce7630-0db2-4279-9b81-cb06ad7d83ca +- name: FaceImagesTrained + description: Number of images trained. 1,000 images trained per transaction. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: FaceImagesTrained + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: fa6564b0-870b-4b21-b648-6a793d7a2797 +- name: FacesStored + description: Number of faces stored, prorated daily. The number of faces stored is reported daily. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: FacesStored + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: 3846fe0-d373-4548-af44-a2d7a2ba3399 +- name: FaceTransactions + description: Number of API calls made to Face service + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: FaceTransactions + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: c382a635-df8d-4d19-86de-daa28de4dce7 +- name: FeatureCardinality_Action + description: Feature Cardinality based on Action. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: FeatureCardinality_Action + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: 3657d258-5623-4480-84ca-3ba6226d1378 +- name: FeatureCardinality_Context + description: Feature Cardinality based on Context. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: FeatureCardinality_Context + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: d582a978-ce14-484a-b759-84903838979c +- name: FeatureCardinality_Slot + description: Feature Cardinality based on Slot. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: FeatureCardinality_Slot + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: bfe3b067-314b-46bf-925e-e81f66cf910f +- name: FineTunedTrainingHours + description: Number of Training Hours Processed on an OpenAI FineTuned Model. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: FineTunedTrainingHours + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: 52909b9b-190d-4d7b-9900-1789ce0b937b +- name: GeneratedTokens + description: Number of tokens generated (output) from an OpenAI model. Applies to PTU, PTU-Managed and Pay-as-you-go deployments. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: GeneratedTokens + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: 7fbd5f2d-00f0-4ca1-8d5f-0233d0a3f910 +- name: ImagesStored + description: Number of Custom Vision images stored. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: ImagesStored + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: 2b1b7563-e1ec-4f56-9caf-f2cb019bc04f +- name: Latency + description: Latency in milliseconds. Do not use for Azure OpenAI service. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: Latency + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: d673ed33-d3f0-47b4-8270-03de31d91382 +- name: LearnedEvents + description: Number of learned events. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: LearnedEvents + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: 66b4ade6-1ae4-430e-b545-5c1c188b780c +- name: LUISSpeechRequests + description: Number of LUIS speech to intent understanding requests. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: LUISSpeechRequests + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: e4c3e04b-15c3-4883-8351-a87a4510e40e +- name: LUISTextRequests + description: Number of LUIS text requests. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: LUISTextRequests + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: 4c766f95-57b7-4a3b-bba3-8801265dbc01 +- name: MatchedRewards + description: Number of matched rewards. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: MatchedRewards + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: c41c172e-b804-42c4-b329-aa255c85f506 +- name: NonActivatedEvents + description: Number of non-activated events. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: NonActivatedEvents + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: b5283ee6-b4a5-4e5e-890d-12ebca7f54e7 +- name: NumberOfSlots + description: Number of slots per event. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: NumberOfSlots + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: a1d7f8c7-1182-4241-b3f6-e086309d7ac1 +- name: NumberofSpeakerProfiles + description: Number of speaker profiles enrolled. Prorated hourly. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: NumberofSpeakerProfiles + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: f5425eb7-e311-4336-b5ab-7a9b2b0d5dea +- name: ObservedRewards + description: Number of observed rewards. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: ObservedRewards + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: 6b7ae03b-e2c8-4115-a560-4144a455816b +- name: OneDocumentCharactersTranslated + description: Number of characters in document translation (synchronous) request. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: OneDocumentCharactersTranslated + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: eee95c4b-db79-48e5-9a5c-ef921a22e3c0 +- name: OnlineEstimatorOverallReward + description: Online Estimator Overall Reward. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: OnlineEstimatorOverallReward + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: 73c87a60-8de8-414e-9cc5-81a3ca14d687 +- name: OnlineEstimatorSlotReward + description: Online Estimator Reward by slot. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: OnlineEstimatorSlotReward + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: c61d3a5c-4aa4-4c6a-8bc0-859061559b4c +- name: OnlineEventCount + description: Estimation for online event count. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: OnlineEventCount + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: e360aeac-66a6-4bf0-8e36-475608c6d02b +- name: OnlineReward + description: Estimation for online reward. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: OnlineReward + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: 86e00692-7e42-4a4c-86a3-21c70add7bd3 +- name: ProcessedCharacters + description: Number of Characters processed by Immersive Reader. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: ProcessedCharacters + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: 4b474463-3243-4966-a4d0-8404760b9ca3 +- name: ProcessedHealthTextRecords + description: Number of health text records processed. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: ProcessedHealthTextRecords + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: bf42c604-b4f7-4b6c-8a33-2f5e1912d306 +- name: ProcessedImages + description: Number of images processed. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: ProcessedImages + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: fcd3e37c-82bb-48df-8860-f1b4f01d4cc3 +- name: ProcessedPages + description: Number of pages processed. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: ProcessedPages + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: bb4ebaf2-e5ec-47cc-b8a8-2428e924721c +- name: ProcessedPromptTokens + description: Number of prompt tokens processed (input) on an OpenAI model. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: ProcessedPromptTokens + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: 30dc0126-1466-4c11-9096-a7fffc552bc8 +- name: ProcessedTextRecords + description: Count of Text Records. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: ProcessedTextRecords + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: 5aeb1d15-f8f3-49d5-8894-b6af0d89d935 +- name: QuestionAnsweringTextRecords + description: Number of text records processed + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: QuestionAnsweringTextRecords + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: c8f71cfd-42cd-4063-92fc-d6560697250d +- name: RAIAbusiveUsersCount + description: Number of potentially abusive user that detected over a period of time. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: RAIAbusiveUsersCount + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: f2926569-df78-4c68-90a7-3c5f96cfa1f3 +- name: RAIHarmfulRequests + description: Number of calls made to Azure OpenAI API and detected as harmful(both block model and annotate mode) by content filter applied over a period of time. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: RAIHarmfulRequests + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: e7341b29-84ea-4ca2-8140-e774b1cd1444 +- name: RAIRejectedRequests + description: Number of calls made to Azure OpenAI API and rejected by content filter applied over a period of time. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: RAIRejectedRequests + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: a97c7421-8268-4837-b433-762882c3887f +- name: RAISystemEvent + description: System event for risks & safety monitoring. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: RAISystemEvent + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: b0bf777b-90e9-4aed-b8e2-94ab9755d1ca +- name: RAITotalRequests + description: Number of calls made to Azure OpenAI API and detected by content filter applied over a period of time. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: RAITotalRequests + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: 82c2b472-2084-4122-8bb5-51142ce19101 +- name: Ratelimit + description: The current ratelimit of the ratelimit key. Do not use for Azure OpenAI service. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: Ratelimit + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: b269a4f9-ba74-4061-abc1-655d656c1c5f +- name: Reward + description: Average reward per event. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: Reward + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: 3984067c-1e9b-41ee-9464-1f6b2df45cea +- name: ServerErrors + description: Number of calls with server side error (HTTP response code 5xx). Do not use for Azure OpenAI service. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: ServerErrors + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: 6293ec35-7a2c-49a2-8479-84f93068872e +- name: SlotFeatureIdOccurrences + description: Number of times each slot feature appears. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: SlotFeatureIdOccurrences + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: b05249b2-d6f2-4c2e-a14b-a25353053e6d +- name: SlotFeaturesPerEvent + description: Average number of slot features per event. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: SlotFeaturesPerEvent + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: 6495d787-2701-45ea-8abd-f23b18ed6e66 +- name: SlotIdOccurrences + description: Number of times each slot appears. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: SlotIdOccurrences + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: 12ffdc4a-2ac4-4b4b-bf04-c5b48d2f0904 +- name: SlotNamespacesPerEvent + description: Average number of slot namespaces per event. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: SlotNamespacesPerEvent + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: c87a2b96-2308-4d2c-9353-8d300f0e542c +- name: SlotRewards + description: Reward per slot. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: SlotRewards + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: 13d1dc54-12a8-475d-8a87-d9060df9f348 +- name: SpeakerRecognitionTransactions + description: Number of speaker recognition transactions. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: SpeakerRecognitionTransactions + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: 1f6e25bb-1412-46b8-b4cf-de1498a03927 +- name: SpeechModelHostingHours + description: Number of speech model hosting hours. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: SpeechModelHostingHours + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: 0433dc7d-e9c0-4d32-8295-ce24cd9e453b +- name: SpeechModelHostingHours + description: Number of speech model hosting hours. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: SpeechModelHostingHours + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: 2aa2bd92-85bd-47b8-ac48-3c672fdbb486 +- name: SuccessfulCalls + description: Number of successful calls. Do not use for Azure OpenAI service. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: SuccessfulCalls + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: 715804f2-6789-4b83-9c5f-bee2a805bbc2 +- name: SuccessRate + description: Availability percentage with the following calculation; (Total Calls - Server Errors)/Total Calls. Server Errors include any HTTP responses >=500. Do not use for Azure OpenAI service. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: SuccessRate + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: edc719b7-66cf-45cd-8fde-f153b0462c4e +- name: SynthesizedCharacters + description: Number of characters. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: SynthesizedCharacters + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: b0320e4c-7f6d-4990-b2b9-12f1fcb103cf +- name: TextCharactersTranslated + description: Number of characters in text translation request. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: TextCharactersTranslated + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: 2785f1ab-abcc-44da-8e08-d16c74e67002 +- name: TextCustomCharactersTranslated + description: Number of custom characters in text translation request. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: TextCustomCharactersTranslated + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: 50959073-a6ad-4b63-b76e-4a22745e5852 +- name: TextTrainedCharacters + description: Number of characters trained using text translation. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: TextTrainedCharacters + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: 528496f5-e701-4a9e-8b4c-c876be59c9dc +- name: TokenTransaction + description: Number of inference tokens processed on an OpenAI model. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: TokenTransaction + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: 2f4a4eb0-310a-4eae-ba0c-66d93fe1de6e +- name: TotalCalls + description: Total number of calls. Do not use for Azure OpenAI service. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: TotalCalls + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: 82b6364c-a0c8-4012-8ef9-f638c3132f38 +- name: TotalErrors + description: Total number of errors(HTTP response code 4xx or 5xx). Do not use for Azure OpenAI service. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: TotalErrors + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: 39d82158-fc44-41ee-9b31-602f8a069379 +- name: TotalEvents + description: Number of events. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: TotalEvents + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: 2a65a81a-be78-499f-bca4-64976249a0cd +- name: TotalTokenCalls + description: Total number of token calls. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: TotalTokenCalls + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: 369652ae-56b1-4620-be56-0024629b2cad +- name: UserBaselineEventCount + description: Estimation for user defined baseline event count. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: UserBaselineEventCount + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: 61defc4a-43af-4667-b63a-02c28af099be +- name: UserBaselineReward + description: Estimation for user defined baseline reward. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: UserBaselineReward + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: 9386f63a-026e-4c91-886e-c10478132bdd +- name: VideoSecondsSynthesized + description: Number of seconds synthesized. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: VideoSecondsSynthesized + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: 81268206-66e5-4b33-8205-93147fc5989c +- name: VoiceModelHostingHours + description: Number of hours. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: VoiceModelHostingHours + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: 7d5cc479-cf69-44bc-a612-eac4b20fdc08 +- name: VoiceModelTrainingMinutes + description: Number of minutes. + type: Metric + verified: false + visible: false + tags: manual-ck + properties: + metricName: VoiceModelTrainingMinutes + metricNamespace: Microsoft.CognitiveServices/accounts + severity: 0 + windowSize: PT5M + evaluationFrequency: PT1M + timeAggregation: Total + operator: GreaterThan + criterionType: StaticThresholdCriterion + threshold: 0.0 + guid: 39eaa390-7c58-4b79-af20-e47138e7ed97 diff --git a/services/Search/searchServices/alerts.yaml b/services/Search/searchServices/alerts.yaml index 75ea504e9..5b1c86551 100644 --- a/services/Search/searchServices/alerts.yaml +++ b/services/Search/searchServices/alerts.yaml @@ -36,3 +36,23 @@ criterionType: StaticThresholdCriterion threshold: 10.0 guid: 7a044f2f-f38f-4f13-82eb-c7f49bf17ad0 +- name: Activity Log Search Service Delete + description: Activity Log Alert for Search Service Delete + type: ActivityLog + verified: false + visible: true + tags: + - manual + properties: + category: Administrative + operationName: Microsoft.Search/searchServices/delete + status: + - succeeded + references: + - name: Activity Log Service Notifications + url: https://learn.microsoft.com/azure/service-health/alerts-activity-log-service-notifications-portal + - name: Best practices for setting up service health alerts + url: https://www.microsoft.com/videoplayer/embed/RE2OtUa + - name: Azure AI Search Alert Rules + url: https://learn.microsoft.com/en-us/azure/search/monitor-azure-cognitive-search#azure-ai-search-alert-rules + guid: 5611eb31-51c7-4279-ab8c-97dba0a2c044