LogicMonitor provides support for monitoring Azure OpenAI Service. LogicMonitor helps you optimize your Azure OpenAI environment by enhancing visibility of token transactions, response times and delays, deployment utilization, responsible AI indicators, and more.

Requirements for Monitoring Azure OpenAI

Install all OpenAI LogicModules from the LogicMonitor Module Exchange. If all OpenAI modules are already present, ensure the modules are using the most recent version.

For more information, see Module Installation.

Azure OpenAI LogicModules in Package

LogicMonitor’s package for Azure OpenAI consists of the following LogicModules. For full coverage, import all of the following LogicModules into your LogicMonitor platform:

Name	Type	Description
Microsoft_Azure_OpenAI	DataSource	Monitors metrics from Azure OpenAI deployments, including usage, latency, throughput, and Responsible AI indicators.
Microsoft_Azure_OpenAIModel	DataSource	Monitors key metrics form Azure OpenIA models, including token usage, request behavior, and latency measurements.
Microsoft_Azure_OpenAIModelDeployment	DataSource	Monitors key metrics from Azure OpenAI model deployments, including token usage, request behavior, and latency measurements.