Streaming Application Insight data to Power BI

[Rodi123]

Is it possible to create a real-time dashboard in Power BI using data from Azure Application Insights, such as the Requests table?

[Anonymous · Accepted solution]

Hi @Rodi123 ,

You mentioned "real-time dashboard in Power BI". Do you want to use the real-time dashboard in Real-time Intelligence or the dashboard in Power BI? These are two different products, and there is no such thing as a real-time dashboard in Power BI.

If you are talking about Real-time Intelligence, you need to connect to the data source first, and then create a real-time dashboard through Kusto Query. Real-time Intelligence currently does not have a connector that can directly connect to Azure Application Insights. You need to first create an Event Hubs namespace and an event hub in Azure Event Hub, and then use data collection rules in Azure Monitor to stream logs and metrics to Event Hubs. For specific steps, you can refer to the following documents:
Stream Azure monitoring data to an event hub and external partners - Azure Monitor | Microsoft Learn

You can then create a real-time dashboard, using the Azure Event hub as a data source:
Create a Real-Time Dashboard - Microsoft Fabric | Microsoft Learn

Best Regards,
Dino Tao
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

[nilendraFabric · Accepted solution]

HI @Rodi123 

Tt is possible to create a real-time dashboard in Power BI using data from Azure Application Insights.
It can be acheived in many ways :

1. Using Azure Stream Analytics for Real-Time Streaming
Azure Stream Analytics (ASA) can process data exported from Application Insights in real time and send it to Power BI for visualization:

Continuous Export: Set up continuous export from Application Insights to an Azure Blob Storage container.
Stream Analytics Job: Configure an Azure Stream Analytics job to ingest the exported data from Blob Storage.
Output to Power BI: Use the Power BI output option in Stream Analytics to send processed data directly to a Power BI streaming dataset.
Real-Time Dashboard: Create a Power BI dashboard using the streaming dataset, which updates in real time as new data flows through Stream Analytics
This method is highly scalable and supports near real-time updates.

2. Direct Query via Azure Data Explorer (ADX)
You can use the Azure Data Explorer (ADX) connector in Power BI to query Application Insights data directly:

Kusto Query Language (KQL): Write KQL queries in Application Insights Logs to retrieve data, such as from the Requests table.
Direct Query Mode: Connect Power BI to Application Insights via ADX and use Direct Query mode. This allows for near real-time updates with features like automatic page refresh
This approach is simpler but may have limitations on query complexity and performance.

3. Application Insights REST API with Power BI Streaming Dataset
For smaller-scale solutions or custom needs:

Use the Application Insights REST API to fetch telemetry data like Requests.
Push this data into a Power BI streaming dataset using tools like Power Automate or custom scripts.
Build a dashboard in Power BI that updates whenever new data is pushed

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

Thanks 
Nilendra

[Anonymous · Accepted solution]

Hi @Rodi123 ,

You mentioned "real-time dashboard in Power BI". Do you want to use the real-time dashboard in Real-time Intelligence or the dashboard in Power BI? These are two different products, and there is no such thing as a real-time dashboard in Power BI.

If you are talking about Real-time Intelligence, you need to connect to the data source first, and then create a real-time dashboard through Kusto Query. Real-time Intelligence currently does not have a connector that can directly connect to Azure Application Insights. You need to first create an Event Hubs namespace and an event hub in Azure Event Hub, and then use data collection rules in Azure Monitor to stream logs and metrics to Event Hubs. For specific steps, you can refer to the following documents:
Stream Azure monitoring data to an event hub and external partners - Azure Monitor | Microsoft Learn

You can then create a real-time dashboard, using the Azure Event hub as a data source:
Create a Real-Time Dashboard - Microsoft Fabric | Microsoft Learn

Best Regards,
Dino Tao
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.