Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Hack Update] 069-FabricRealTimeAnalytics - Real Time Intelligence rebranding changes to hack to bring it up to d… #899

Merged
merged 11 commits into from
Oct 16, 2024
Binary file not shown.
Binary file not shown.
27 changes: 0 additions & 27 deletions 069-FabricRealTimeAnalytics/Coach/Solution-01.md

This file was deleted.

Empty file.
Original file line number Diff line number Diff line change
Expand Up @@ -24,3 +24,5 @@ percentpricedifference
pricedifference
KQLDB
popout
eventstream
eventhouse
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
# What The Hack - Fabric Real-time Analytics - Coach Guide
# What The Hack - Fabric Real-time Intelligence - Coach Guide

## Introduction

Expand All @@ -8,13 +8,13 @@ Welcome to the coach's guide for the Fabric Real-time Analytics What The Hack. H

## Coach's Guides

0. Challenge 00: **[Prerequisites](Solution-00.md)**
- Challenge 00: **[Prerequisites](Solution-00.md)**
- Getting the environment setup for the rest of the challenges
1. Challenge 01: **[Ingesting the Data and Creating the Database](Solution-01.md)**
- Challenge 01: **[Ingesting the Data and Creating the Database](Solution-01.md)**
- Creating a database to store the real-time data
1. Challenge 02: **[Transforming the Data](Solution-02.md)**
- Challenge 02: **[Transforming the Data](Solution-02.md)**
- Transforming the data using KQL Querysets
1. Challenge 03: **[Create the Realtime Reporting](Solution-03.md)**
- Challenge 03: **[Create the Realtime Reporting](Solution-03.md)**
- Creating the Power BI reports, with real-time data

## Coach Prerequisites
Expand All @@ -40,14 +40,14 @@ This hack requires students to have access to an Azure subscription where they c
- Sample Day 1
- Challenge 0 (1 hour)
- Challenge 1 (2 hours)
- Challenge 2 (2 hours)
- Challenge 2 (2 hours)
- Challenge 3 (2 hours)

## Architecture Diagrams

![Architecture 1](Images/ArchitectureSlide1.PNG)

![Architecture 2](Images/ArchitectureSlide2.PNG)
![Architecture 2](Images/FabricLineageViewOfArchitecture.PNG)

## Repository Contents

Expand Down
Original file line number Diff line number Diff line change
@@ -1,10 +1,10 @@
# Challenge 00 - Prerequisites - Ready, Set, GO! - Coach's Guide
# Solution 00 - Prerequisites - Ready, Set, GO! - Coach's Guide

**[Home](./README.md)** - [Next Solution >](./Solution-01.md)

## Introduction

Thank you for participating in the Fabric real time analytics WTH. Before you can hack, you will need to set up some prerequisites.
Thank you for participating in the Fabric real time intelligence WTH. Before you can hack, you will need to set up some prerequisites.

## Common Prerequisites

Expand Down
41 changes: 41 additions & 0 deletions 069-FabricRealTimeIntelligence/Coach/Solution-01.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,41 @@
# Solution 01 - Ingesting and Creating the Database - Coach's Guide

[< Previous Solution](./Solution-00.md) - **[Home](./README.md)** - [Next Solution >](./Solution-02.md)

## Setup Steps

Steps for MAA Fabric Real-time intelligence:
1. Create Fabric capacity (F4)
1. Change Admin settings to allow 1 second page refresh
- Admin Portal
- Capacity settings
- PBI Workloads
2. Open PBI in the browser
3. Create a workspace and assign it to the Fabric capacity
4. New resource, create an Eventhouse
- This by default creates a KQL DB with the same name as the Eventhouse
5. Turn on Onelake folder
6. Create an Eventstream that brings in data from the Eventhub and outputs it to the KQL DB table
- Create new table name
- Create connection:
- Event hub namespace
- Event hub
- Sas key name
- Sas key
- Event retrieval start date (under more parameters)
- Schema should be JSON with no nested values

## Notes & Guidance

Unfortunately Fabric does not allow template automation for the items inside of it, so you will have to follow along with the students to create the example from scratch as they are doing.

The Learning Resource below have a useful tutorial to get you going if the steps laid out here are not enough.

## Learning Resources

- [Realtime Analytics in Fabric Tutorial](https://learn.microsoft.com/en-us/fabric/real-time-analytics/tutorial-introduction)
- [Creating an Eventhouse](https://learn.microsoft.com/en-us/fabric/real-time-intelligence/create-eventhouse)
- [Creating a KQL Database](https://learn.microsoft.com/en-us/fabric/real-time-analytics/create-database)
- [Get Data from Event Hubs into KQL](https://learn.microsoft.com/en-us/fabric/real-time-analytics/get-data-event-hub)
- [Creating an Eventstream](https://learn.microsoft.com/en-us/fabric/real-time-intelligence/event-streams/create-manage-an-eventstream?pivots=standard-capabilities)
- [Get Data from Eventstream into KQL](https://learn.microsoft.com/en-us/fabric/real-time-intelligence/get-data-eventstream)
Original file line number Diff line number Diff line change
@@ -1,21 +1,12 @@
# Challenge 02 - Transforming the Data - Coach's Guide
# Solution 02 - Transforming the Data - Coach's Guide

[< Previous Solution](./Solution-01.md) - **[Home](./README.md)** - [Next Solution >](./Solution-03.md)

## Setup Steps

Steps for MAA Fabric Real-time analytics setup:

1. Get data from event hub
- Create new table name
- Create connection:
- Event hub namespace
- Event hub
- Sas key name
- Sas key
- Event retrieval start date (under more parameters)
- Schema should be JSON with no nested values
7. Create kql queryset
Steps for MAA Fabric Real-time intelligence setup:

1. Create kql queryset (one is made by default in the KQL DB)

## Notes & Guidance

Expand Down
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
# Challenge 03 - Create the Realtime Reporting - Coach's Guide
# Solution 03 - Create the Realtime Reporting - Coach's Guide

[< Previous Solution](./Solution-02.md) - **[Home](./README.md)**

Expand Down
Original file line number Diff line number Diff line change
@@ -1,8 +1,8 @@
# What The Hack - Fabric Real-time Analytics
# What The Hack - Fabric Real-time Intelligence

## Introduction

The AbboCost Financial group monitors several crazy stocks! Because of the volatile nature of these stocks, they need Up to the Second real-time reporting on what the stocks are doing, as well as historical data on all previous stock prices. Luckily, you have just the solution for them: Fabric!
The AbboCost Financial group monitors several crazy stocks! Because of the volatile nature of these stocks, they need up to the second real-time reporting on what the stocks are doing, as well as historical data on all previous stock prices. Luckily, you have just the solution for them: Fabric!

## Learning Objectives

Expand All @@ -15,13 +15,13 @@ In this hack you will be solving the common business problem that companies have

## Challenges

0. Challenge 00: **[Prerequisites](Student/Challenge-00.md)**
- Challenge 00: **[Prerequisites](Student/Challenge-00.md)**
- Getting the environment setup for the rest of the challenges
1. Challenge 01: **[Ingesting the Data and Creating the Database](Student/Challenge-01.md)**
- Challenge 01: **[Ingesting the Data and Creating the Database](Student/Challenge-01.md)**
- Creating a database to store the real-time data
1. Challenge 02: **[Transforming the Data](Student/Challenge-02.md)**
- Challenge 02: **[Transforming the Data](Student/Challenge-02.md)**
- Create a queryset to add information to the data
1. Challenge 03: **[Create Realtime Reporting](Student/Challenge-03.md)**
- Challenge 03: **[Create Realtime Reporting](Student/Challenge-03.md)**
- Creating the Real-time Power BI reports

## Prerequisites
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@

## Introduction

Thank you for participating in the Fabric Real-time Analytics What The Hack. Before you can hack, you will need to set up some prerequisites.
Thank you for participating in the Fabric Real-time Intelligence What The Hack. Before you can hack, you will need to set up some prerequisites.

## Common Prerequisites

Expand Down Expand Up @@ -46,7 +46,7 @@ az group create --name myIoT-rg --location eastus
az group deployment create -g myIoT-rg --name HackEnvironment -f setupIoTEnvironment.json
```

After deploying the ARM template, navigate to the resource group and create a Fabric capacity in the Azure portal. F2 SKU is more than enough for this WTH.
After deploying the ARM template, navigate to the resource group and create a Fabric capacity in the Azure portal. F4 SKU is more than enough for this WTH.

## Success Criteria

Expand All @@ -56,4 +56,4 @@ To complete this challenge successfully, you should be able to:
- Event Hub Namespace
- Event Hub (verify it is ingesting data from the container)
- Azure Container Instance (verify that it is running the Docker container and data is streaming out, go to logs to verify this)
- Fabric instance created and running
- Fabric instance created and running (F4)
Original file line number Diff line number Diff line change
Expand Up @@ -20,8 +20,11 @@ To complete this challenge successfully, you should be able to:
## Learning Resources

- [Realtime Analytics in Fabric Tutorial](https://learn.microsoft.com/en-us/fabric/real-time-analytics/tutorial-introduction)
- [Creating an Eventhouse](https://learn.microsoft.com/en-us/fabric/real-time-intelligence/create-eventhouse)
- [Creating a KQL Database](https://learn.microsoft.com/en-us/fabric/real-time-analytics/create-database)
- [Get Data from Event Hubs into KQL](https://learn.microsoft.com/en-us/fabric/real-time-analytics/get-data-event-hub)
- [Creating an Eventstream](https://learn.microsoft.com/en-us/fabric/real-time-intelligence/event-streams/create-manage-an-eventstream?pivots=standard-capabilities)
- [Get Data from Eventstream into KQL](https://learn.microsoft.com/en-us/fabric/real-time-intelligence/get-data-eventstream)


## Tips
Expand Down