Monthly Archives: June 2023

DP-203 Data Engineering on Microsoft Azure – Design and Develop Data Processing – Azure Databricks Part 7

22. Lab – Azure Data Lake Storage Credential Passthrough Now in this chapter, I want to go through a scenario wherein you can actually make use of something known as your ad Credential pass-through. So earlier on we had seen that if we wanted to fetch data from a data lake gen two storage account,… Read More »

DP-203 Data Engineering on Microsoft Azure – Design and Develop Data Processing – Azure Databricks Part 6

19. Lab – Getting data from Azure Data Lake – Implementation So in the previous chapter we had created our keyword. We create a key in the keyword. Now it’s time to create something known as a databricks scoped secret. So for that I need to go on to my Databricks resource. So here, here… Read More »

DP-203 Data Engineering on Microsoft Azure – Design and Develop Data Processing – Azure Databricks Part 5

17. Lab – Structured Streaming – Streaming from Azure Event Hubs – Implementation So where did we leave off in the last chapter? So, we had run our notebook to read events from the Event Stream, but we were getting the body of our event in some sort of encoded format. So I have now… Read More »

DP-203 Data Engineering on Microsoft Azure – Design and Develop Data Processing – Azure Databricks Part 4

12. Lab – Filtering on NULL values Now in this chapter, I just want to quickly show you again, how do you filter on null values? Again, something we had seen earlier on when it came to working with Azure Synapse, the Spark Pool. So just one thing that I want to confirm. Let me… Read More »

DP-203 Data Engineering on Microsoft Azure – Design and Develop Data Processing – Azure Databricks Part 3

7. Lab – Reading a CSV file Now, in this chapter, we’ll see how to process our log CSV file. So, one of the most important aspects when it comes on to any service that we have seen. So, from the exam perspective, you should be able to understand how to go through CSV files,… Read More »

DP-203 Data Engineering on Microsoft Azure – Design and Develop Data Processing – Azure Databricks Part 2

4. Lab – Creating a cluster Now in the last chapter, we have gone ahead and create our workspace. In this chapter, we are going to now create a cluster. So the cluster will have the underlying machines that is going to have Spark installed. So as part of the data bricks implementation, you have… Read More »

DP-203 Data Engineering on Microsoft Azure – Design and Develop Data Processing – Azure Databricks

1. What is Azure Databricks Now, before we actually go into Azure data bricks, let me go ahead and first explain the need for Data Bricks itself. So, Databricks is a company that was actually founded by the original creators of Apache Spark. So Data Bricks itself, the service actually makes use of Apache Spark… Read More »

MS-203 Microsoft 365 Messaging – Troubleshoot Mail Flow Problem Part 3

5. Analyze Message Headers with the Remote Connectivity Analyzer Let’s take some time now and talk about a really great web based tool that Microsoft provides us. This tool is called the remote connectivity analyzer, okay. Also known as RCA. We can get to this tool by typing test connectivity Microsoft. com. So we’re going… Read More »

MS-203 Microsoft 365 Messaging – Troubleshoot Mail Flow Problem Part 2

3. Configuring Message Tracking Okay. And we’re going to be using a command called get Message Tracking log. Now if I type that command, let in right now, get message tracking log, hit Enter, it’s just going to show me everything, okay, everything that’s been happening and I’m going to hit control C to break… Read More »

MS-203 Microsoft 365 Messaging – Troubleshoot Mail Flow Problem

1. Examining Message Trace in Exchange Online We’re now going to take a look at something called message Trace in Exchange Online. Now Message Trace is a feature that is going to allow us to see email that’s been flowing within our Exchange Online organization, okay? They’ve made this really simple to use, real easy… Read More »

img