Introduction

In this course, the student will learn about the data engineering as it pertains to working with batch and real-time analytical solutions using Azure data platform technologies. Students will begin by understanding the core compute and storage technologies that are used to build an analytical solution.

The students will learn how to interactively explore data stored in files in a data lake. They will learn the various ingestion techniques that can be used to load data using the Apache Spark capability found in Azure Synapse Analytics or Azure Databricks, or how to ingest using Azure Data Factory or Azure Synapse pipelines.

The students will also learn the various ways they can transform the data using the same technologies that is used to ingest data. They will understand the importance of implementing security to ensure that the data is protected at rest or in transit.

The student will then show how to create a real-time analytical system to create real-time analytical solutions.

Objectives

This exam measures the ability to perform the technical tasks listed below:

• Design and implement data warehousing
• Design and develop data processing
• Design and implement data security
• Monitor and optimize data storage and data processing

Student profile

The primary audience for this course is data professionals, data architects, and business intelligence professionals who want to learn about data engineering and building analytical solutions using data platform technologies that exist on Microsoft Azure.

Prerequisites

Successful students start this course with knowledge of cloud computing and core data concepts and professional experience with data solutions.

Specifically completing:

• AZ-900 – Azure Fundamentals
• DP-900 – Microsoft Azure Data Fundamentals

Course Materials

Students will receive a copy of the official Microsoft documentation in a digital format.

Methodology

This is an active and participatory course through demonstrations, practical exercises and user analysis of all theoretical topics taught by the trainer in order to address real cases of the related product.

The trainer will also use different dynamics that allow group work in the classroom such as challenges, assessment tests and real cases to prepare for the associated Microsoft certification exam if that is the case.

Certification

This course is certified by Microsoft®.

The evaluation is continuous, based on group and individual activities. The trainer will give constant feedback to each participant.

During the course, participants will complete an evaluation test that they must pass with more than 75% of correct answers.

The conditions for additional certification services are subject to the terms of the license owner or the approved certification authority.

Accreditation

A Certificate of Attendance will be issued only to students with an attendance of more than 75% and a Diploma of Achievement if they also pass the evaluation test.

Data Engineering on Microsoft Azure

1. Design and implement data warehousing

• Design a data storage structure
• Design a partitioning strategy
• Design the service layer
• Implement physical data storage structures
• Implement logical data structures
• Implement the service layer

2. Design and develop data processing

• Ingest and transform data
• Design and develop a batch processing solution
• Design and develop a stream processing solution
• Manage batches and pipelines

3. Design and implement data security

• Design security for data policies and standards
• Implement data security

4. Monitor and optimize data storage and processing

• Monitor data storage and processing
• Optimize and troubleshoot data storage and processing

DP 203 | DP203 | DP-203