Course Contents

Understanding Azure and Bigdata from learning to on-the-job perspectives.

Hadoop
- Introduction To Big Data
- HDFS
- MapReduce
- Apache Hive
- Architecture
- Cluster Setup
- Troubleshooting and Optimizations
- Apache Sqoop
- Impala
- Nifi
- Hadoop Knowledge Based Assessment
Scala For Spark
- Starting Scala
- Scala 101 and Worksheets
- Classes, Objects, Apps and more
- Control Structures in Scala
- Functions and Closures
- Custom Control Structures
- Composition and Inheritance
- Hierarchy, Types and Options
- Traits
- Packages, Imports and Scope
- Testing in Scala
- Pattern Matching
- Lists
- Collections
- Building Scala, SBT, Java Compatibility
- Futures
- Scala Knowledge Based Assessment
Spark w Scala
- Introduction to Spark - Getting started
- Resilient Distributed Dataset and DataFrames
- Spark application programming
- Introduction to Spark libraries
- Spark configuration, monitoring and tuning
- Introduction to Notebooks
- Spark RDD Architecture
- Optimizing Transformations and Actions
- Caching and Serialization
- Develop and Testing
- Scala Crash Course
- Spark Basics and Simple Examples
- Advanced Examples of Spark Programs
- Running Spark on a Cluster
- SparkSQL, DataFrames, and DataSets
- Machine Learning with MLLib
- Intro to Spark Streaming
- Intro to GraphX
- Spark Knowledge based Assessment
- Spark Case Study using Scala
Azure Fundamentals
- Azure Core Services
- Understand Cloud Concepts
- Understand Security, Privacy, Compliance & trust
- Understand Azure Pricing & Support
Azure Data Engineer
- Understand evolving world of data
- Survey the services on the Azure Data platform
- Identify the tasks of a data engineer in a cloud-hosted architecture
- Choose a data storage approach in Azure
- Create an Azure Storage account
- Connect an app to Azure Storage
- Secure your Azure Storage account
- Store application data with Azure Blob storage
- Azure - Knowledge based assessment
- Azure Data Engineer- Case study