Apache Spark with Scala useful for Databricks Certification
- Description
- Curriculum
- FAQ
- Reviews
Apache Spark with Scala useful for Databricks Certification(Unofficial)
Apache Spark with Scala its a Crash Course for Databricks Certification Enthusiast (Unofficial) for beginners
“Big data” analysis is a hot and highly valuable skill – and this course will teach you the hottest technology in big data: Apache Spark. Employers including Amazon, eBay, NASA, Yahoo, and many more. All are using Spark to quickly extract meaning from massive data sets across a fault-tolerant Hadoop cluster. You’ll learn those same techniques, using your own Operating system right at home.
So, What are we going to cover in this course then?
Learn and master the art of framing data analysis problems as Spark problems through over 30+ hands-on examples, and then execute them up to run on Databricks cloud computing services (Free Service) in this course. Well, the course is covering topics which are included for certification:
1) Spark Architecture Components
- Driver,
- Core/Slots/Threads,
- Executor
- Partitions
2) Spark Execution
- Jobs
- Tasks
- Stages
3) Spark Concepts
- Caching,
- DataFrame Transformations vs. Actions, Shuffling
- Partitioning, Wide vs. Narrow Transformations
4) DataFrames API
- DataFrameReader
- DataFrameWriter
- DataFrame [Dataset]
5) Row & Column (DataFrame)
6) Spark SQL Functions
In order to get started with the course And to do that you’re going to have to set up your environment.
So, the first thing you’re going to need is a web browser that can be (Google Chrome or Firefox, or Safari, or Microsoft Edge (Latest version)) on Windows, Linux, and macOS desktop
This is completely Hands-on Learning with the Databricks environment.
-
3Introduction to SparkVideo lesson
-
4(Old) Free Account creation in DatabricksVideo lesson
-
5(New) Free Account creation in DatabricksVideo lesson
-
6Provisioning a Spark ClusterVideo lesson
-
7Basics about notebooksVideo lesson
-
8Tips to Improve Your Course Taking ExperienceVideo lesson
-
9Why we should learn Apache Spark?Video lesson
-
10Spark Architecture ComponentsVideo lesson
-
11DriverVideo lesson
-
12PartitionsVideo lesson
-
13ExecutorsVideo lesson
-
18Spark RDD (Create and Display Practical)Video lesson
-
19Spark Dataframe (Create and Display Practical)Video lesson
-
20Anonymus Functions in ScalaVideo lesson
-
21Extra (Optional on Spark DataFrame)Video lesson
-
22Extra (Optional on Spark DataFrame) in DetailsVideo lesson
-
23Spark Datasets (Create and Display Practical)Video lesson
-
24CachingVideo lesson
-
25Notes on reading files with SparkVideo lesson
-
26Data Source CSV FileVideo lesson
-
27Data Source JSON FileVideo lesson
-
28Data Source LIBSVM FileVideo lesson
-
29Data Source Image FileVideo lesson
-
30Data Source Arvo FileVideo lesson
-
31Data Source Parquet FileVideo lesson
-
32Untyped Dataset Operations (aka DataFrame Operations)Video lesson
-
33Running SQL Queries ProgrammaticallyVideo lesson
-
34Global Temporary ViewVideo lesson
-
35Creating DatasetsVideo lesson
-
36Scalar Functions (Built-in Scalar Functions) Part 1Video lesson
-
37Scalar Functions (Built-in Scalar Functions) Part 2Video lesson
-
38Scalar Functions (Built-in Scalar Functions) Part 3Video lesson
-
39User Defined Scalar FunctionsVideo lesson

External Links May Contain Affiliate Links read more