Scala And Spark For Big Data And Machine Learning

Learn the latest Big Data technology - Spark and Scala, including Spark 2.0 DataFrames!

Last updated 2022-01-10 | 4.2

- Use Scala for Programming
- Use Spark 2.0 DataFrames to read and manipulate data
- Use Spark to Process Large Datasets

What you'll learn

Use Scala for Programming
Use Spark 2.0 DataFrames to read and manipulate data
Use Spark to Process Large Datasets
Understand hot to use Spark on AWS and DataBricks

* Requirements

* Basic Programming Knowledge in some language
* Basic Math Skills
* English Language

Description

Learn how to utilize some of the most valuable tech skills on the market today, Scala and Spark! In this course we will show you how to use Scala and Spark to analyze Big Data.

Scala and Spark are two of the most in demand skills right now, and with this course you can learn them quickly and easily! This course comes packed with content:

  • Crash Course in Scala Programming
  • Spark and Big Data Ecosystem Overview
  • Using Spark's MLlib for Machine Learning 
  • Scale up Spark jobs using Amazon Web Services
  • Learn how to use Databrick's Big Data Platform
  • and much more!

This course comes with full projects for you including topics such as analyzing financial data or using machine learning to classify Ecommerce customer behavior! We teach the latest methodologies of Spark 2.0 so you can learn how to use SparkSQL, Spark DataFrames, and Spark's MLlib!

After completing this course you will feel comfortable putting Scala and Spark on your resume!

Thanks and I will see you inside the course!

Who this course is for:

  • Someone who already knows how to program and is interested in learning Big Data Technologies
  • Interested in using Spark with Scala for Machine Learning with Large Data Sets

Course content

17 sections • 80 lectures

Introduction Preview 02:28

Welcome to the Course!

Course FAQs Preview 00:13

FAQ for the course!

Scala and Spark Overview Preview 10:40

Get an Overview of Scala and why it is one of the most in demand programming skills!

ScalaIDE Overview Preview 02:51

Get an overview of the IDE we choose for this course: ScalaIDE

Computer Set-up Time! Preview 00:17

Let's get you set-up!

Windows Introduction Preview 00:40

Let's install Scala and Spark on your Windows Machine!

Quick note about Windows Installation. Preview 00:17

Let's install Scala and Spark on your Windows Machine!

Windows Scala and Spark Installation Preview 12:09

Let's install Scala and Spark on your Windows Machine!

Atom Windows Installation Preview 09:30

Learn about various options for IDEs for Scala and Spark

Terminal Exericse Preview 00:35

Let's install Scala and Spark on your Windows Machine!

Mac OS Installation and Setup Preview 09:57

Install Spark and Scala if you are on a Mac!

Installing Scala and Spark on Linux (Ubuntu) Preview 12:49

Full guide to installing Spark and Scala on a Linux Ubuntu Platform

Arithmetic and Numbers Preview 07:00

Learn about basic arithmetic operators in Scala

Values and Variables Preview 07:49

Learn the basics of Data Types in Scala

Booleans and Comparison Operators Preview 02:11

Learn about Relational operators in Scala

Strings and Basic Regex Preview 12:48

Learn about strings in Scala

Tuples Preview 02:35

Learn about Scala tuples!

Scala Basics - Assessment Test Exercises Preview 00:38

Test your knowledge!

Scala Basics Assessment Test Questions Preview 00:25

Time to practice!

Scala Basics - Assessment Test Solutions Preview 05:53

Learn about Logical Operators

Intro to Collections Preview 00:47

Part of the Scala Collections section of the course!

Lists Preview 08:28

Part of the Scala Collections section of the course!

Arrays Preview 03:48

Part of the Scala Collections Section

Sets Preview 06:02

Part of the Scala Collections section of the course!

Maps Preview 07:18

Part of the Scala Collections section of the course!

Collections - Assessment Test Exercise Preview 00:30

Part of the Scala Collections section of the course!

Scala Collections Assessment Test Preview 00:26

Part of the Scala Collections Part of the Course

Collections Assessment Test - Solutions Preview 06:14

Part of the Scala Collections section of the course!

Flow Control Preview 08:35

Learn Level Two of Scala Programming!

For Loops Preview 05:57

Learn how to create control flow loops with Scala

While Loops Preview 05:55

Learn Level Two of Scala Programming!

Functions Preview 12:45

Learn how to create functions with Scala!

Scala Programming Exercises Preview 02:33

Overview of Scala Level One Assessment

Scala Programming Exercises - Solutions Preview 15:24

Solutions to Scala Programming Test

Quick Note for Windows Users! Preview 00:39

Quick note!

Introduction to Spark DataFrames Preview 06:29

Learn how to use the Latest Spark 2.0 DataFrames!

DataFrames Overview Preview 18:12

Learn how to use the Latest Spark 2.0 DataFrames!

Spark DataFrame Operations Preview 16:23

Learn how to use the Latest Spark 2.0 DataFrames!

GroupBy and Aggregate Functions Preview 10:53

Learn how to use the Latest Spark 2.0 DataFrames!

Missing data Preview 13:16

Learn how to use the Latest Spark 2.0 DataFrames!

Date and Timestamps Preview 09:53

Learn how to use the Latest Spark 2.0 DataFrames!

Quick Note on DataFrame Project Preview 00:11

Quick note!

DataFrame Project Exercises Preview 01:34

Learn how to use the Latest Spark 2.0 DataFrames!

DataFrame Project - Solutions Preview 20:20

Learn how to use the Latest Spark 2.0 DataFrames!

Introduction to Machine Learning Preview 06:50

Part of the Machine Learning with Scala and Spark Section

Machine Learning with Spark Preview 11:50

Part of the Machine Learning with Scala and Spark Section

IntelliJ IDEA Installation Overview Preview 11:08

Part of the Machine Learning with Scala and Spark Section

Introduction to Linear Regression Preview 06:14

Learn about Regression Models with Spark!

Introduction to Regression Section Preview 01:07

Learn about Regression Models with Spark!

Linear Regression Documentation Example Preview 08:29

Learn about Regression Models with Spark!

Alternate Linear Regression Data CSV File Preview 00:17

Quick note

Linear Regression Walkthrough Part 1 Preview 16:40

Learn about Regression Models with Spark!

Linear Regression Walkthrough Part 2 Preview 07:26

Learn about Regression Models with Spark!

Linear Regression Exercise Project Preview 02:32

Learn about Regression Models with Spark!

Linear Regression Project Solutions Preview 16:56

Learn about Regression Models with Spark!

Introduction to Classification Preview 12:42

Learn about Classification with Spark!

Classification Documentation Example Preview 07:39

Learn about Classification with Spark!

Spark Classification - Logistic Regression Example - Part 1 Preview 15:49

Learn about Classification with Spark!

Spark Classification - Logistic Regression Example - Part 2 Preview 21:40

Learn about Classification with Spark!

Logistic Regression Project Exercise Preview 01:52

Learn about Classification with Spark!

Classification Project Solutions Preview 15:16

Learn about Classification with Spark!

Model Evaluation Overview Preview 10:23

Learn about Model Evaluation with Spark

Spark Model Evaluation - Documentation Example Preview 21:32

Learn about Model Evaluation with Spark

Spark - Model Evaluation - Regression Example Preview 23:16

Learn about Model Evaluation with Spark!

Introduction to Clustering with Spark Preview 01:37

Learn how to use Clustering Algorithms with Spark!

KMeans Theory Lecture Preview 05:05

Learn how to use Clustering Algorithms with Spark!

Note on Kmeans Preview 00:08

Example of KMeans with Spark Preview 07:15

Learn how to use Clustering Algorithms with Spark!

Clustering Project Exercise Overview Preview 03:42

Learn how to use Clustering Algorithms with Spark!

Clustering Project Exercises - Solutions Preview 10:31

Learn how to use Clustering Algorithms with Spark!

PCA Theory Overview Preview 03:13

Learn how to conduct a Principal Component Analysis with Spark!

PCA with Spark - Documentation Example Preview 06:00

Learn how to conduct a Principal Component Analysis with Spark!

PCA with Spark - Project Exercise Preview 03:06

Learn how to conduct a Principal Component Analysis with Spark!

PCA Spark Exercise - Solutions Preview 10:39

Learn how to conduct a Principal Component Analysis with Spark!

Databricks Overview Preview 17:24

Learn how to build a Recommender System on Databricks!

Introduction to Spark Recommendation Systems Preview 04:03

Learn how to build a Recommender System on Databricks!

Spark Recommender System Implementation Preview 13:35

Learn how to build a Recommender System on Databricks!

Zeppelin Notebooks on AWS Elastic MapReduce Preview 19:57

Learn how to set up your own cluster on AWS EMR!

So what's next? Preview 00:49

Find out what's next for you