This course is offered by Jose Portilla on Udemy.

Learn the latest Big Data Technology - Spark! And learn to use it with one of the most popular programming languages, Python!

One of the most valuable technology skills is the ability to analyze huge data sets, and this course is specifically designed to bring you up to speed on one of the best technologies for this task, Apache Spark! The top technology companies like Google, Facebook, Netflix, Airbnb, Amazon, NASA, and more are all using Spark to solve their big data problems!

Spark can perform up to 100x faster than Hadoop MapReduce, which has caused an explosion in demand for this skill! Because the Spark 2.0 DataFrame framework is so new, you now have the ability to quickly become one of the most knowledgeable people in the job market!

This course will teach the basics with a crash course in Python, continuing on to learning how to use Spark DataFrames with the latest Spark 2.0 syntax! Once we've done that we'll go through how to use the MLlib Machine Library with the DataFrame syntax and Spark. All along the way you'll have exercises and Mock Consulting Projects that put you right into a real world situation where you need to use your new skills to solve a real problem!

1. Spark DataFrame

   • Spark DataFrame Basics
   • Spark DataFrame 5.Operations
   • Groupby and Aggregate Functions
   • Missing Data
   • Dates and Timestamps
   • DataFrame Project Exercise

2. Linear Regression

   • Data Transformations
   • Linear Regression with PySpark Example
   • Linear Regression Code Along
   • Linear Regression Consulting Project

3. Logistic Regression

   • Logistic Regression with PySpark Example
   • Logistic Regression Code Along
   • Logistic Regression Consulting Project

4. Tree Methods

   • Tree Methods with PySpark Example
   • Tree Methods Code Along
   • Tree Methods Consulting Project

5. Clustering

   • Clustering with PySpark Example
   • Clustering Code Along
   • Clustering Consulting Project

6. Recommender System

   • Recommender System Code Along

7. Natural Language Processing (NLP)

   • Tools for NLP
   • NLP Code Along

8. Spark Streaming

   • Introduction to Spark Streaming