Search our courses
Training

To stay competitive, organizations have started adopting new approaches to data processing and analysis.  For example, data scientists are turning to Apache Spark for processing massive amounts of data using Apache Spark’s distributed compute capability and its built-in machine learning library.

This intensive Apache Spark training course provides an overview of data science algorithms as well as the theoretical and technical aspects of using the Apache Spark platform for Machine Learning.  This training course is supplemented by a variety of hands-on labs that help attendees reinforce their theoretical knowledge of the learned material.

 

Our Machine Learning Course, Machine Learning with Apache Spark Training, covers following topics:

  •     Machine learning algorithms
  •     Introduction to functional programming
  •     Introduction to Apache Spark
  •     The Spark Shell
  •     The Spark Machine Learning Library
  •     Text mining

 

This Apache Spark training course has 3 hands-on labs that are outlined at the bottom of this page. The labs cover the spark-submit tool as well as Apache Spark shell. The labs allow you to practice the following skills:

 

Lab 1 - Using the spark-submit Tool

Spark offers developers two ways of running your applications:

  •     Using the spark-submit tool
  •     Using Spark Shell

In this lab, we will review what is involved in using the spark-submit tool.

 

Lab 2 - The Apache Spark Shell

Interactive development environment in Spark is provided by the Spark Shell (also known as REPL: Read/Eval/Print Loop tool) that is available for Scala and Python developers (Java is not yet supported).
The lab instructions below apply to the Scala version of the Spark Shell.

 

Lab 3 - Using Random Forests for Classification with Spark MLlib

In this lab, we will learn how to use Random Forests implementation of the algorithm from Spark's Machine Learning library, MLlib, to perform object classification.
Random Forests algorithm is regarded as one of the most successful supervised learning algorithm that can be used for both classification and regression.
In our work we will use the Python version of the library, which provides API similar to those implemented in Scala and Java.
We will also use the spark-submit Spark tool to submit the application from command line rather than typing in commands in Spark Shell.

Web Age Spark class can be delivered in traditional classroom style format. This Apache Spark Training can also be delivered in a synchronous instructor led format.

Machine Learning with Apache Spark

Course Code

GTMLAS

Duration

1 Day

Course Fee

POA

Accreditation

N/A

Target Audience

  • Data Scientists, Business Analysts, Software Developers, IT Architects

Attendee Requirements

  • Participants should have the general knowledge of statistics and programming

Expand all

Course Description

To stay competitive, organizations have started adopting new approaches to data processing and analysis.  For example, data scientists are turning to Apache Spark for processing massive amounts of data using Apache Spark’s distributed compute capability and its built-in machine learning library.

This intensive Apache Spark training course provides an overview of data science algorithms as well as the theoretical and technical aspects of using the Apache Spark platform for Machine Learning.  This training course is supplemented by a variety of hands-on labs that help attendees reinforce their theoretical knowledge of the learned material.

 

Our Machine Learning Course, Machine Learning with Apache Spark Training, covers following topics:

  •     Machine learning algorithms
  •     Introduction to functional programming
  •     Introduction to Apache Spark
  •     The Spark Shell
  •     The Spark Machine Learning Library
  •     Text mining

 

This Apache Spark training course has 3 hands-on labs that are outlined at the bottom of this page. The labs cover the spark-submit tool as well as Apache Spark shell. The labs allow you to practice the following skills:

 

Lab 1 - Using the spark-submit Tool

Spark offers developers two ways of running your applications:

  •     Using the spark-submit tool
  •     Using Spark Shell

In this lab, we will review what is involved in using the spark-submit tool.

 

Lab 2 - The Apache Spark Shell

Interactive development environment in Spark is provided by the Spark Shell (also known as REPL: Read/Eval/Print Loop tool) that is available for Scala and Python developers (Java is not yet supported).
The lab instructions below apply to the Scala version of the Spark Shell.

 

Lab 3 - Using Random Forests for Classification with Spark MLlib

In this lab, we will learn how to use Random Forests implementation of the algorithm from Spark's Machine Learning library, MLlib, to perform object classification.
Random Forests algorithm is regarded as one of the most successful supervised learning algorithm that can be used for both classification and regression.
In our work we will use the Python version of the library, which provides API similar to those implemented in Scala and Java.
We will also use the spark-submit Spark tool to submit the application from command line rather than typing in commands in Spark Shell.

Web Age Spark class can be delivered in traditional classroom style format. This Apache Spark Training can also be delivered in a synchronous instructor led format.

Course Outline

Chapter 1. Machine Learning Algorithms

  •     Supervised vs Unsupervised Machine Learning
  •     Supervised Machine Learning Algorithms
  •     Unsupervised Machine Learning Algorithms
  •     Choose the Right Algorithm
  •     Life-cycles of Machine Learning Development
  •     Classifying with k-Nearest Neighbors (SL)
  •     k-Nearest Neighbors Algorithm
  •     k-Nearest Neighbors Algorithm
  •     The Error Rate
  •     Decision Trees (SL)
  •     Random Forests
  •     Unsupervised Learning Type: Clustering
  •     K-Means Clustering (UL)
  •     K-Means Clustering in a Nutshell
  •     Regression Analysis
  •     Logistic Regression

Chapter 2. Introduction to Functional Programming

  •     What is Functional Programming (FP)?
  •     Terminology: Higher-Order Functions
  •     Terminology: Lambda vs Closure
  •     A Short List of Languages that Support FP
  •     FP with Java
  •     FP With JavaScript
  •     Imperative Programming in JavaScript
  •     The JavaScript map (FP) Example
  •     The JavaScript reduce (FP) Example
  •     Using reduce to Flatten an Array of Arrays (FP) Example
  •     The JavaScript filter (FP) Example
  •     Common High-Order Functions in Python
  •     Common High-Order Functions in Scala
  •     Elements of FP in R

Chapter 3. Introduction to Apache Spark

  •     What is Apache Spark
  •     A Short History of Spark
  •     Where to Get Spark?
  •     The Spark Platform
  •     Spark Logo
  •     Common Spark Use Cases
  •     Languages Supported by Spark
  •     Running Spark on a Cluster
  •     The Driver Process
  •     Spark Applications
  •     Spark Shell
  •     The spark-submit Tool
  •     The spark-submit Tool Configuration
  •     The Executor and Worker Processes
  •     The Spark Application Architecture
  •     Interfaces with Data Storage Systems
  •     Limitations of Hadoop's MapReduce
  •     Spark vs MapReduce
  •     Spark as an Alternative to Apache Tez
  •     The Resilient Distributed Dataset (RDD)
  •     Spark Streaming (Micro-batching)
  •     Spark SQL
  •     Example of Spark SQL
  •     Spark Machine Learning Library
  •     GraphX
  •     Spark vs R

Chapter 4. The Spark Shell

  •     The Spark Shell
  •     The Spark Shell UI
  •     Spark Shell Options
  •     Getting Help
  •     The Spark Context (sc) and SQL Context (sqlContext)
  •     The Shell Spark Context
  •     Loading Files
  •     Saving Files
  •     Basic Spark ETL Operations

Chapter 5. The Spark Machine Learning Library

  •     What is MLlib?
  •     Supported Languages
  •     MLlib Packages
  •     Dense and Sparse Vectors
  •     Labeled Point
  •     Python Example of Using the LabeledPoint Class
  •     LIBSVM format
  •     An Example of a LIBSVM File
  •     Loading LIBSVM Files
  •     Local Matrices
  •     Example of Creating Matrices in MLlib
  •     Distributed Matrices
  •     Example of Using a Distributed Matrix
  •     Classification and Regression Algorithm
  •     Clustering

Chapter 6. Text Mining

  •     What is Text Mining?
  •     The Common Text Mining Tasks
  •     What is Natural Language Processing (NLP)?
  •     Some of the NLP Use Cases
  •     Machine Learning in Text Mining and NLP
  •     Machine Learning in NLP
  •     TF-IDF
  •     The Feature Hashing Trick
  •     Stemming
  •     Example of Stemming
  •     Stop Words
  •     Popular Text Mining and NLP Libraries and Packages

Lab Exercises

    Lab 1. Learning the Lab Environment
    Lab 2. The Spark Shell
    Lab 3. Using Random Forests for Classification with Spark MLlib
    Lab 4. Using k-means Algorithm from MLlib
    Lab 5. Text Classification with Spark ML Pipeline

Learning Path
Ways to Attend
  • Attend a public course, if there is one available. Please check our schedule, or register your interest in joining a course in your area.
  • Private onsite Team training also available, please contact us to discuss. We can customise this course to suit your business requirements.

Private Team Training is available for this course

We deliver this course either on or off-site in various regions around the world, and can customise your delivery to suit your exact business needs. Talk to us about how we can fine-tune a course to suit your team's current skillset and ultimate learning objectives.

Private Team Training | Contact us

Technical ICT learning & mentoring services

Private Team Training

Our instructors are specialist consultants with vast real world experience and expertise allowing them to design and deliver client-focused courses for your organisation.

Learn more about our Private Team Training

What Our Clients Say

"Absolutely fantastic training. Thoroughly enjoyed it thanks to our highly enthusiastic tutor.  It wouldn't be an understatement to say that it was the best professional training that I have ever received."

 

Customised Linux with Networking

Live Online -  February 2022

 

"The course content was very good. When needed, the Instructor was extending the content of the course with hints and tips to help us understand different topics that were covered in the course."

 

Kubernetes Administration Certification - GTLFK

Live Online June 2021

 

 

 

“The course was held at the highest possible standards, the instructor was excellent, well prepared, well informed, and clearly an SME. Top marks.”

 

Professional Cloud Service Manager - GTC13

Live Online December 2021

 

“Very engaging and practical course so hope to be able to put the learning into practice.”

 

Being Agile in Business - GTBAB

Live Online September 2021

 

“Great instructor, who encouraged active participation. The breakout groups and exercises kept the group engaged and the content relevant to our own products”.

 

Site Reliability Engineering Foundation - GTDSRE

Live Online January 2022

 

 

 

"Intelligence is the ability to avoid doing work, yet
getting the work done"

Linus Torvalds, creator of Linux and GIT

Technical ICT learning & mentoring services

About GuruTeam

GuruTeam is a high-level ICT Learning, Mentoring and Consultancy services company. We specialise in delivering instructor-led on and off-site training in Blockchain, Linux, Cloud, Big Data, DevOps, Kubernetes, Agile, Software & Web Development technologies. View our Testimonials

Download our eBrochure
Our Accreditation Partners
  •  
  •  
  •  

 

Upcoming Courses

Kubernetes Administration

11th - 14th March 2024

26th - 29th March 2024

Live Online

 

This Kubernetes Administration Certification training course is suitable for anyone who wants to learn the skills necessary to build and administer a Kubernetes cluster

Learn More

RUST

11th - 14th March 2024

26th - 29th March 2024

 Live Online

This course will help you understand what Rust applications look like, how to write Rust applications properly, and how to get the most out of the language and its libraries.

Learn More

Introduction to Python 3 

19th - 21st March 2024

9th - 11th April 2024

7th - 9th May 2024

   4th - 6th June 2024

 

Live Online

This Introduction to Python 3 training course is designed for anyone who needs to learn how to write programs in Python or support/modify existing programs.

 

Learn More

 GO LANG TRAINING

11th - 14th March 2024

26th - 29th March 2024

 

Live Online        

 

This Go language programming training course will help you understand how Go works, and immediately be more productive. If you are building a team using Go, this will be a great opportunity to get your team on the same page and speaking the same language. Innovative lab exercises and code samples are provided to reinforce skills and quickly master the topics.

Learn More

Newsletter

Stay up to date, receive updates on scheduled dates, new courses, offers, and events.

Subscribe to our Newsletter