Big Data Fundamentals with PySpark

via

DataCamp

Course Features

Duration

4 hours

Delivery Method

Online

Available on

Limited Access

Accessibility

Mobile, Desktop, Laptop

Language

English

Subtitles

English

Level

Intermediate

Teaching Type

Self Paced

Video Content

4 hours

Course Description

Big Data has attracted a lot of attention in the past few years, and it is now a mainstream topic for many companies. What is Big Data? This course will introduce you to the basics of Big Data with PySpark. Spark is a framework which allows for Big Data "lightning fast cluster computing". It's a data processing platform engine that can run programs up to 100x faster in memory than Hadoop and 10x faster on disk. PySpark allows Spark programming. It includes powerful libraries such as SparkSQL for machine learning and MLlib to facilitate programming. Learn about William Shakespeare and how to analyze Fifa 2018 data. You'll also learn about cluster genomic datasets. This course will give you a solid understanding of PySpark and its general application to Big Data analysis.

Course Overview

Virtual Labs

International Faculty

Post Course Interactions

Hands-On Training,Instructor-Moderated Discussions

Case Studies, Captstone Projects

Skills You Will Gain

Prerequisites/Requirements

Introduction to Python

What You Will Learn

At the end of this course, you will have gained an in-depth understanding of PySpark and its application to general Big Data analysis

Learn the fundamentals of working with big data with PySpark

You will explore the works of William Shakespeare, analyze Fifa 2018 data and perform clustering on genomic datasets

Course Content

Expand all sections

Module 1: Introduction to Big Data analysis with Spark

Module 2: Programming in PySpark RDD's

Module 3: PySpark SQL DataFrames

Module 4: Machine Learning with PySpark MLlib

Course Instructors

Upendra Kumar Devisetty

Science Analyst at CyVerse

Upendra Kumar Devisetty is a Science Analyst at CyVerse where he scientifically interacts with biologists, bioinformaticians, programming teams and other members of CyVerse team. He also coordinates ...