Introduction to Big Data and Hadoop

Beginner

96 Lessons

10h

Certificate of Completion

AI-POWERED

Explanations

AI-POWERED

Explanations

This course includes

48 Playgrounds

30 Quizzes

This course includes

48 Playgrounds

30 Quizzes

Course Overview

This course offers a one-of-a-kind rich and interactive experience to learn the fundamentals and basics of Big Data. Throughout this course, you will have plenty of opportunities to get your hands dirty with functioning Hadoop clusters. You will start off by learning about the rise of Big Data as well as the different types of data like structured, unstructured, and semi-structured data. You will then dive into the fundamentals of Big Data such as YARN (yet another resource manager), MapReduce, HDFS (Hadoo...Show More

Course Content

Hadoop

Introduction

Rise of Big Data Untitled Masterpiece Big Data Defined Big Data vs Data Warehouse

YARN

Introduction Workflow Scheduling

Map Reduce

Basics Mapper Testing Mapper Mapper Input Reducer Testing Reducer Testing MapReduce Program

Running MapReduce End to End

Exploring MapReduce Runs Combiner and Partitioner Putting it Together Resiliency

HDFS

Filesystem The Big Picture Disk Blocks & HDFS Blocks Block Replication Namenode Datanode Writing and Reading High Availability

HDFS in Practice HDFS in Practice II Distcp

Spark

Introduction Architecture

Spark Application Life Cycle Spark API Resilient Distributed Datasets (RDDs)DataFrames Datasets An Example Running Spark Applications Anatomy of a Spark Application Execution of a Spark Application

Input & Output Formats

12 Lessons

Misc

5 Lessons

Quiz

6 Lessons

Reference: Replication

14 Lessons

10.

Reference: Partitioning

4 Lessons

11.

Reference: Transactions

9 Lessons

12.

Reference: Issues in Distributed Systems

4 Lessons

Course Author

Trusted by 1.4 million developers working at companies

Anthony Walker

@_webarchitect_

Emma Bostian 🐞

@EmmaBostian

Evan Dunbar

ML Engineer

Carlos Matias La Borde

Software Developer

Souvik Kundu

Front-end Developer

Vinay Krishnaiah

Software Developer

Eric Downs

Musician/Entrepeneur

Kenan Eyvazov

DevOps Engineer

Anthony Walker

@_webarchitect_

Emma Bostian 🐞

@EmmaBostian

Hands-on Learning Powered by AI

See how Educative uses AI to make your learning more immersive than ever before.

Instant Code Feedback

Evaluate and debug your code with the click of a button. Get real-time feedback on test cases, including time and space complexity of your solutions.

AI-Powered Mock Interviews

Put your skills to the test in a simulated interview setting. Receive personalized feedback based on your performance. Available in Premium & Premium Plus plans.

Adaptive Learning

At various checkpoints throughout Educative courses, you will be prompted to take a quick assessment. Receive a condensed curriculum tailored to your strengths and skill gaps.

Explain with AI

Select any text within any Educative course, and get an instant explanation — without ever leaving your browser.

AI Code Mentor

AI Code Mentor helps you quickly identify errors in your code, learn from your mistakes, and nudge you in the right direction — just like a 1:1 tutor!