← Back

ETL and Data Pipelines with Shell, Airflow and Kafka

IBM · View on Coursera ↗

Or see the score while you browse.

Taught by Yan Luo

Information TechnologyData ScienceComputer Science

Coursera
4.5
headline rating
↓
1.1
gap
Starisk
3.4
Padded

About the course

Delve into the two different approaches to converting raw data into analytics-ready data. One approach is the Extract, Transform, Load (ETL) process. The other contrasting approach is the Extract, Load, and Transform (ELT) process. ETL processes apply to data warehouses and data marts.

Read more

ELT processes apply to data lakes, where the data is transformed on demand by the requesting/calling application. In this course, you will learn about the different tools and techniques that are used with ETL and Data pipelines. Both ETL and ELT extract data from source systems, move the data through the data pipeline, and store the data in destination systems. During this course, you will experience how ELT and ETL processing differ and identify use cases for both. You will identify methods and tools used for extracting the data, merging extracted data either logically or physically, and for loading data into data repositories. You will also define transformations to apply to source data to make the data credible, contextual, and accessible to data users. You will be able to outline some of the multiple methods for loading data into the destination system, verifying data quality, monitoring load failures, and the use of recovery mechanisms in case of failure. By the end of this course, you will also know how to use Apache Airflow to build data pipelines as well be knowledgeable about the advantages of using this approach. You will also learn how to use Apache Kafka to build streaming pipelines as well as the core components of Kafka which include: brokers, topics, partitions, replications, producers, and consumers. Finally, you will complete a shareable final project that enables you to demonstrate the skills you acquired in each module.

The dissent

The most-upvoted critical review (20 votes, 2.0★).

“Course content is good but labs are riddled with bugs and in dire need of quality control. I encountered many time-consuming, frustrating technical issues that made completing this course a slog. Final assignment introduces some difficult linux manipulations that were not covered in the coures and are not really that relevant to the subject matter. Some questions on the final are unclear and could be better written. Would recommend the instructors or whomever created this course to eat their own cooking and go through this course and fix the various issues.”

2.0 / 5

Read the full review on Coursera ↗

Coursera's 4.5 comes from 465 ratings. Of those, 4.7% are 1–2★.

Starisk reads the reviews learners voted most helpful, and weights each by the square root of its votes: a review with 80 upvotes counts about five times one with 2. Unvoted reviews are not skipped out of laziness — by this model they carry no evidence that other students endorsed them.

That measures what the most-endorsed reviews say, not “true quality.” The rating distribution above is the whole population, so you can see the sample next to it.

Reviews read on 9 Nov 2026.Read them on Coursera ↗