<aside> ☝

List of notes for this specialization + Lecture notes & Repository & Quizzes + Home page on Coursera. Read this note alongside the lecture notes—some points aren't mentioned here as they're already covered in the lecture notes.

</aside>

Information

• Home page
• Home page on Coursera.
• Instructor: Joe Reis (the author of “Fundamentals of Data Engineering” ← free download)
• Home page of Course 1 — Introduction to Data Engineering
• Lecture notes
• DeepLearning.AI community for this course.
• My Github repository for resources in the course.

Introduction to Data Engineering

• Data-Centric AI: The discipline of systematically engineering the data used to build an AI system.
• This program is all about framework, principles, getting you to think like a data engineer + building system on AWS.

Program

1. Course 1: Intro to DE
2. Course 2: Source Systems, Data Ingestion, and Pipelines.
3. Course 3: Data Storage and Queries.
4. Course 4: Data Modeling, Transformation, and Serving.

Prerequisite

• Intermediate Python, Pandas
• Basic SQL
• Basic AWS Cloud.

This program

• What is unique about this program?

  • This program teaches you how to think like a data engineer
  • Hands-on practice.

• Textbook: Fundamentals of Data Engineering

• Scenario

  

  Most of dev focuses only on the last stage → waste time and less effective

• First course → a big picture. First week is only about how to think like a DE. No lab, no implementation.

Plan for course 1