📝 Notes taken by Abd @ITNA Digital

Missed the deadline for the HW ☚ī¸

Introduction

Introduction Video: https://www.youtube.com/watch?v=bkJZDmreIpA GitHub Curriculum: https://github.com/DataTalksClub/data-engineering-zoomcamp#week-1-introduction--prerequisites Week 1 Curriculum: https://github.com/DataTalksClub/data-engineering-zoomcamp/tree/main/week_1_basics_n_setup

Dataset: http://www1.nyc.gov/site/tlc/about/tlc-trip-record-data.page

Playlist: Data Engineering Zoomcamp - YouTube

Slides: Data engineering zoomcamp introduction (slideshare.net)

Recommended Books

  1. Designing Data-Intensive Applications: The Big Ideas Behind Reliable, Scalable, and Maintainable Systems (Top priority)
  2. Database Internals

Content

SQL & Docker Videos || 🔗 Github Repo

[Introduction to Docker](https://www.notion.so/Introduction-to-Docker-3b0d99ed6dbd4b60bd5aca76ae5c3842)

Ingesting NY Taxi Data to Postgres

Connecting pgAdmin and Postgres

Dockerizing the Ingestion Script

Running Postgres and pgAdmin with Docker-Compose

SQL Refreshser

Terraform & GCP VM Instance (Brief)

Page Template (Empty)

My Notes