Data Engineering Hands-On Lab

E-commerce Analytics Platform

🎯 Business Problem

Company: GlobalMart - A growing e-commerce company

Situation: GlobalMart operates across multiple regions and has been storing data in various formats across different systems:

• Sales data comes from their web platform (CSV files)
• Product catalog is maintained in Excel spreadsheets by different teams
• Customer data is exported from CRM system (JSON format)
• Inventory updates come from warehouse management system (XML format)
• Marketing campaign data is stored in Parquet format from their analytics tool

Current Pain Points:

1. Data is scattered across multiple systems and formats
2. Manual effort required to consolidate reports
3. No single source of truth for business metrics
4. Delayed insights due to manual data processing
5. Data quality issues and inconsistencies
6. No historical tracking of changes

Goal: Build an end-to-end data pipeline that can: