Table of Contents

This notion page consists of the following:

• Technical Documentation
  • ETL Pipeline Design
  • Database Design
• Data Analytic Documentation

Introduction

The Utilities Dashboard 2.0 project is a software engineering and data analytics project that seeks to extract utility costs (Electricity, Gas, Water) and other important data, such as usage, from utility bills (often found as pdfs in emails) and exports it as a csv.

The csv is then fed into PowerBI to create useful and insightful tables and graphs to allow me to analyze trends on usage, costs and rates, allowing me to make informed decisions on switching providers and on my own usage.

The project will utilize the following technologies:

• python - To write the script
• Gmail API and OAuth - To scrape utility bills from email
• pandas - For data analysis and storage
• pdfplumber - To scrape PDF files
• PowerBI - For data visualization and analysis

Goals

• [ ] Be able to see increase/decrease in usage and spending on utilities
• [ ] Be able to see the change in utility rates and the effect it has on total cost
• [ ] Be able to see trends for winter and summer seasons
• [ ] Be able to compare current rates (incl. service charge) to other online competitors

Project Scope