Intro

I am currently using both GCP and AWS for a certain project. While each cloud providers provides very nice tool and visualizations for their own spending (Cloud billing for GCP and Cost&Usage report for AWS respectively), I wanted to consolidate both cloud providers usage report and visualize using single BI tool. The report does not need to be realtime, I only need daily granularity on my report. (No streaming)

So I had to spin up something and these were couple options

• House data to AWS using Athena+Quicksight(or other BI tool)
• House data to GCP using Bigquery+datastudio(or other BI tool)
• Spend more time searching for 3rd party tools

I am a big fan of BigQuery and I prefer to to ELT rather than ETL on BQ. Moreover, I was already using BigQuery for the project with holistics.io, I chose to house usage and cost data to bigquery.

Move data to BQ

GCP Cloud Billing

Setup

This is easy, cloud billing natively support bigquery export.

• Enable billing for the GCP project.
• Create a dataset in BigQuery whthin the GCP project you desire - I named it billing_export
• You need appropriate permissions to setup export

Schema