How to properly clean up data
Our engineering team will be scraping websites and getting raw data into the databases. Us mortals who do not know how to write code or scrape (yet) will then help with data cleansing. Below are the steps we will follow.
<aside> 1️⃣ Pick a TICKET
</aside>
Go to Data Collection Task pick a ticket and put your name on it. The process will go faster if you focus on one ticket at a time and work through it.
<aside> 2️⃣ Open the FightPandemics Final Database
</aside>
The link will be available in the ticket or Important Resources
<aside> 3️⃣ Understand Fields
</aside>
Familiarize yourself with the different columns in the FightPandemics Final Database
Also take a look at the database description to understand the columns and learn more about how to fill them in. This will be your guide to filling in the missing information.
<aside> 4️⃣ Identify Record Numbers
</aside>
Identify rows numbered in the ticket and complete the missing information. The scraping team will give us a few fields such as website links and post titles. All other fields will be blank.