FEATURES

1. Automated web crawling-scraping of the news to be executed several times per day
2. Sentiment analysis of each article
3. Database storing of category labeled news articles
4. Data Science REST API that could be consume by any client

TECNOLOGIES

• Python
  • Scrapy: Web Crawling and Scraping Framework
  • FastAPI: REST API FrameWork
  • SQL Alchemy: ORM
• MySQL - Google Cloud SQL
• Docker - Deployment in Google Cloud Run
• Google Scheduler

ARCHITECTURE

• Microservice build as a REST API

DATABASE SCHEMA

NEWS CATEGORIES

1. Politics
2. Economy