AWS Pre-requisities

Name Security Group ID Type Protocol Port Source
yt-scraper sg-010a50493f1638af2 Custom TCP tcp 8000 0.0.0.0/0
yt-scraper sg-010a50493f1638af2 SSH tcp 22 0.0.0.0/0
yt-scraper sg-010a50493f1638af2 Custom TCP tcp 3000 0.0.0.0/0

Installing Dependencies

  1. Download Python3 and pip and virtual environment on the server
sudo apt update -y
sudo apt install python3 -y
sudo apt install python3-pip -y
sudo apt install python3-venv -y
  1. Install Google Chrome
sudo apt install -y wget unzip
wget <https://dl.google.com/linux/direct/google-chrome-stable_current_amd64.deb>
sudo apt install -y ./google-chrome-stable_current_amd64.deb
  1. Install Redis

    Using redis is crucial since it helps to follow a queue of requests

sudo apt install redis -y
sudo systemctl status redis-server # To check if the redis server is running
  1. Installing Cloudflared

    This helps use to create a https link so that the browser can access the backend

wget <https://github.com/cloudflare/cloudflared/releases/latest/download/cloudflared-linux-amd64.deb>
sudo dpkg -i cloudflared-linux-amd64.deb
  1. Copy the backend folder from github