Node 4: Fetch Current Page

HTTP Request Configuration:

Method: GET URL: {{ $json.url }} Timeout: 30000ms Headers: User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 Accept: text/html,application/xhtml+xml Accept-Language: en-US,en;q=0.9

Critical Settings:

• Timeout: 30 seconds (some pages load slowly)
• User-Agent: Mimics real browser to avoid blocking
• Follow Redirects: Enabled
• Ignore SSL Issues: Enabled for testing

Troubleshooting:

• If pages return 403: Change User-Agent string
• If timeouts occur: Increase timeout to 45 seconds
• For JavaScript-heavy pages: Consider using Browser automation

Node 5: Get Previous Version

Airtable Configuration:

Authentication: OAuth2 Operation: Read records Table: Pages Filter Formula: AND({URL} = '{{ $json.url }}') Max Records: 1 Sort: [{field: "Timestamp", direction: "desc"}]

Required Airtable Fields:

• URL (URL field)
• Content (Long text)
• Competitor (Single line text)