v1.0.0

Most web scraping tools are too complicated. They usually require a lengthy setup or programming experience. Spider is different - it focuses on getting things done quickly and efficiently.

• Installation Instructions
• Frequently Asked Questions
• Getting Started
• Scraping
  • Scraping a Single Page
  • Scraping Multiple Pages
  • Reviewing Scrape Results
  • Generated Columns
  • Editing CSS Selectors
• Troubleshooting
• Reporting Bugs

Installation Instructions

There are several ways to install Spider once you’ve obtained a license key.

1. (Recommended) Install via the Chrome Web Store or Firefox Web Store. Click the Add to Chrome/Firefox button on that page.
2. Install the packed extension, using the files you got from Gumroad.

   • Chrome Installation (.crx file).

     This has been reported to not work in recent versions of Chrome. Install it from the Web Store if so.

     1. Navigate to chrome://extensions.
     2. Enable developer mode in the top right.
     3. Drag-and-drop the .crx file onto the page.
     4. Click Continue.

   • Firefox Installation (.xpi file).

     1. Navigate to about:addons.
     2. Drag-and-drop the .xpi file onto the page.
     3. Click Add.

Frequently Asked Questions

• Can I scrape in? Like, can I automatically scrape the product detail page from the product list page? Not right now, but we might implement something to do this in the future. Check out the Spider Road Map.

• Can I scrape password protected stuff with Spider? Yes! It’s a browser extension, so as long as you log in first, you can scrape whatever you like.

• Does Spider support infinite scrolling?

  No, not really. Unless you were to scroll the whole thing yourself first.

• Clicking the Next button is tedious when scraping paginated results. Why don’t you just automate it?

  Our goal with the browser extension is to mimic manual use when it makes sense, while still saving of time and keeping things organized. Automating things in this way could put load on servers in a way that a manual user couldn’t, and we don’t want to enable that behavior. That being said, we would like to improve this experience in the future, so keep an eye on the Road Map.