v1.0.0
Most web scraping tools are too complicated. They usually require a lengthy setup or programming experience. Spider is different - it focuses on getting things done quickly and efficiently.
There are several ways to install Spider once you’ve obtained a license key.
Chrome Installation (.crx file).
This has been reported to not work in recent versions of Chrome. Install it from the Web Store if so.
chrome://extensions
.Firefox Installation (.xpi file).
about:addons
.Can I scrape in? Like, can I automatically scrape the product detail page from the product list page? Not right now, but we might implement something to do this in the future. Check out the Spider Road Map.
Can I scrape password protected stuff with Spider? Yes! It’s a browser extension, so as long as you log in first, you can scrape whatever you like.
Does Spider support infinite scrolling?
No, not really. Unless you were to scroll the whole thing yourself first.
Clicking the Next button is tedious when scraping paginated results. Why don’t you just automate it?
Our goal with the browser extension is to mimic manual use when it makes sense, while still saving of time and keeping things organized. Automating things in this way could put load on servers in a way that a manual user couldn’t, and we don’t want to enable that behavior. That being said, we would like to improve this experience in the future, so keep an eye on the Road Map.