|
Developed by the Team at Art.sy, a service for discovering online art and high-end graphics, Spidey can be used to setup custom site scraping rules, unique to targeted URLs and their respective site structure.
Spidey is more of a framework than a site scraping utility, allowing developers to write very targeted, in-depth scraping rules, appropriate to the content they want to fetch.
The advantage of using Spidey is that scraped results will be more clean and won't require any kind of filtering before being used.
Via: Spidey 0.0.4
0 Comment:
Post a Comment