Yes, I mourned the loss of that one. Nothing really comes close as a replacement.
I’ve used Scrapy to create scraping services for Hugo sites. It’s extremely fast and has detailed documentation. Nevertheless I’m looking forward to tucking this under my hat for the next scraper I write. Thanks for sharing!
Incidentally, I noticed recently that Yahoo’s YQL API is still available and in use. This is REALLY useful for scraping websites and manipulating RSS/ATOM feeds and was the basis behind Pipes.
https://developer.yahoo.com/yql/guide/yql_code_tutorials.html
1 Like