What all cool stuff can hugo + colly do?


Yes, I mourned the loss of that one. Nothing really comes close as a replacement.


I’ve used Scrapy to create scraping services for Hugo sites. It’s extremely fast and has detailed documentation. Nevertheless I’m looking forward to tucking this under my hat for the next scraper I write. Thanks for sharing!


Incidentally, I noticed recently that Yahoo’s YQL API is still available and in use. This is REALLY useful for scraping websites and manipulating RSS/ATOM feeds and was the basis behind Pipes.