What all cool stuff can hugo + colly do?


#21

Yes, I mourned the loss of that one. Nothing really comes close as a replacement.


#22

I’ve used Scrapy to create scraping services for Hugo sites. It’s extremely fast and has detailed documentation. Nevertheless I’m looking forward to tucking this under my hat for the next scraper I write. Thanks for sharing!


#23

Incidentally, I noticed recently that Yahoo’s YQL API is still available and in use. This is REALLY useful for scraping websites and manipulating RSS/ATOM feeds and was the basis behind Pipes.

https://developer.yahoo.com/yql/guide/yql_code_tutorials.html