Not sure what you mean by recursively, but the problem is:
Hugo reads all pages into memory to be able to create a site. This works fine for most use cases, but you’re having problems. What you want is a “streaming option”, but that is currently not an option.
yes After log view its take 98% use from memory.here is must be option like slow & steady without large memory can handle big site.Okay I m using my Server XEON 1271 v3 with 32GB RAM 240GB SSD Let see What Happen.I will post again.
I think he means “incremental” rather than “recursive”
Does Hugo need to load all pages into memory on every rebuild?.. or only those which have changed?
If the latter, then it should be possible to build the site “incrementally” by adding, say, a couple of thousand markdown files at a time into the content directory and rebuilding each time.
If the former, then I presume the user needs to setup his computer with a humongous /swap disc, so it doesn’t crash and burn when the RAM is exhausted.
All that said, 100 000+ posts does seem a bit “enthusiastic”. Maybe some ‘pruning’ might help, too.
On live-reload we’re only reloading the stuff you change (to make it a bit simplistic), but every page must currently be in memory for us to be able to handle all your clever range Site.Pages.
So incremental != streaming.
I’m not saying we’re not getting smarting about this in the future, but the thread starter is in the present.