Hugo build stuck

support
1

I’m running hugo build or the command hugo -v in an ec2 instance. It says

**INFO 2019/12/13 17:14:52 No translation bundle found for default language "en"**

**INFO 2019/12/13 17:14:52 Translation func for language en not found, use default.**

**INFO 2019/12/13 17:14:52 i18n not initialized; if you need string translations, check that you have a bundle in /i18n that matches the site language or the default language.**

and its stuck. It has around 10k pages and im looking at the memory usage and it sticks at 1.15GB(usually goes up to 40+GB when building). In order to troubleshoot i’ve re-installed hugo with no avail. I’m really not sure why its suddenly like this because all the commands that i’ve run/ the environment is the same.

This is my hugo env:
Hugo Static Site Generator v0.60.1/extended linux/amd64 BuildDate: unknown

**GOOS="linux"**

**GOARCH="amd64"**

**GOVERSION="go1.13.4"**

Any ideas on why im getting stuck??

2

No, but you can try to do a “kill -SIGABRT ” and post the stack trace here.

40GB? Big files/data?

1 Like
4 
**SIGABRT: abort**

**PC=0x4f9251 m=0 sigcode=0**

**goroutine 0 [idle]:**

**runtime.futex(0x2fa4668, 0x80, 0x0, 0x0, 0x0, 0xc000047820, 0xc000047830, 0x7ffedcd04ee8, 0x7ffedcd04f08, 0x4a30df, ...)**

**/home/linuxbrew/.linuxbrew/Cellar/go/1.13.4/libexec/src/runtime/sys_linux_amd64.s:535 +0x21**

**runtime.futexsleep(0x2fa4668, 0x7ffe00000000, 0xffffffffffffffff)**

**/home/linuxbrew/.linuxbrew/Cellar/go/1.13.4/libexec/src/runtime/os_linux.go:44 +0x46**

**runtime.notesleep(0x2fa4668)**

**/home/linuxbrew/.linuxbrew/Cellar/go/1.13.4/libexec/src/runtime/lock_futex.go:151 +0x9f**

**runtime.stopm()**

**/home/linuxbrew/.linuxbrew/Cellar/go/1.13.4/libexec/src/runtime/proc.go:1928 +0xc0**

**runtime.findrunnable(0xc000046500, 0x0)**

**/home/linuxbrew/.linuxbrew/Cellar/go/1.13.4/libexec/src/runtime/proc.go:2391 +0x53f**

**runtime.schedule()**

**/home/linuxbrew/.linuxbrew/Cellar/go/1.13.4/libexec/src/runtime/proc.go:2524 +0x2be**

**runtime.park_m(0xc0000d4300)**

**/home/linuxbrew/.linuxbrew/Cellar/go/1.13.4/libexec/src/runtime/proc.go:2610 +0x9d**

**runtime.mcall(0x18392f0)**

**/home/linuxbrew/.linuxbrew/Cellar/go/1.13.4/libexec/src/runtime/asm_amd64.s:318 +0x5b**

**goroutine 1 [runnable]:**

**syscall.Syscall(0x0, 0x5, 0xc00084f2d4, 0x14, 0x14, 0x14, 0x0)**

**/home/linuxbrew/.linuxbrew/Cellar/go/1.13.4/libexec/src/syscall/asm_linux_amd64.s:18 +0x5**

**syscall.read(0x5, 0xc00084f2d4, 0x14, 0x14, 0x0, 0x0, 0x0)**

**/home/linuxbrew/.linuxbrew/Cellar/go/1.13.4/libexec/src/syscall/zsyscall_linux_amd64.go:732 +0x5a**

**syscall.Read(...)**

**/home/linuxbrew/.linuxbrew/Cellar/go/1.13.4/libexec/src/syscall/syscall_unix.go:183**

**internal/poll.(*FD).Read(0xc00040a300, 0xc00084f2d4, 0x14, 0x14, 0x0, 0x0, 0x0)**

**/home/linuxbrew/.linuxbrew/Cellar/go/1.13.4/libexec/src/internal/poll/fd_unix.go:165 +0x164**

**os.(*File).read(...)**

**/home/linuxbrew/.linuxbrew/Cellar/go/1.13.4/libexec/src/os/file_unix.go:259**

**os.(*File).Read(0xc000539338, 0xc00084f2d4, 0x14, 0x14, 0x14, 0x0, 0x0)**

**/home/linuxbrew/.linuxbrew/Cellar/go/1.13.4/libexec/src/os/file.go:116 +0x71**

**io.ReadAtLeast(0x7fb9305ab578, 0xc00080bda0, 0xc00084f2d4, 0x14, 0x14, 0x14, 0xffffffffffffffff, 0x0, 0x0)**

**/home/linuxbrew/.linuxbrew/Cellar/go/1.13.4/libexec/src/io/io.go:310 +0x87**

**github.com/spf13/afero.readerContainsAny(0x7fb9305ab578, 0xc00080bda0, 0x2f18d60, 0x4, 0x4, 0x0)**

**/home/vsts_azpcontainer/.cache/Homebrew/go_cache/pkg/mod/github.com/spf13/afero@v1.2.2/util.go:235 +0x2a0**

**github.com/spf13/afero.FileContainsAnyBytes(0x20a90a0, 0xc00080b2e0, 0xc00084b400, 0x14, 0x2f18d60, 0x4, 0x4, 0x0, 0x0, 0x0)**

**/home/vsts_azpcontainer/.cache/Homebrew/go_cache/pkg/mod/github.com/spf13/afero@v1.2.2/util.go:198 +0x134**

**github.com/gohugoio/hugo/helpers.FileContainsAny(...)**

**/tmp/hugo-20191130-4613-suxihy/hugo-0.60.1/src/github.com/gohugoio/hugo/helpers/path.go:661**

**github.com/gohugoio/hugo/tpl/tplimpl.(*templateHandler).loadTemplates.func1.2(0xc00084b400, 0x14, 0x2f18d60, 0x4, 0x4, 0xc0007e8c00, 0xa, 0x2)**

**/tmp/hugo-20191130-4613-suxihy/hugo-0.60.1/src/github.com/gohugoio/hugo/tpl/tplimpl/template.go:731 +0x84**

**github.com/gohugoio/hugo/output.CreateTemplateNames(0xc000034064, 0x14, 0xc00084b400, 0x14, 0x0, 0x0, 0xc00017d800, 0x9, 0x9, 0xc00080cea0, ...)**

**/tmp/hugo-20191130-4613-suxihy/hugo-0.60.1/src/github.com/gohugoio/hugo/output/layout_base.go:137 +0x4a9**

**github.com/gohugoio/hugo/tpl/tplimpl.(*templateHandler).loadTemplates.func1(0xc00084b400, 0x14, 0x209cb80, 0xc00093a000, 0x0, 0x0, 0x0, 0x0)**

**/tmp/hugo-20191130-4613-suxihy/hugo-0.60.1/src/github.com/gohugoio/hugo/tpl/tplimpl/template.go:735 +0x23c**

**github.com/gohugoio/hugo/hugofs.(*Walkway).walk(0xc0008a4090, 0xc00084b400, 0x14, 0x209cb80, 0xc00093a000, 0x0, 0x0, 0x0, 0xc000845360, 0x0, ...)**

**/tmp/hugo-20191130-4613-suxihy/hugo-0.60.1/src/github.com/gohugoio/hugo/hugofs/walk.go:167 +0x7a**

**github.com/gohugoio/hugo/hugofs.(*Walkway).walk(0xc0008a4090, 0xc00089c36a, 0x8, 0x209cb80, 0xc0008458a0, 0xc00092d6c0, 0x4, 0x4, 0xc000845360, 0x0, ...)**

**/tmp/hugo-20191130-4613-suxihy/hugo-0.60.1/src/github.com/gohugoio/hugo/hugofs/walk.go:290 +0x765**

**github.com/gohugoio/hugo/hugofs.(*Walkway).walk(0xc0008a4090, 0x0, 0x0, 0x209cb80, 0xc000845580, 0xc000842800, 0x10, 0x10, 0xc000845360, 0x2065460, ...)**

**/tmp/hugo-20191130-4613-suxihy/hugo-0.60.1/src/github.com/gohugoio/hugo/hugofs/walk.go:290 +0x765**

**github.com/gohugoio/hugo/hugofs.(*Walkway).Walk(0xc0008a4090, 0xc00080b2e0, 0x0)**

**/tmp/hugo-20191130-4613-suxihy/hugo-0.60.1/src/github.com/gohugoio/hugo/hugofs/walk.go:137 +0x1dc**

**github.com/gohugoio/hugo/helpers.SymbolicWalk(0x20a90a0, 0xc00080b2e0, 0x0, 0x0, 0xc000845360, 0x12, 0x2fd4000)**

**/tmp/hugo-20191130-4613-suxihy/hugo-0.60.1/src/github.com/gohugoio/hugo/helpers/path.go:518 +0x114**

**github.com/gohugoio/hugo/tpl/tplimpl.(*templateHandler).loadTemplates(0xc0000c9200, 0x0, 0x0, 0x1a, 0x1d7616c)**

**/tmp/hugo-20191130-4613-suxihy/hugo-0.60.1/src/github.com/gohugoio/hugo/tpl/tplimpl/template.go:748 +0xac**

**github.com/gohugoio/hugo/tpl/tplimpl.(*templateHandler).LoadTemplates(0xc0000c9200, 0x0, 0x0, 0x1d7616c, 0x4be)**

**/tmp/hugo-20191130-4613-suxihy/hugo-0.60.1/src/github.com/gohugoio/hugo/tpl/tplimpl/template.go:492 +0x3f**

**github.com/gohugoio/hugo/hugolib.(*Site).withSiteTemplates.func1(0x209cbe0, 0xc0000c9200, 0x0, 0xc000437950)**

**/tmp/hugo-20191130-4613-suxihy/hugo-0.60.1/src/github.com/gohugoio/hugo/hugolib/hugo_sites.go:431 +0x42**

**github.com/gohugoio/hugo/tpl/tplimpl.(*TemplateProvider).Update(0x0, 0xc000747600, 0x0, 0x0)**

**/tmp/hugo-20191130-4613-suxihy/hugo-0.60.1/src/github.com/gohugoio/hugo/tpl/tplimpl/templateProvider.go:40 +0x190**

**github.com/gohugoio/hugo/deps.(*Deps).LoadResources(0xc000747600, 0x0, 0x0)**

**/tmp/hugo-20191130-4613-suxihy/hugo-0.60.1/src/github.com/gohugoio/hugo/deps/deps.go:165 +0x78**

**github.com/gohugoio/hugo/hugolib.applyDeps(0xc00080f680, 0xc00053ef00, 0xc000585880, 0x0, 0x0, 0x20a4d40, 0xc000746a00, 0xc0005ba000, 0x17, 0x27, ...)**

**/tmp/hugo-20191130-4613-suxihy/hugo-0.60.1/src/github.com/gohugoio/hugo/hugolib/hugo_sites.go:403 +0x3bb**

**github.com/gohugoio/hugo/hugolib.newHugoSites(0xc00080f680, 0xc00053ef00, 0x0, 0x0, 0x0, 0x20a4d40, 0xc000746a00, 0x0, 0x0, 0x0, ...)**

**/tmp/hugo-20191130-4613-suxihy/hugo-0.60.1/src/github.com/gohugoio/hugo/hugolib/hugo_sites.go:311 +0x4f7**

**github.com/gohugoio/hugo/hugolib.NewHugoSites(0xc00080f680, 0xc00053ef00, 0x0, 0x0, 0x0, 0x20a4d40, 0xc000746a00, 0x0, 0x0, 0x0, ...)**

**/tmp/hugo-20191130-4613-suxihy/hugo-0.60.1/src/github.com/gohugoio/hugo/hugolib/hugo_sites.go:426 +0x12f**

**github.com/gohugoio/hugo/commands.(*commandeer).loadConfig.func3()**

**/tmp/hugo-20191130-4613-suxihy/hugo-0.60.1/src/github.com/gohugoio/hugo/commands/commandeer.go:402 +0x281**

**sync.(*Once).doSlow(0xc00029a9d0, 0xc0006c7a38)**

**/home/linuxbrew/.linuxbrew/Cellar/go/1.13.4/libexec/src/sync/once.go:66 +0xe3**

**sync.(*Once).Do(...)**

**/home/linuxbrew/.linuxbrew/Cellar/go/1.13.4/libexec/src/sync/once.go:57**

**github.com/gohugoio/hugo/commands.(*commandeer).loadConfig(0xc0007d85b0, 0xc0007d0001, 0x2064760, 0xc00080c540)**

**/tmp/hugo-20191130-4613-suxihy/hugo-0.60.1/src/github.com/gohugoio/hugo/commands/commandeer.go:361 +0x85f**

**github.com/gohugoio/hugo/commands.newCommandeer(0x1, 0xc000328a90, 0x2062100, 0xc00080c410, 0xc00080c530, 0x0, 0x0, 0x0, 0x1a971a0, 0x10697401, ...)**

**/tmp/hugo-20191130-4613-suxihy/hugo-0.60.1/src/github.com/gohugoio/hugo/commands/commandeer.go:183 +0x241**

**github.com/gohugoio/hugo/commands.initializeConfig(0x1a90001, 0xc000328a90, 0x2062100, 0xc00080c410, 0xc00080c530, 0x65cb57, 0xc000431100, 0xc0006c7c88)**

**/tmp/hugo-20191130-4613-suxihy/hugo-0.60.1/src/github.com/gohugoio/hugo/commands/hugo.go:123 +0x76**

**github.com/gohugoio/hugo/commands.(*commandsBuilder).newHugoCmd.func1(0xc0007f4a00, 0xc00080c520, 0x0, 0x1, 0x0, 0x0)**

**/tmp/hugo-20191130-4613-suxihy/hugo-0.60.1/src/github.com/gohugoio/hugo/commands/commands.go:159 +0x134**

**github.com/spf13/cobra.(*Command).execute(0xc0007f4a00, 0xc00000e070, 0x1, 0x1, 0xc0007f4a00, 0xc00000e070)**

**/home/vsts_azpcontainer/.cache/Homebrew/go_cache/pkg/mod/github.com/spf13/cobra@v0.0.4-0.20190321000552-67fc4837d267/command.go:762 +0x460**

**github.com/spf13/cobra.(*Command).ExecuteC(0xc0007f4a00, 0xc00080c410, 0xc0006c7ec0, 0x169baa2)**

**/home/vsts_azpcontainer/.cache/Homebrew/go_cache/pkg/mod/github.com/spf13/cobra@v0.0.4-0.20190321000552-67fc4837d267/command.go:850 +0x2fb**

**github.com/gohugoio/hugo/commands.Execute(0xc00000e070, 0x1, 0x1, 0x49dbbf, 0xc0000e0058, 0x0, 0x0)**

**/tmp/hugo-20191130-4613-suxihy/hugo-0.60.1/src/github.com/gohugoio/hugo/commands/hugo.go:89 +0xb9**

**main.main()**

**/tmp/hugo-20191130-4613-suxihy/hugo-0.60.1/src/github.com/gohugoio/hugo/main.go:23 +0x6c**

**goroutine 115 [select]:**

**go.opencensus.io/stats/view.(*worker).start(0xc0007de050)**

**/home/vsts_azpcontainer/.cache/Homebrew/go_cache/pkg/mod/go.opencensus.io@v0.22.0/stats/view/worker.go:154 +0x100**

**created by go.opencensus.io/stats/view.init.0**

**/home/vsts_azpcontainer/.cache/Homebrew/go_cache/pkg/mod/go.opencensus.io@v0.22.0/stats/view/worker.go:32 +0x57**

**goroutine 52 [syscall]:**

**os/signal.signal_recv(0x0)**

**/home/linuxbrew/.linuxbrew/Cellar/go/1.13.4/libexec/src/runtime/sigqueue.go:147 +0x9c**

**os/signal.loop()**

**/home/linuxbrew/.linuxbrew/Cellar/go/1.13.4/libexec/src/os/signal/signal_unix.go:23 +0x22**

**created by os/signal.init.0**

**/home/linuxbrew/.linuxbrew/Cellar/go/1.13.4/libexec/src/os/signal/signal_unix.go:29 +0x41**

**rax 0xca**

**rbx 0x2fa4520**

**rcx 0x4f9253**

**rdx 0x0**

**rdi 0x2fa4668**

**rsi 0x80**

**rbp 0x7ffedcd04ed0**

**rsp 0x7ffedcd04e88**

**r8 0x0**

**r9 0x0**

**r10 0x0**

**r11 0x286**

**r12 0x40**

**r13 0xc000a76328**

**r14 0x10**

**r15 0x1cb7d80**

**rip 0x4f9251**

**rflags 0x286**

**cs 0x33**

**fs 0x0**

**gs 0x0**

I moved the data files outside of the site/repo so that the build wouldn’t look at it. So its only 4000~10000 frontmatter files with no json attached or referencing

5

I’ve also just tried taking everything but ~100 or so frontmatter pages and the build time has gone over 6min hanging. It looks like it is running hugo -v as it shows 100% cpu usage for one process, so my guess would be that its stuck…

6

No, but if you showed a repo that reproduces the errors, we could assist. If you are running into build issues, please Performance | Hugo. But seriously, you ought to just share some code, you’ll get your answers and we won’t have to ask 20+ questions. :slight_smile: