Downgrading a homebrew installation is a hassle. I’d use a different installation method.
If you really want to stick with homebrew, see the last part of this comment:
https://discourse.gohugo.io/t/how-to-downgrade-hugo-to-a-previous-version/40388/5
Specifically, the paragraph beginning with “This is the best method that I can find so far…”