The forum’s post editor also uses Markdown.
The syntax is not a peculiarity of Hugo, rather it is a peculiarity of the Markdown spec that clashes with MathJax.
Please, see this post and the rest of that topic for more info:
You can always switch to using .html instead of .md content files for your Hugo project to avoid dealing with the Markdown processor altogether.