https://github.github.com/gfm/#tables-extension-
which is what Goldmark uses says:
Block-level elements cannot be inserted in a table.
A hard break is a block-level element and ergo cannot be added (as Markdown) to a table.
If you wanted to avoid the unsafe
you would need to create a shortcode.