Remove links from sitemap.xml

[RickCogley]

One method:

Custom Robots.txt and sitemap.xml Templates

Intro The docs have an example of how to block every page using robots.txt but, I wanted to make a robots.txt template that blocks only pages with a certain frontmatter param. As others have pointed out in the comments and elsewhere, robots.txt is not a sure thing. Web crawlers have to be set to honor it, and sometimes they are not. Additionally, for any page that is disallowed in robots.txt, the same page should be excluded from the sitemap. Here’s what to do: Set Up the robots.txt Template T…