Custom Robots.txt and sitemap.xml Templates

[RickCogley]

Good point. Looks like you’d need to do something like:

Allow taxonomy with limitations

No. But you can hide these pages so that search engines cannot index them. Replicate your taxonomies as a folder structure under /content/ and then in the_index.md add the following parameter: +++ hidden = "true" +++ And then in the head partial of your site you could include {{ with .Params.hidden }}<meta name="robots" content="noindex">{{ end }} Also change your sitemap.xml template under /layouts/ to: <urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9"> {{ range .Data.P…