Mkdocs: generate a robots.txt

Created on 7 Mar 2014 · 3Comments · Source: mkdocs/mkdocs

some defaults, and then hint at useful customisations

Source

SvenDowideit

Most helpful comment

I'm not sure that this is particularly useful, what would be a sensible default for everyone? Given a robots.txt can be added to the docs_dir and it will be copied over, isn't that enough?

d0ugal on 28 Nov 2014

👍3

All 3 comments

I'm not sure that this is particularly useful, what would be a sensible default for everyone? Given a robots.txt can be added to the docs_dir and it will be copied over, isn't that enough?

d0ugal on 28 Nov 2014

👍3

@SvenDowideit Can you eloaborate why there should be some defaults? I tend to side with @d0ugal, users can just place a robots.txt of their liking in the docs_dir...