git.shiar.nl / sheet.git / commitdiff
? search:
summary | shortlog | log | commit | commitdiff | tree
raw | patch | inline | side by side (from: ff54b2f)
robots: host directive to reduce mirror crawling
authorMischa POSLAWSKY <perl@shiar.org>
Tue, 2 May 2017 21:35:02 +0000 (23:35 +0200)
committerMischa POSLAWSKY <perl@shiar.org>
Mon, 29 May 2017 17:23:12 +0000 (19:23 +0200)
Preferred domain to indicate main site for at least Yandex bots:
<https://yandex.com/support/webmaster/controlling-robot/robots-txt.xml#host>


No differences found
sheet.shiar.nl - software cheat sheets