Robots.txt: Revision history

From Hackepedia
Jump to navigationJump to search

Diff selection: Mark the radio buttons of the revisions to compare and hit enter or the button at the bottom.
Legend: (cur) = difference with latest revision, (prev) = difference with preceding revision, m = minor edit.

14 October 2014

  • curprev 01:4101:41, 14 October 2014Franks talk contribs 2,492 bytes +2,492 Created page with "If you're wonder how search engines get your website's information, it's through automated tools, or robots, called spiders. Once a spider discovers a new domain name, like on..."