walkah/net
1
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
net/robots.txt
James Walker 137b990c3a simple robots.txt
2012-01-06 22:56:54 -05:00

3 lines
30 B
Plaintext
Raw Blame History

User-agent: *
Crawl-delay: 10
Reference in New Issue View Git Blame Copy Permalink