walkah/net
1
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
net/robots.txt

3 lines
30 B
Plaintext
Raw Normal View History

simple robots.txt
2012-01-06 22:56:54 -05:00
User-agent: *
Crawl-delay: 10
Reference in New Issue Copy Permalink