primal/athens
1
0
Fork 0
mirror of https://github.com/gomods/athens synced 2026-02-03 08:40:31 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
e765256033dc266fed465ea4a7a1f01beb31e2eb
athens/robots.txt
oliverch 874d27158d feat: add /robots.txt (#1355) 
* feat: add /robots.txt

* disallow all crawler by default.
2019-09-16 16:21:08 -05:00

3 lines
26 B
Plaintext
Raw Blame History

User-agent: *
Disallow: /
Reference in New Issue View Git Blame Copy Permalink