primal/athens
1
0
Fork 0
mirror of https://github.com/gomods/athens synced 2026-02-03 12:10:32 +00:00
Code Issues Packages Projects Releases Wiki Activity

feat: add /robots.txt (#1355)

Browse Source 
* feat: add /robots.txt

* disallow all crawler by default.
This commit is contained in:
oliverch
2019-09-17 05:21:08 +08:00
committed by Aaron Schlesinger
parent 800024fc6f
commit 874d27158d
7 changed files with 36 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files
robots.txt
+2
View File
@@ -0,0 +1,2 @@
User-agent: *
Disallow: /