creations/ipv4.army
1
0
Fork 0
forked from seth/ipv4.army
Code Pull requests Activity

Add robots.txt to manage web crawler access

Browse source
This commit is contained in:
wont-stream 2025-04-08 16:50:44 -04:00
parent da60eea418
commit fb0991efec
1 changed files with 3 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

3
public/robots.txt Normal file
View file

@ -0,0 +1,3 @@
User-agent: *
Allow:
Disallow: /cgi-bin/