add robots.txt — disallow all crawlers from indexing the site
This commit is contained in:
parent
c6a1d32498
commit
3c3ed8090c
1 changed files with 2 additions and 0 deletions
2
frontend/public/robots.txt
Normal file
2
frontend/public/robots.txt
Normal file
|
|
@ -0,0 +1,2 @@
|
|||
User-agent: *
|
||||
Disallow: /
|
||||
Loading…
Add table
Reference in a new issue