moon
/
spc-pleroma
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

Update robots_txt.md

This commit is contained in:
feld 2020-08-12 16:19:34 +00:00
parent bd7bf6cd19
commit 3aa7969ff9
1 changed files with 2 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

4
docs/administration/CLI_tasks/robots_txt.md
View File

@ -1,8 +1,8 @@
# Managing robot.txt # Managing robots.txt
{! backend/administration/CLI_tasks/general_cli_task_info.include !} {! backend/administration/CLI_tasks/general_cli_task_info.include !}
## Generate a new robot.txt file and add it to the static directory ## Generate a new robots.txt file and add it to the static directory
The `robots.txt` that ships by default is permissive. It allows well-behaved search engines to index all of your instance's URIs. The `robots.txt` that ships by default is permissive. It allows well-behaved search engines to index all of your instance's URIs.