github-mirror/discourse
2
0
Fork 0
mirror of https://github.com/discourse/discourse.git synced 2024-11-23 09:17:08 +08:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity

add a warning in robots.txt when using subfolder

Browse Source
This commit is contained in:
Régis Hanol 2018-04-12 00:00:15 +02:00
parent 062bf8bad3
commit 1a9271dd2f
1 changed files with 4 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

5
app/views/robots_txt/index.erb
View File

@ -1,4 +1,7 @@
# See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file
# See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file
<% if Discourse.base_uri.present? %>
# This robots.txt file is not used. Please append the content below in the robots.txt file located at the root
<% end %>
#
<% @allowed_user_agents.each do |user_agent| %>
User-agent: <%= user_agent %>