discourse/app/views/robots_txt
2018-04-16 15:38:10 +10:00
..
index.erb per spec we need to repeat disallow paths per agent 2018-04-16 15:38:10 +10:00
no_index.erb prefix the robots.txt rules with the directory when using subfolder 2018-04-11 22:05:02 +02:00