github-mirror/discourse
2
0
Fork 0
mirror of https://github.com/discourse/discourse.git synced 2025-02-05 15:57:30 +08:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity
761003c8bd
discourse/app/views/robots_txt
History
Sam d84256a876 FEATURE: add Noindex to robots.txt for disallowed routes 
This strips pages out of indexes that should not exist see:

https://meta.discourse.org/t/pages-listed-in-the-robots-txt-are-crawled-and-indexed-by-google/100309/11?u=sam
2018-11-02 16:39:47 +11:00
..
index.erb FEATURE: add Noindex to robots.txt for disallowed routes 2018-11-02 16:39:47 +11:00
no_index.erb