mirror of
https://github.com/discourse/discourse.git
synced 2024-12-24 20:03:54 +08:00
d84256a876
This strips pages out of indexes that should not exist see: https://meta.discourse.org/t/pages-listed-in-the-robots-txt-are-crawled-and-indexed-by-google/100309/11?u=sam |
||
|---|---|---|
| .. | ||
| index.erb | ||
| no_index.erb | ||