github-mirror/discourse
2
0
Fork 0
mirror of https://github.com/discourse/discourse.git synced 2025-02-17 07:12:46 +08:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity

FEATURE: enable canonical url indexing (#16196)

Browse Source 
We rolled out a change to disable canonical indexing.

The goal behind it was to limit crawl budget by Google being spent
scanning non canonical topic links.

Since this change was applied we rolled out 2 fixes that made the change
no longer needed.

1. Topic RSS feeds are no longer followed, links in the RSS feeds are
not followed.

2. Post RSS feeds now contain canonical links.

Combined these two changes mean crawlers no longer discover a large
amount on non-canonical links on Discourse sites.
This commit is contained in:
Sam 2022-03-16 09:36:04 +11:00 committed by GitHub
parent 6a295ea9e9
commit 81be734873
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
config/site_settings.yml
View File

@ -1605,7 +1605,7 @@ security:
enable_escaped_fragments: true
allow_index_in_robots_txt: true
allow_indexing_non_canonical_urls:
default: false
default: true
hidden: true
moderators_manage_categories_and_groups: false
moderators_change_post_ownership: