FEATURE: block bing from crawling all discourse sites

bing is crawling our properties 10x faster than any other crawler,
until default behavior is improved we are blocking it out-of-the-box

You may enable it by setting the blacklist back to empty
This commit is contained in:
Sam 2018-04-05 16:02:51 +10:00
parent 8760c4d68c
commit 91a4fee03d

View File

@ -1023,7 +1023,7 @@ security:
default: ''
blacklisted_crawler_user_agents:
type: list
default: ''
default: 'bingbot'
onebox:
enable_flash_video_onebox: false