discourse/config
Sam 3a7b696703 FEATURE: allow for setting crawl delay per user agent
Also moved to default crawl delay bing so no more than a req every 5 seconds is allowed

New site settings:

"slow_down_crawler_user_agents" - list of crawlers that will be slowed down
"slow_down_crawler_rate" - how many seconds to wait between requests

Not enforced server side yet
2018-04-06 10:15:23 +10:00
..
cloud/cloud66 Add rubocop to our build. (#5004) 2017-07-28 10:20:09 +09:00
environments also watch CSS in unicorn on dev 2018-03-09 17:47:57 +11:00
initializers FEATURE: Webhook for tag events 2018-04-04 17:49:20 +05:30
locales FEATURE: allow for setting crawl delay per user agent 2018-04-06 10:15:23 +10:00
application.rb Review Changes for f4f8a293e7. 2018-02-21 14:55:49 +08:00
boot.rb Make bootsnap MRI only for now 2018-02-26 10:29:25 +11:00
cdn.yml.sample
database.yml Support user defined postgres timeouts 2017-10-27 09:59:44 -04:00
deploy.rb.sample enough with the malloc limit, not needed 2016-05-25 21:09:07 +10:00
discourse_defaults.conf Add new config to ensure backup/restore connects to PG directly. 2018-03-09 10:28:03 +08:00
discourse.config.sample enough with the malloc limit, not needed 2016-05-25 21:09:07 +10:00
discourse.pill.sample
environment.rb prevent the application from starting in development mode when SMTP settings are changed 2016-06-03 17:39:54 +02:00
logrotate.conf
multisite.yml.production-sample
nginx.global.conf
nginx.sample.conf FEATURE: add request start time so we can track queueing 2018-03-26 16:29:20 +11:00
projections.json
puma.rb Add rubocop to our build. (#5004) 2017-07-28 10:20:09 +09:00
routes.rb Simplify log in for request specs. 2018-03-28 11:32:47 +08:00
sidekiq.yml Opps no reason to limit this to 1. 2017-09-29 08:19:35 +08:00
site_settings.yml FEATURE: allow for setting crawl delay per user agent 2018-04-06 10:15:23 +10:00
spring.rb
thin.yml.sample
unicorn_launcher
unicorn_upstart.conf enough with the malloc limit, not needed 2016-05-25 21:09:07 +10:00
unicorn.conf.rb More control over Unicorn logstash logger. 2017-11-15 12:28:36 +08:00