github-mirror/discourse
2
0
Fork 0
mirror of https://github.com/discourse/discourse.git synced 2024-11-24 19:03:13 +08:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity

Merge pull request #2941 from riking/archive_org

Browse Source 
Add archive.org to crawler list to serve no-js to
This commit is contained in:
Sam 2014-11-03 11:58:12 +11:00
commit 6080cee874
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
lib/crawler_detection.rb
View File

@ -1,5 +1,5 @@
module CrawlerDetection
def self.crawler?(user_agent)
!/Googlebot|Mediapartners|AdsBot|curl|Twitterbot|facebookexternalhit|bingbot|Baiduspider/.match(user_agent).nil?
!/Googlebot|Mediapartners|AdsBot|curl|Twitterbot|facebookexternalhit|bingbot|Baiduspider|ia_archiver/.match(user_agent).nil?
end
end