Merge pull request #2941 from riking/archive_org

Add archive.org to crawler list to serve no-js to
This commit is contained in:
Sam 2014-11-03 11:58:12 +11:00
commit 6080cee874

View File

@ -1,5 +1,5 @@
module CrawlerDetection module CrawlerDetection
def self.crawler?(user_agent) def self.crawler?(user_agent)
!/Googlebot|Mediapartners|AdsBot|curl|Twitterbot|facebookexternalhit|bingbot|Baiduspider/.match(user_agent).nil? !/Googlebot|Mediapartners|AdsBot|curl|Twitterbot|facebookexternalhit|bingbot|Baiduspider|ia_archiver/.match(user_agent).nil?
end end
end end