mirror of
https://github.com/discourse/discourse.git
synced 2024-11-23 06:29:30 +08:00
Add archive.org to crawler list to serve no-js to
This commit is contained in:
parent
4d82a571fb
commit
37dbc4b5e6
|
@ -1,5 +1,5 @@
|
|||
module CrawlerDetection
|
||||
def self.crawler?(user_agent)
|
||||
!/Googlebot|Mediapartners|AdsBot|curl|Twitterbot|facebookexternalhit|bingbot|Baiduspider/.match(user_agent).nil?
|
||||
!/Googlebot|Mediapartners|AdsBot|curl|Twitterbot|facebookexternalhit|bingbot|Baiduspider|ia_archiver/.match(user_agent).nil?
|
||||
end
|
||||
end
|
||||
|
|
Loading…
Reference in New Issue
Block a user