discourse/app/views/layouts/crawler.html.erb

<!DOCTYPE html>
<html lang="<%= SiteSetting.default_locale %>">
  <head>
    <meta charset="utf-8">
    <title><%= content_for?(:title) ? yield(:title) + ' - ' + SiteSetting.title : SiteSetting.title %></title>
    <meta name="description" content="<%= @description_meta || SiteSetting.site_description %>">
    <%= render partial: "layouts/head" %>
    <%- unless customization_disabled? %>
      <%= raw SiteCustomization.custom_head_tag(session[:preview_style]) %>
    <%- end %>
    <%= render_google_universal_analytics_code %>
    <%= yield :head %>
    <style>
      header img {
        max-width: 90% !important;
        padding-bottom: 10px;
      }

      img { max-width: 100%; width: auto; height: auto; }

      #main-outlet > div {
        margin-bottom: 15px;
      }

      footer nav a {
        margin-right: 15px;
      }

      footer nav {
        line-height: 30px;
      }

      body {
        max-width: 98%;
        padding-left: 1%;
      }
      .topic-list > div > a {
        margin-right: 10px;
      }
      .topic-list > div .posts {
          margin-left: 10px;
      }
      .topic-list > div {
        margin-bottom: 15px;
      }

    </style>
  </head>
  <body>
    <%- unless customization_disabled? %>
      <%= SiteCustomization.custom_header(session[:preview_style], mobile_view? ? :mobile : :desktop) %>
    <%- end %>
    <header>
      <a href="<%= path "/" %>"><img src="<%=SiteSetting.logo_url%>" alt="<%=SiteSetting.title%>" id="site-logo" style="max-width: 400px;"></a>
    </header>
    <div id="main-outlet" class="wrap">
      <%= yield %>
    </div>
    <footer class="container">
      <nav itemscope itemtype='http://schema.org/SiteNavigationElement'>
        <a href='<%= path "/" %>'><%= t 'home_title' %></a>
        <%= link_to t('js.filters.categories.title'), path("/categories") %>
        <%= link_to t('guidelines_topic.title'), path("/guidelines") %>
        <%= link_to t('tos_topic.title'), path("/tos") %>
        <%= link_to t('privacy_topic.title'), path("/privacy") %>
      </nav>
      <p><%= t 'powered_by_html' %></p>
    </footer>
    <%= render_google_analytics_code %>
    <%- unless customization_disabled? %>
      <%= raw SiteCustomization.custom_body_tag(session[:preview_style]) %>
    <%- end %>
  </body>
</html>
Detect Googlebot from user agent and use a different layout that doesn't load javascript 2014-02-15 06:10:08 +08:00			`<!DOCTYPE html>`
			`<html lang="<%= SiteSetting.default_locale %>">`
			`<head>`
			`<meta charset="utf-8">`
			`<title><%= content_for?(:title) ? yield(:title) + ' - ' + SiteSetting.title : SiteSetting.title %></title>`
Add meta generator tag with the Discourse version. Use a partial for common head elements. 2014-06-20 06:17:52 +08:00			`<meta name="description" content="<%= @description_meta \|\| SiteSetting.site_description %>">`
			`<%= render partial: "layouts/head" %>`
move SiteText.{head,top,bottom} to SiteCustomization 2015-01-14 18:52:42 +08:00			`<%- unless customization_disabled? %>`
			`<%= raw SiteCustomization.custom_head_tag(session[:preview_style]) %>`
			`<%- end %>`
FIX: Add Google Analytics code to crawler view 2015-02-02 16:49:58 +08:00			`<%= render_google_universal_analytics_code %>`
Include opengraph/oembed tags in the crawler layout. 2014-03-15 22:32:23 +08:00			`<%= yield :head %>`
normalize crawler and no-js views 2015-01-15 17:31:30 +08:00			`<style>`
FIX: not showing content on topics for mobile crawler 2016-03-17 12:09:08 +08:00			`header img {`
tweak logo image 2016-03-17 13:56:47 +08:00			`max-width: 90% !important;`
			`padding-bottom: 10px;`
FIX: not showing content on topics for mobile crawler 2016-03-17 12:09:08 +08:00			`}`

			`img { max-width: 100%; width: auto; height: auto; }`

			`#main-outlet > div {`
			`margin-bottom: 15px;`
			`}`

			`footer nav a {`
			`margin-right: 15px;`
			`}`

			`footer nav {`
			`line-height: 30px;`
			`}`

			`body {`
			`max-width: 98%;`
			`padding-left: 1%;`
			`}`
			`.topic-list > div > a {`
			`margin-right: 10px;`
			`}`
			`.topic-list > div .posts {`
			`margin-left: 10px;`
			`}`
			`.topic-list > div {`
			`margin-bottom: 15px;`
			`}`

normalize crawler and no-js views 2015-01-15 17:31:30 +08:00			`</style>`
Detect Googlebot from user agent and use a different layout that doesn't load javascript 2014-02-15 06:10:08 +08:00			`</head>`
			`<body>`
			`<%- unless customization_disabled? %>`
FIX: footer was missing in some pages - error pages - search results pages - list of all tags - topics list of a specific tag - user leaderboard 2015-08-05 22:14:26 +08:00			`<%= SiteCustomization.custom_header(session[:preview_style], mobile_view? ? :mobile : :desktop) %>`
Detect Googlebot from user agent and use a different layout that doesn't load javascript 2014-02-15 06:10:08 +08:00			`<%- end %>`
normalize crawler and no-js views 2015-01-15 17:31:30 +08:00			`<header>`
FIX: render About page for web crawlers 2016-03-08 04:28:02 +08:00			`<a href="<%= path "/" %>"><img src="<%=SiteSetting.logo_url%>" alt="<%=SiteSetting.title%>" id="site-logo" style="max-width: 400px;"></a>`
Detect Googlebot from user agent and use a different layout that doesn't load javascript 2014-02-15 06:10:08 +08:00			`</header>`
UX: fix container layout 2015-07-28 16:02:39 +08:00			`<div id="main-outlet" class="wrap">`
Detect Googlebot from user agent and use a different layout that doesn't load javascript 2014-02-15 06:10:08 +08:00			`<%= yield %>`
			`</div>`
remove unnecessary <footer> tags 2014-11-12 21:35:20 +08:00			`<footer class="container">`
FEATURE: add microdata prop and more links for crawler - add microdata based on schema.org - add breadcrumb on the top of topic - add navigations link on the bottom of every pages - add category description on the category list 2015-02-13 19:34:22 +08:00			`<nav itemscope itemtype='http://schema.org/SiteNavigationElement'>`
FIX: crawler pages and RSS had broken links for sites deployed to a subfolder with relative_url_root 2015-05-01 00:46:19 +08:00			`<a href='<%= path "/" %>'><%= t 'home_title' %></a>`
PERF: remove 10-20ms of work from every page view <% s=Time.now; main_app.categories_path main_app.guidelines_path main_app.tos_path main_app.privacy_path p (Time.now-s)*1000%> Returns 10-20ms consistently on i7-4770k, on shared hosts the cost could easily reach 40ms This code simply calculates the strings /categories /guidelines /tos /privacy It is ludicrous to spend this enormous amount of work just to calculate 4 strings. I do not know if this is something specific about Discourse or a bug in Rails (I tried without the main_app prefix and got similar results), regardless we can got to avoid these _path APIs for now Discovered this when running a flamegraph on our home page. 2016-01-21 19:43:56 +08:00			`<%= link_to t('js.filters.categories.title'), path("/categories") %>`
			`<%= link_to t('guidelines_topic.title'), path("/guidelines") %>`
			`<%= link_to t('tos_topic.title'), path("/tos") %>`
correct path 2016-01-22 04:55:07 +08:00			`<%= link_to t('privacy_topic.title'), path("/privacy") %>`
FEATURE: add microdata prop and more links for crawler - add microdata based on schema.org - add breadcrumb on the top of topic - add navigations link on the bottom of every pages - add category description on the category list 2015-02-13 19:34:22 +08:00			`</nav>`
Put the 'Powered by Discourse...' message shown to crawlers and no-js visitors in a footer element so that SEO something something. 2014-06-20 05:32:26 +08:00			`<p><%= t 'powered_by_html' %></p>`
			`</footer>`
FIX: Add Google Analytics code to crawler view 2015-02-02 16:49:58 +08:00			`<%= render_google_analytics_code %>`
			`<%- unless customization_disabled? %>`
			`<%= raw SiteCustomization.custom_body_tag(session[:preview_style]) %>`
			`<%- end %>`
Detect Googlebot from user agent and use a different layout that doesn't load javascript 2014-02-15 06:10:08 +08:00			`</body>`
			`</html>`