User-agent: * Allow: /images/jayman-vector-logo.svg Allow: /*.pdf$ Allow: /assets Disallow: /admin Disallow: /AdminSecurity/* # See https://www.google.ca/robots.txt Certain social media sites are whitelisted to allow crawlers to access page markup User-agent: Twitterbot Allow: /assets Allow: /images/jayman-vector-logo.svg Disallow: /assets/_dmsassets User-agent: facebookexternalhit Allow: /assets Allow: /images/jayman-vector-logo.svg Disallow: /assets/_dmsassets