crismanNoble/preview.as

Some sites are not showing the same meta tags as when manually inspected

Opened this issue · 1 comments

Example:
https://consortiumholdings.com/

preview.as raw meta: https://preview.as/?url=https://consortiumholdings.com

last fetched: Fri Feb 26 2021 08:28:33 GMT-0800 (Pacific Standard Time)
inital url: https://consortiumholdings.com
final url: https://consortiumholdings.com
http status: 200
favicon: https://consortiumholdings.com/favicon.ico
<meta name="robots" content="noindex,nofollow">

view-source meta (partial) view-source:https://consortiumholdings.com/

--
<!-- This site is optimized with the Yoast SEO plugin v13.5 - https://yoast.com/wordpress/plugins/seo/ -->
  | <title>Home - Consortium Holdings</title>
  | <meta name="robots" content="max-snippet:-1, max-image-preview:large, max-video-preview:-1"/>
  | <link rel="canonical" href="https://consortiumholdings.com/" />
  | <meta property="og:locale" content="en_US" />
  | <meta property="og:type" content="website" />
  | <meta property="og:title" content="Home - Consortium Holdings" />
  | <meta property="og:description" content="we are a social &amp; culinary collective creating incubators for meaningful interaction. we try to create places that matter. We set out to create not restaurants and bars, but public gathering spaces that help cultivate our neighborhoods through the fostering of creativity, dialogue, questions and conversations." />
  | <meta property="og:url" content="https://consortiumholdings.com/" />
  | <meta property="og:site_name" content="Consortium Holdings" />
  | <meta property="og:image" content="https://consortiumholdings.com/wp-content/uploads/2015/06/Lobster-Fry-Grab.jpg" />
  | <meta property="og:image:secure_url" content="https://consortiumholdings.com/wp-content/uploads/2015/06/Lobster-Fry-Grab.jpg" />
  | <meta property="og:image:width" content="1280" />
  | <meta property="og:image:height" content="720" />
  | <meta name="twitter:card" content="summary_large_image" />
  | <meta name="twitter:description" content="we are a social &amp; culinary collective creating incubators for meaningful interaction. we try to create places that matter. We set out to create not restaurants and bars, but public gathering spaces that help cultivate our neighborhoods through the fostering of creativity, dialogue, questions and conversations." />
  | <meta name="twitter:title" content="Home - Consortium Holdings" />
  | <meta name="twitter:image" content="https://consortiumholdings.com/wp-content/uploads/2015/06/Lobster-Fry-Grab.jpg" />
  | <script type='application/ld+json' class='yoast-schema-graph yoast-schema-graph--main'>{"@context":"https://schema.org","@graph":[{"@type":"Organization","@id":"https://consortiumholdings.com/#organization","name":"Consortium Holdings","url":"https://consortiumholdings.com/","sameAs":[],"logo":{"@type":"ImageObject","@id":"https://consortiumholdings.com/#logo","inLanguage":"en-US","url":"https://consortiumholdings.com/wp-content/uploads/2019/12/CH_LOGO-01.png","width":500,"height":500,"caption":"Consortium Holdings"},"image":{"@id":"https://consortiumholdings.com/#logo"}},{"@type":"WebSite","@id":"https://consortiumholdings.com/#website","url":"https://consortiumholdings.com/","name":"Consortium Holdings","inLanguage":"en-US","publisher":{"@id":"https://consortiumholdings.com/#organization"},"potentialAction":[{"@type":"SearchAction","target":"https://consortiumholdings.com/?s={search_term_string}","query-input":"required name=search_term_string"}]},{"@type":"ImageObject","@id":"https://consortiumholdings.com/#primaryimage","inLanguage":"en-US","url":"https://consortiumholdings.com/wp-content/uploads/2015/06/Lobster-Fry-Grab.jpg","width":1280,"height":720},{"@type":"WebPage","@id":"https://consortiumholdings.com/#webpage","url":"https://consortiumholdings.com/","name":"Home - Consortium Holdings","isPartOf":{"@id":"https://consortiumholdings.com/#website"},"inLanguage":"en-US","about":{"@id":"https://consortiumholdings.com/#organization"},"primaryImageOfPage":{"@id":"https://consortiumholdings.com/#primaryimage"},"datePublished":"2015-06-23T08:22:51+00:00","dateModified":"2020-01-28T14:04:06+00:00","potentialAction":[{"@type":"ReadAction","target":["https://consortiumholdings.com/"]}]}]}</script>
  | <!-- / Yoast SEO plugin. -->
  |  

Looks like when fetching as twitter bot the response is being blocked, this is the html returned

result <html style="height:100%"><head><META NAME="ROBOTS" CONTENT="NOINDEX, NOFOLLOW"><meta name="format-detection" content="telephone=no"><meta name="viewport" content="initial-scale=1.0"><meta http-equiv="X-UA-Compatible" content="IE=edge,chrome=1"></head><body style="margin:0px;height:100%"><iframe id="main-iframe" src="/_Incapsula_Resource?SWUDNSAI=30&xinfo=7-122338781-0%200NNN%20RT%281614357196052%2027%29%20q%280%20-1%20-1%20-1%29%20r%280%20-1%29%20B12%284%2c315%2c0%29%20U18&incident_id=1292000130288427509-509754975363793735&edet=12&cinfo=04000000&rpinfo=0&cts=LP5XnDHDWLntLwl4Q1wwOwKCVd9v0maDbjgis4AgCntyhGxm1fppQysQX8IYHGa2" frameborder=0 width="100%" height="100%" marginheight="0px" marginwidth="0px">Request unsuccessful. Incapsula incident ID: 1292000130288427509-509754975363793735</iframe></body></html>