TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

Deprecating our AJAX crawling scheme

144 pointsby antichaosover 9 years ago

10 comments

m0th87over 9 years ago
Don&#x27;t believe the hype. Google has been saying that they can execute javascript for years. Meanwhile, as far as I can see, most non-trivial applications still aren&#x27;t being crawled successfully, including my company&#x27;s.<p>We recently got rid of prerender because of the promise from the last article from google saying the same thing [1]. It didn&#x27;t work.<p>1: <a href="http:&#x2F;&#x2F;googlewebmastercentral.blogspot.com&#x2F;2014&#x2F;05&#x2F;understanding-web-pages-better.html" rel="nofollow">http:&#x2F;&#x2F;googlewebmastercentral.blogspot.com&#x2F;2014&#x2F;05&#x2F;understan...</a>
评论 #10389855 未加载
评论 #10390914 未加载
cotillionover 9 years ago
So they&#x27;re actually evaluating all js and css Googlebot is consuming. That&#x27;s insane.<p>Can we forget about any new competitors in search engine land now? Not only do you have to match Google in relevance you&#x27;ll actually have to implement your own BrowserBot just to download the pages.
评论 #10389211 未加载
评论 #10389035 未加载
评论 #10388981 未加载
评论 #10389818 未加载
评论 #10389481 未加载
评论 #10389426 未加载
评论 #10389628 未加载
rdohertyover 9 years ago
Wow, I built a project that rendered JS built webpages for search engines via NodeJS and PhantomJS. Rendering webpages is <i>extremely</i> CPU intensive, I&#x27;m amazed at the amount of processing power Google must have to do this at Internet scale.<p>I really hope this works, lots of JS libraries expect things like viewport and window size information, I wonder how Google is achieving that.
评论 #10389084 未加载
评论 #10388895 未加载
评论 #10389070 未加载
评论 #10389847 未加载
评论 #10389368 未加载
评论 #10391021 未加载
评论 #10389098 未加载
评论 #10389661 未加载
a2techover 9 years ago
This is good-one of my current projects for a customer is entirely AJAX&#x2F;JS rendered and we were worried that Googlebot would have a fit with it.
评论 #10389058 未加载
评论 #10389091 未加载
评论 #10388871 未加载
espeedover 9 years ago
This was the missing piece for Polymer elements &#x2F; custom web components. Now that Google has confirmed it&#x27;s indexing JavaScript, web-component adoption should take off.
评论 #10391575 未加载
eurokc98over 9 years ago
Gary Illyes @goog said this was happening Q1 this year, and like others mentioned lots of other direct&#x2F;indirect signals have pointed this way.<p><a href="http:&#x2F;&#x2F;searchengineland.com&#x2F;google-may-discontinue-ajax-crawlable-guidelines-216119" rel="nofollow">http:&#x2F;&#x2F;searchengineland.com&#x2F;google-may-discontinue-ajax-craw...</a> March 5th: Gary said you may see a blog post at the Google Webmaster Blog as soon as next week announcing the decommissioning of these guidelines.<p>Pure speculation but interesting... The timing may have something to do with Wix, a Google Domains partner, who is having difficulty with their customer sites being indexed. The support thread shows a lot of talk around &quot;we are following Google&#x27;s Ajax guidelines so this must be a problem with Google&quot;. John Mueller is active in that thread so it&#x27;s not out of the realm of possibility someone was asked to make a stronger public statement. <a href="http:&#x2F;&#x2F;searchengineland.com&#x2F;google-working-on-fixing-problem-with-wix-web-sites-not-showing-up-in-search-results-233310" rel="nofollow">http:&#x2F;&#x2F;searchengineland.com&#x2F;google-working-on-fixing-problem...</a>
评论 #10389720 未加载
nailerover 9 years ago
Currently I use prerender.io and this meta tag:<p><pre><code> &lt;meta name=&quot;fragment&quot; content=&quot;!&quot;&gt; </code></pre> I don&#x27;t actually use #! URLs, (or pushstate, though I might use pushstate in the future) but without both of these Google can&#x27;t see anything JS generated - using Google Webmaster Tools to check.<p>Does this announcement mean I can remove the &lt;meta&gt; tag and stop using prerender.io now?
评论 #10389888 未加载
评论 #10389865 未加载
shostackover 9 years ago
Any idea how related this might be to Wix sites getting de-indexed?[1]<p><a href="http:&#x2F;&#x2F;searchengineland.com&#x2F;google-working-on-fixing-problem-with-wix-web-sites-not-showing-up-in-search-results-233310" rel="nofollow">http:&#x2F;&#x2F;searchengineland.com&#x2F;google-working-on-fixing-problem...</a>
rcconfover 9 years ago
This might be obvious to anyone who has done SEO, but can Googlebot index React&#x2F;Angular websites accurately? I was always under the impression that the isomorphic aspect of React helped with SEO (not just load times.)
评论 #10389442 未加载
jwrover 9 years ago
Finally. It was obvious we would have to get to that point eventually, it just wasn&#x27;t clear when.