Search this blog

Sep 9, 2009

Does Googlebot use inference when crawling? (Google Webmaster Video)

Leon from the UK asks:

"Does GoogleBot use inference when spidering - having crawled site.com/article/page1.htm and /page2.htm, can it guess at the existence of a /page3.htm and crawl it? Or does it stick entirely to what it finds via the link graph and/or Sitemaps/feeds?"

This video is part of a "Grab Bag" series in which Matt Cutts, head of Google's webspam team, answers questions from webmasters. We're not currently taking new video questions, so your best bet for getting an answer about webmaster-related search issues is to head to our help forum: http://www.google.com/support/forum/p...



Related Topics:

How are spam reports prioritized? (Google Webmaster Video) : Matt Cutts, head of Google's webspam team, answers questions from webmasters.

What should I watch out for if I redirect mobile visitors? (Video) : Matt Cutts, head of Google's webspam team, answers questions from webmasters.

Can you show us something that you have programmed yourself? (Google Webmaster Video) : Matt Cutts, head of Google's webspam team, answers questions.

Are different types of sites treated differently in Google? (Google Webmaster Video) : Google Webmaster Tool Tips and Tricks

News Search SEO (Google Webmaster Video) : Background and FAQs for publishers interested in Google News Search : Google Webmaster Tool Tips and Tricks

Does Google value its own links for PageRank? (Google Webmaster Tool Video)

Is Google putting more weight on brands in rankings? (Google Webmaster Video) : New Search Engine Rankings Place Heavy Emphasis on Branding

More Topics:

Google Webmaster Tool Tips and Tricks

Best From Google

Adsense Tips and Tricks

Speeding Up in a Slowdown Google Videos

Guide and Tips For Bloggers

Twitter Tools

Social Networking Tools

Useful Tools and API's
googleb9684350554081ee.html