Crawl your site the way Googlebot does.