Fixing Crawl Errors Found by Google Webmaster Tools

Google Webmaster Tools helps diagnose your website visibility performance issues that Googlebot has detected. One area that you want to pay close attention to is Crawl Errors under the Diagnostics section. A crawl error is when Googlebot tried to crawl a page but could not access it. It’s expected that most URLs will return a 200 response code, some a 404 response, some will be disallowed by robots.txt, etc. The main error types are, Not found, URLs not followed, URLs restricted by robots.txt, URLs timed out, HTTP errors, URL unreachable, and Soft 404s. The most common remedy is to export the list of URLs with errors and 301 (permanently) redirect the ones that are dead pages. Work with your SEO and Web Support teams to keep your website’s crawl errors to a minimum.