Google Search Console. Google Webmaster Trends analyst Gary Illyes recently wrote a blog post on crawl budget in which he specifically asks webmasters to pay attention to the number of server errors in Search Console's Crawl Errors report. This is because a large number of server errors or connection timeouts usually indicate poor site health. Assuming your site has little to no server errors, the next thing you'll want to look at is your sitemaps.
Google to crawl the site more, only to find that the crawl also increased the to nearly 140,000. It turned out that many discontinued products were still included in sitemaps on the site, even though the pages had been removed, which meant that Google convert raster to vector continued to waste valuable crawl budget on products that didn't. were out of stock. Make sure your sitemaps are dynamically updated to reflect the arrival of new products and the discontinuation of old products. Finally, review your product settings. Almost all e-commerce sites
Here is an example URL for an Amazon product: in bold after the "?" is just a parameter that Amazon uses to help users find that specific roll of paper towels. Fortunately, Google Search Console (and Bing Webmaster Tools) lets you tell Googlebot not to crawl specific parameters. If you have duplicate category pages that only differ in certain sorting options, URL parameters in Search Console are a great way to conserve crawl budget for the rest of your site.