We’d like to use a URL parameter function to save crawl budget.

We’d like to use a URL parameter function to save crawl budget but we found different opinions on the web for example we have a shirt in different sizes and colors with the same content like what should we do there.

Webmaster Guru Asked on April 5, 2017 in Crawling.
Add Comment
1 Answer(s)

JOHN MEULLER (Webmaster Analyst from Google):

So the Euro parameter tool is fantastic for something like that different parameters if you can set it up for that then that’s a great way to do that it’s not the same as blocking with robots txt though so it’s not a guarantee that we’ll never crawl those URLs or never index them but if we can confirm from like spot checking that we don’t actual depending on how you have them set up.

Webmaster Guru Answered on April 5, 2017.
Add Comment

Your Answer

By posting your answer, you agree to the privacy policy and terms of service.