Configuring URL Parameters in Webmaster Tools

TL;DR

Learn to configure URL parameters for efficient site crawling.

Transcript

Maile Ohye: Hi. I'm Maile Ohye. I'm a member of Google's webmaster support team. And I'd like to help you better understand how to use the URL parameters feature in webmaster tools. URL parameters is a fairly advanced feature. So some of this information might be more complex than one would expect. Before you further watch this video, please chec... Read More

Key Insights

• URL parameters are an advanced feature in Webmaster Tools that help Google crawl websites more efficiently by providing hints on which URLs to prioritize.
• Improper configuration of URL parameters can lead to pages being dropped from search indexes, so it's crucial to understand their impact.
• Googlebot aims to crawl unique and useful content, reducing the crawling of duplicate URLs to save bandwidth and improve content focus.
• Parameters that do not change page content, such as session IDs or tracking IDs, can be marked accordingly to streamline crawling.
• Parameters that alter page content, like sort or filter options, require careful configuration to ensure important content remains accessible.
• The 'sort' parameter can be complex; if it’s optional or consistent across the site, specific crawling rules can be set to optimize efficiency.
• The 'narrows' parameter filters content; if it leads to less useful pages, setting it to 'Crawl No URLs' might be beneficial, but requires verification.
• For 'specifies' and 'paginates' parameters, it's generally best to allow crawling of every URL to ensure all content is indexed.

Questions & Answers

Q: What is the primary purpose of URL parameters in Webmaster Tools?

The primary purpose of URL parameters in Webmaster Tools is to provide Google with hints on how to crawl a website more efficiently. By configuring these parameters, webmasters can help Googlebot prioritize unique and useful content, thereby reducing the crawling of redundant URLs and saving bandwidth.

Q: What are the risks of improperly configuring URL parameters?

Improperly configuring URL parameters can lead to significant risks, such as pages being dropped from Google's search index. This happens because incorrect settings might prevent Googlebot from accessing important content, resulting in a loss of visibility in search results and potentially impacting site traffic.

Q: How should parameters that do not change page content be handled?

Parameters that do not change page content, like session IDs or tracking IDs, should be marked as 'does not change content' in Webmaster Tools. This helps Googlebot recognize these URLs as representative and avoid unnecessary crawling of duplicates, thereby improving the efficiency of the crawling process.

Q: Why is it important to verify URLs when configuring the 'narrows' parameter?

Verifying URLs when configuring the 'narrows' parameter is crucial because this parameter filters content on a page. If configured incorrectly, it can lead to the exclusion of important pages from being crawled and indexed. Ensuring that non-useful content is filtered out without affecting key pages helps maintain search visibility.

Q: What should be considered when configuring the 'sort' parameter?

When configuring the 'sort' parameter, it's important to determine if it is optional or used consistently across the site. Depending on these factors, webmasters might decide to crawl no URLs or only specific URLs with certain sort values. This careful configuration helps manage how Googlebot accesses sorted content efficiently.

Q: How does the 'specifies' parameter affect crawling decisions?

The 'specifies' parameter directly determines the content displayed on a page, such as item IDs or SKUs. For this reason, it's generally recommended to allow Googlebot to crawl every URL associated with this parameter to ensure that all specific content is indexed and available in search results.

Q: Why might translated content be better organized in sub-directories?

Organizing translated content in sub-directories or sub-folders is recommended as it helps Google understand the site's structure better. This organization clarifies the regional or language-specific content, which can improve how Google indexes and presents this content in search results, enhancing visibility for international audiences.

Q: What is the overall strategy for handling multiple parameters in one URL?

When dealing with multiple parameters in one URL, the strategy is to use a process of elimination rather than inclusion. By applying the knowledge of the site and the settings in URL parameters, webmasters can weed out URLs that shouldn't be crawled, ultimately focusing on a smaller subset of valuable URLs for Googlebot to index.

Summary & Key Takeaways

• Maile Ohye from Google's webmaster support team explains the use of URL parameters in Webmaster Tools to enhance crawling efficiency. She emphasizes the importance of correct configuration to avoid dropping pages from search indexes and advises on handling parameters that do or do not affect page content.

• The video outlines different types of parameters such as 'sort', 'narrows', 'specifies', 'translates', and 'paginates', and provides guidance on how to configure them. It highlights scenarios where Googlebot's crawling behavior can be tailored to improve efficiency and reduce redundancy.

• Ohye advises webmasters to start by identifying parameters that do not change page content and then proceed to configure those that do. She stresses the importance of letting Googlebot decide when in doubt and provides best practices for organizing translated content in sub-directories.