More detailed search queries in Webmaster Tools

Webmaster level: intermediate

To help jump-start your year and make metrics for your site more actionable, we've updated one of the most popular features in Webmaster Tools: data in the search queries feature will no longer be rounded / bucketed. This change will become visible over the next few days.

The search queries feature gives insights into the searches that have at least one page from your website shown in the search results. It collects these "impressions" together with the times when users visited your site - the "clicks" - and displays these for the last 90 days.

Before and after:

We hope this makes it easier for you to see the finer details of how users are finding your website, and when they're clicking through. Should you have any questions, feel free to visit our help forum.

Posted by John Mueller, frequent searcher & Webmaster Trends Analyst, Google Switzerland

Read More

Improved Search Queries stats for separate mobile sites

Webmaster Level: All

Search Queries in Webmaster Tools just became more cohesive for those who manage a mobile site on a separate URL from desktop, such as mobile on m.example.com and desktop on www. In Search Queries, when you view your m. site* and set Filters to “Mobile,” from Dec 31, 2013 onwards, you’ll now see:

• Queries where your m. pages appeared in search results for mobile browsers
• Queries where Google applied Skip Redirect. This means that, while search results displayed the desktop URL, the user was automatically directed to the corresponding m. version of the URL (thus saving the user from latency of a server-side redirect).

Skip Redirect information (impressions, clicks, etc.) calculated with mobile site.

Prior to this Search Queries improvement, Webmaster Tools reported Skip Redirect impressions with the desktop URL. Now we’ve consolidated information when Skip Redirect is triggered, so that impressions, clicks, and CTR are calculated solely with the verified m. site, making your mobile statistics more understandable.

Best practices if you have a separate m. site

Here are a few search-friendly recommendations for those publishing content on a separate m. site:

• Follow our advice on Building Smartphone-Optimized Websites
• On the desktop page, add a special link rel="alternate" tag pointing to the corresponding mobile URL. This helps Googlebot discover the location of your site's mobile pages.
• On the mobile page, add a link rel="canonical" tag pointing to the corresponding desktop URL.
• Use the HTTP Vary: User-Agent header if your servers automatically redirect users based on their user agent/device.
• Verify ownership of both the desktop (www) and mobile (m.) sites in Webmaster Tools for improved communication and troubleshooting information specific to each site.

* Be sure you've verified ownership for your mobile site!

Written by Maile Ohye, Developer Programs Tech Lead

Read More

So long, 2013, and thanks for all the fish

Now that 2013 is almost over, we'd love to take a quick look back, and venture a glimpse into the future. Some of the important topics on our blog from 2013 were around mobile, internationalization, and search quality in general. Here are some of the most popular new posts from this year:

• Changes in rankings of smartphone search results
• Introducing "x-default hreflang" for international landing pages
• 5 common mistakes with rel=canonical
• A reminder about selling links that pass PageRank
• View manual webspam actions in Webmaster Tools
• The Webmaster Academy goes international
• We created a first steps cheat sheet for friends & family
• In-depth articles in search results
• Make the most of Search Queries in Webmaster Tools
• rel="author" frequently asked (advanced) questions
• Getting started with structured data
• Backlinks and reconsideration requests
• Making smartphone sites load fast
• Easier recovery for hacked sites
• So long, 2013, and thanks for all the fish

It's been a busy year here on the blog. We hope that our posts here have helped to make these - sometimes complex - topics a bit easier to understand. Is there anything you would have wanted more information about? Let us know in the comments!

Our Help Forum and office hours hangouts have also been a place for helpful, insightful, and sometimes controversial discussions. It's not always easy to find ways to improve websites, or to solve technical & usability issues that users post about, so we're extremely thankful to have such a fantastic group of Top Contributors that give advice and provide feedback there.

Where are we headed in 2014? Only time will tell, but I'm sure we'll see more information for the general webmaster, hard-core technical advice, ways to make mobile sites even better, rockin' Webmaster Tools updates, tips on securing your site & its connections, and more. Are you ready? Don't forget your towel & let's go!

On behalf of all the webmaster help forum guides, we wish you happy holidays & a great 2014.

Posted by Zineb Ait Bahajji and John Mueller, Webmaster Trends Analysts

Read More

Switching to the new website verification API

Webmaster level: advanced

Just over a year ago we introduced a new API for website verification for Google services. In the spirit of keeping things simple and focusing our efforts, we've decided to deprecate the old verification API method on March 31st, 2014. The rest of the API will remain unchanged, this only affects the verification method. For more information about verification in general, please see our site verification Help Center article.

One advantage of upgrading to the new API for verification is that it uses the same client libraries as most other Google APIs, which simplifies integration with other apps and tools. Getting started is easy, especially if you're used to other Google APIs:

1. Download the Google API client library for your favorite programming language.
2. Learn about the Site Verification API and its methods.
3. Allow your users to authenticate with OAuth.
4. Start verifying!

If you can't wait to try it out and are a fan of command lines, here's a shortcut:

1. Download and install oacurl.
2. Authenticate with a Google Account:
   $ java -cp oacurl-1.2.0.jar com.google.oacurl.Login \
  --scope https://www.googleapis.com/auth/siteverification
3. Request the verification information:
   $ echo '{ "verificationMethod": "FILE", "site": {
 "identifier": "http://www.example.com",
 "type": "SITE" } }' | \
 java -cp oacurl-1.2.0.jar com.google.oacurl.Fetch \
 'https://www.googleapis.com/siteVerification/v1/token' \
 --content-type JSON -X=POST
4. Create & add the file to your website, then verify:
   $ echo '{ "site": { "identifier": "http://www.example.com",
"type": "SITE" } }' | \
java -cp oacurl-1.2.0.jar com.google.oacurl.Fetch \
'https://www.googleapis.com/siteVerification/v1/webResource?verificationMethod=FILE' \
--content-type JSON -X=POST
5. Done!

We hope this API will make it easier to implement Google site verification in your projects. Should you have any questions, feel free to comment here, or post in our Webmaster Help Forum.

Posted by John Mueller, fan of long command lines & Webmaster Trends Analyst

Read More

Improving URL removals on third-party sites

Webmaster level: all

Content on the Internet changes or disappears, and occasionally it's helpful to have search results for it updated quickly. Today we launched our improved public URL removal tool to make it easier to request updates based on changes on other people's websites. You can find it at https://www.google.com/webmasters/tools/removals

This tool is useful for removals on other peoples' websites. You could use this tool if a page has been removed completely, or if it was just changed and you need to have the snippet & cached page removed. If you're the webmaster of the site, then using the Webmaster Tools URL removal feature is faster & easier.

How to request a page be removed from search results

If the page itself was removed completely, you can request that it's removed from Google's search results. For this, it's important that the page returns the proper HTTP result code (403, 404, or 410), has a noindex robots meta tag, or is blocked by the robots.txt (blocking via robots.txt may not prevent indexing of the URL permanently). You can check the HTTP result code with a HTTP header checker. While we attempt to recognize "soft-404" errors, having the website use a clear response code is always preferred. Here's how to submit a page for removal:

1. Enter the URL of the page. As before, this needs to be the exact URL as indexed in our search results. Here's how to find the URL.
2. The analysis tool will confirm that the page is gone. Confirm the request to complete the submission.
3. There's no step three!
   

How to request a page's cache & snippet be removed from search results

If the page wasn't removed, you can also use this tool to let us know that a text on a page (such as a name) has been removed or changed. It'll remove the snippet & cached page in Google's search results until our systems have been able to reprocess the page completely (it won't affect title or ranking). In addition to the page's URL, you'll need at least one word that used to be on the page but is now removed. You can learn more about cache removals in our Help Center.

1. Enter the URL of the page which has changed. This needs to be the exact URL as indexed in our search results. Here's how to find the URL.
2. Confirm that the page has been updated or removed, and confirm that the cache & snippet are outdated (do not match the current content).
3. Now, enter a word that no longer appears on the live page, but which is still visible in the cache or snippet. See our previous blog post on removals for more details.

You can find out more about URL removals in our Help Center, as well as in our earlier blog posts on removing URLs & directories, removing & updating cached content, removing content you don't own, and tracking requests + what not to remove.

We hope these changes make it easier for you to submit removal requests! We welcome your feedback in our removals help forum category, where other users may also be able to help with more complicated removal issues.

Posted by John Mueller, Webmaster Trends Analyst

Read More

Structured Data dashboard: new markup error reports for easier debugging

Since we launched the Structured Data dashboard last year, it has quickly become one of the most popular features in Webmaster Tools. We’ve been working to expand it and make it even easier to debug issues so that you can see how Google understands the marked-up content on your site.

Starting today, you can see items with errors in the Structured Data dashboard. This new feature is a result of a collaboration with webmasters, whom we invited in June to>register as early testers of markup error reporting in Webmaster Tools. We’ve incorporated their feedback to improve the functionality of the Structured Data dashboard.

An “item” here represents one top-level structured data element (nested items are not counted) tagged in the HTML code. They are grouped by data type and ordered by number of errors:

We’ve added a separate scale for the errors on the right side of the graph in the dashboard, so you can compare items and errors over time. This can be useful to spot connections between changes you may have made on your site and markup errors that are appearing (or disappearing!).

Our data pipelines have also been updated for more comprehensive reporting, so you may initially see fewer data points in the chronological graph.

How to debug markup implementation errors

1. To investigate an issue with a specific content type, click on it and we’ll show you the markup errors we’ve found for that type. You can see all of them at once, or filter by error type using the tabs at the top:



2. Check to see if the markup meets the implementation guidelines for each content type. In our example case (events markup), some of the items are missing a startDate or name property. We also surface missing properties for nested content types (e.g. a review item inside a product item) — in this case, this is the lowprice property.
3. Click on URLs in the table to see details about what markup we’ve detected when we crawled the page last and what’s missing. You’ll can also use the “Test live data” button to test your markup in the Structured Data Testing Tool. Often when checking a bunch of URLs, you’re likely to spot a common issue that you can solve with a single change (e.g. by adjusting a setting or template in your content management system).



4. Fix the issues and test the new implementation in the Structured Data Testing Tool. After the pages are recrawled and reprocessed, the changes will be reflected in the Structured Data dashboard.

We hope this new feature helps you manage the structured data markup on your site better. We will continue to add more error types in the coming months. Meanwhile, we look forward to your comments and questions here or in the dedicated Structured Data section of the Webmaster Help forum.

Posted by Mariya Moeva, Webmaster Trends Analyst

Read More

Checklist and videos for mobile website improvement

Webmaster Level: Intermediate to Advanced

Unsure where to begin improving your smartphone website? Wondering how to prioritize all the advice? We just published a checklist to help provide an efficient approach to mobile website improvement. Several topics in the checklist link to a relevant business case or study, other topics include a video explaining how to make data from Google Analytics and Webmaster Tools actionable during the improvement process. Copied below are shortened sections of the full checklist. Please let us know if there’s more you’d like to see, or if you have additional topics for us to include.

Step 1: Stop frustrating your customers

• Remove cumbersome extra windows from all mobile user-agents | Google recommendation, Article
  • JavaScript pop-ups that can be difficult to close.
  • Overlays, especially to download apps (instead consider a banner such as iOS 6+ Smart App Banners or equivalent, side navigation, email marketing, etc.).
  • Survey requests prior to task completion.


• Provide device-appropriate functionality
  • Remove features that require plugins or videos not available on a user's device (e.g., Adobe Flash isn't playable on an iPhone or on Android versions 4.1 and higher). | Business case
  • Serve tablet users the desktop version (or if available, the tablet version). | Study
  • Check that full desktop experience is accessible on mobile phones, and if selected, remains in full desktop version for duration of the session (i.e., user isn't required to select "desktop version" after every page load). | Study


• Correct high traffic, poor user-experience mobile pages
  
  
  
  How to correct high-traffic, poor user-experience mobile pages with data from Google Analytics bounce rate and events (slides)


• Make quick fixes in performance (and continue if behind competition) | Business case



How to make quick fixes in mobile site performance and compare your site to the competition (slides)

To see all topics in “Stop frustrating your customers,” please see the full Checklist for mobile website improvement.

Step 2: Facilitate task completion

• Optimize crawling, indexing, and the searcher experience | Business case
  
  • Unblock resources (CSS, JavaScript) that are robots.txt disallowed.
  • Implement search-engine best practices given your mobile implementation:
    • Responsive design: Be sure to include CSS @media query.
    • Separate mobile site: Add rel=alternate media and rel=canonical, as well as Vary: User-Agent HTTP Header which helps Google implement Skip Redirect.
    • Dynamic serving: Include Vary: User-Agent HTTP header.
  
  
• Optimize popular mobile persona workflows for your site
  
  
  How to optimize popular mobile workflows using Google Webmaster Tools and Google Analytics (slides)

Step Three: Convert customers into fans!

• Consider search integration points with mobile apps | Announcement, Information


• Brainstorm new ways to provide value
  • Build for mobile behavior, such as the in-store shopper. | Business case
  • Leverage smartphone GPS, camera, accelerometer.
  • Increase sharing or social behavior. | Business case
  • Consider intuitive/fun tactile functionality with swiping, shaking, tapping.

Written by Maile Ohye, Developer Programs Tech Lead

Read More