Accidental Noindexation Recovery Strategy and Results |
Accidental Noindexation Recovery Strategy and Results Posted: 28 Sep 2011 04:16 AM PDT Posted by chadburgess This post was originally in YOUmoz, and was promoted to the main blog because it provides great value and interest to our community. The author's views are entirely his or her own and may not reflect the views of SEOmoz, Inc. "I know before the cards are even turned over..." - Mike McDermott, Rounders When Mike McD was called by Teddy KGB in a huge No-Limit Hold'em poker pot, he didn't have to see his opponents hand to know that KGB had two aces, the only hand in the deck that could beat his nines full of aces (if you have seen Rounders, feel free to skip over the video below, if not, you probably should get on that). This was the same feeling I had when we got "SERP a DERPd" via accidental noindexation of 9,000 of our most important pages....
Contents:
(note that I am focusing on Google in this post) Background: I am an in-house SEO and customer acquisition marketer at SeatGeek.com, a NYC tech startup. Our site is a ticket search engine for sports concerts and theater tickets (i.e. "a Kayak for event tickets"). On Monday 8/1, I was searching Google for 'mets tickets' and saw that SeatGeek had slipped from page 1. Worse, we weren't even on page 2. I tried a few more queries that I knew we should be on page 1 for and still nothing. My heart was beating. Had we been Panda'd? It didn't make sense, but I was panicked. Then it hit me. I opened up our New York Mets page, but, just like Mike Mcd, I knew before I even clicked view source...content="noindex" on all of our product pages.
What happens when pages are accidentally noindexed
This is a chart of incoming organic traffic to one of our key pages right when the noindex hit. Obviously organic traffic ceased to exist. Interestingly though, Google Analytics still reported some traffic to these pages. This might be the one instance where having less frequent crawl frequency can be beneficial (assuming bandwidth isn't an issue). The pages that got noindexed are recrawled every 4-6 days, which would have given us a buffer if we caught this sooner. Unfortunately, Google waited until Saturday to crawl these pages and we didn't catch the problem until Monday. Reindexation Plan and Tactics: The first course of action was to remove the noindex tags, which one of our pop star engineers did within five minutes. This was right around the time I sent out my first plan of action email which I have included below in case you ever have to write the same email: All,
http://www.webmasterworld.com/webmaster/3601620.htm Here's to hoping this is true "My experience is that "noindex" is quite harmless when it comes to ranking. As soon as you change it to "index", the pages should pop up at nearly the same positions in the SERPs as where they were." I will keep you all posted. -Chad Even if rankings would come back, we wanted this to happen as quickly as possible. I had a plan, and fortunately some great interns to help me out. So this is what we did (excuse any repetition from the email)...
All of the above was completed within one hour of us discovering the issue, except for the guest posts and contest which were done over the next 1-2 days. And then we waited... Reindexation Metrics: It took 1-2 days for our most important pages to get back into the index, which we were really happy with. Some of our deeper / less important pages took up to 5 days to come back or longer in some cases. Fortunately we had followed advice from other Mozzers and introduced multiple XML sitemaps earlier in the year with all our product pages in one XML sitemap we were able to easily track indexation of these pages via Google Webmaster Tools. Indexation and traffic were on their way back up by the next day, but as you can tell from the graph below traffic didn't return to previous levels to about 2-3 days from when the noindex tag was removed.
Rankings Impact of Noindexation: Now let's look at how this impacted our SERP rankings. The example above, was a truly interesting case because our Mets page returned to the index the night of the fix and I emailed my bosses to check it out as a good example of a recovering page, but by the time we got into work the next morning it had left the index again and I looked like a clown shoe. Fortunately, the page came back (again...) into the index the next day and was back up to its previous ranking by the end of the week. This is an example of a trend I noticed that many pages would come back into the index first and then return to ranking for their target terms a day or so later. The example below is one where we returned to the index but without the same rank as we had before. There isn't really a way to tell if this was impacted at all by the noindex situation, I suspect it was just a random Google dance related to the more frequent shakeups I have seen in event "tickets" related queries. Overall, our page 1 SERP positions have completely returned to prior levels. Conclusions:
Ok so that was probably too much information for just an accidental noindex situation, but when it happened to me it was scary and there wasn't a solid documentation on what to expect, so I wanted to produce this for the next person in my situation. Thanks for reading. Connect with me on Twitter if you are so inclined. |
Conquer Link Directory Best Practices for SEO Posted: 27 Sep 2011 02:11 PM PDT Posted by Cyrus Shepard Good news to all you link builders out there. SEOmoz just updated the PRO SEO Web Directory List. The long overdue update includes over 400 directories (up from 180) separated into three categories – Web, Local and Social. Wait, aren’t link directories dead? The practice of obtaining links from online directories has changed dramatically over the past 10 years. The stereotypes of the past are both true and dangerous. Spammy, low quality directories flood the lower cesspools of the Internet. An unbridled strategy of obtaining links from these non-discriminate directories can actually hurt your SEO. But times have changed, and strategies have become more evolved. Rethinking DirectoriesWe can move beyond thinking about directories as nothing more than paid links. For webmasters who use this approach, the links they obtain may not be worth the effort. An intelligent directory strategy provides depth to your SEO campaigns and offers tangible benefits including:
If you use different directories for different purposes, you can achieve this and more. A. Web DirectoriesIf links were easy for everyone, they would be less valuable for all of us. In general, the lower the bar of entry into any directory, the less inclusion into that directory is valued by the search engines. Some editorial directories raise the bar by charging a high cost of inclusion (Yahoo, Best of the Web) and being somewhat selective about whom they include. Three hundred dollars is a lot to pay for “inclusion review” but the truth is that for an established business, these links are like bread and butter. Other directories focus on a particular area, and thus are harder to get into. Examples of these “niche” directories include sites such as:
When pursuing directory links, keep the following tips in mind:
I’d often rather have a hard-to-get link from a smaller niche site that an easy-to-get link from a larger well-known directory. B. Social DirectoriesWe know that the rise of Social SEO means sharing your content on sites like Facebook and Twitter can have a positive impact on your site’s traffic. But far too many people limit sharing to the big three (Twitter, Facebook and Google+) without considering other social sharing sites. The plethora of specialized social sites offer several benefits. 1. Member Profiles – Here’s a random profile from Mister Wong, a social bookmarking site. (thank you rgonzalo!) Mr. rgonzalo appears to be an authority on the site. Any content he shares will carry weight with the Mister Wong audience. 2. Content Publishing – Instead of a single website listing, social sites allow you to promote individual pieces of content. Using the above example, whenever Rgonzolo shares a URL, that content is likely linked to and noticed by search engines. 3. Increased participation increases visibility. You probably can’t participate in every social site out there. For web marketers, focusing on a few sites where you can devote your time, like Quora or CrunchBase, may be a good strategy. Those who become trusted authorities within their community are often rewarded with increased visibility of the content they share. C. Local Citation DirectoriesUsing local directories requires a shift in thinking for many webmasters, because it’s not always about the link, but about the citation. As David Mihm points out, the search engine’s local ranking algorithms work much differently than the search algorithms. For local SEO, search engines trust verifiable information from local portals such as Superpages and Judy’s Book. In most cases, if you are a verified business, gaining a citation from these sources is worth the effort and time. For more on local SEO directories, I highly recommend reading Mike Blumenthal and Andrew Shotland (and David Mihm, of course.) Directories = Diversity in Your Link ProfileJust as you shouldn’t rely solely on directory links, you shouldn’t ignore them either. The goal is a diverse and blended link profile. Many webmasters have abandoned directory links due to the bad reputation they have gained over the past years. In truth, the variety and quality of the directories available today offer unique opportunities to expand your SEO reach and diversify your link profile in future-proof ways. I encourage you to check out the new PRO Directory list, it's an awesome resource. That said, any SEO can take advantage of the tactics in this post. Even with a curated list, using Web directories takes time and research. There are no shortcuts in link building, but the effort is worth it. |
You are subscribed to email updates from SEOmoz Daily SEO Blog To stop receiving these emails, you may unsubscribe now. | Email delivery powered by Google |
Google Inc., 20 West Kinzie, Chicago IL USA 60610 |