Accidental Noindexation Recovery Strategy and Results

---

Accidental Noindexation Recovery Strategy and Results Posted: 28 Sep 2011 04:16 AM PDT Posted by chadburgess This post was originally in YOUmoz, and was promoted to the main blog because it provides great value and interest to our community. The author's views are entirely his or her own and may not reflect the views of SEOmoz, Inc. "I know before the cards are even turned over..." - Mike McDermott, Rounders When Mike McD was called by Teddy KGB in a huge No-Limit Hold'em poker pot, he didn't have to see his opponents hand to know that KGB had two aces, the only hand in the deck that could beat his nines full of aces (if you have seen Rounders, feel free to skip over the video below, if not, you probably should get on that). This was the same feeling I had when we got "SERP a DERPd" via accidental noindexation of 9,000 of our most important pages....   Contents: What happens when pages are accidentally noindexed Tactics for getting pages into the Google index quickly How noindex impacts SERP rankings (note that I am focusing on Google in this post)  Background: I am an in-house SEO and customer acquisition marketer at SeatGeek.com, a NYC tech startup. Our site is a ticket search engine for sports concerts and theater tickets (i.e. "a Kayak for event tickets"). On Monday 8/1, I was searching Google for 'mets tickets' and saw that SeatGeek had slipped from page 1. Worse, we weren't even on page 2. I tried a few more queries that I knew we should be on page 1 for and still nothing. My heart was beating. Had we been Panda'd? It didn't make sense, but I was panicked. Then it hit me. I opened up our New York Mets page, but, just like Mike Mcd, I knew before I even clicked view source...content="noindex" on all of our product pages. I have only been doing SEO for ~2 years, so I had never directly experienced an accidental noindex situation. So even as I read reports of these not having an impact on rankings and knew this wasn't as bad as an accidental canonicalization problem, I couldn't help but envision the worst case scenario...9,000 of our most important conversion driving pages would be out of the index for weeks and would not have their same rank when they got back in.  What happens when pages are accidentally noindexed This is a chart of incoming organic traffic to one of our key pages right when the noindex hit. Obviously organic traffic ceased to exist. Interestingly though, Google Analytics still reported some traffic to these pages. This might be the one instance where having less frequent crawl frequency can be beneficial (assuming bandwidth isn't an issue). The pages that got noindexed are recrawled every 4-6 days, which would have given us a buffer if we caught this sooner. Unfortunately, Google waited until Saturday to crawl these pages and we didn't catch the problem until Monday.  Reindexation Plan and Tactics: The first course of action was to remove the noindex tags, which one of our pop star engineers did within five minutes. This was right around the time I sent out my first plan of action email which I have included below in case you ever have to write the same email:  All, So I was doing a daily scan of SERP positions and started noticing team band pages had dropped. At first I thought we got Panda'd, but it looks like the noindex tags that are supposed to be applied to search pages and filtered navigation recently got pushed into production, but because those pages only get reindexed every 3-6 days there was some delay in the traffic impact, which you can see if you filter by team/band pages. We are currently: Noindex already removed in production Writing blog posts that link to all major sports teams to get these reindexed (more difficult for bands) Launching social media campaigns to support this cause Forcing update on .xml sitemap (hopefully to help with concerts issue) Investigating additional techniques Going to look into the current traffic impact / which pages got impacted the most (hopefully some deeper artist type pages never got recrawled before the fix) http://www.webmasterworld.com/webmaster/3601620.htm Here's to hoping this is true "My experience is that "noindex" is quite harmless when it comes to ranking. As soon as you change it to "index", the pages should pop up at nearly the same positions in the SERPs as where they were." I will keep you all posted. -Chad  Even if rankings would come back, we wanted this to happen as quickly as possible. I had a plan, and fortunately some great interns to help me out. So this is what we did (excuse any repetition from the email)... Removed noindex tags We ran social giveaways and campaigns generating strategic social shares Internally, we set up a Google doc with our most important product pages as rows, and everyone's names as columns and had people +1 and Tweet various pages from the list, checking off as we worked through it (read more from Rand about the power of social shares for SEO) Wrote / published blog content that linked off to all the pages that had been removed from the index Examples of the previous bulletpoint: NFL 2011-12 Season: Average Ticket Prices, Weekly MLB Price Rankings, A Sneak Peek at NBA Ticket Prices, First Look at NHL Prices and 3473 Artists Ranked By SeatGeek's Popularity Score (yes I know Google doesn't go beyond ~+100 links per page...) Used our relationships with NY Daily News and Business Insider to get some content up linking back to our most important pages Resubmitted our XML sitemap index file via Google Webmaster Tools Manually submitted select pages via Google Webmaster tools 'Submit to index' feature All of the above was completed within one hour of us discovering the issue, except for the guest posts and contest which were done over the next 1-2 days. And then we waited...  Reindexation Metrics: It took 1-2 days for our most important pages to get back into the index, which we were really happy with. Some of our deeper / less important pages took up to 5 days to come back or longer in some cases. Fortunately we had followed advice from other Mozzers and introduced multiple XML sitemaps earlier in the year with all our product pages in one XML sitemap we were able to easily track indexation of these pages via Google Webmaster Tools. Indexation and traffic were on their way back up by the next day, but as you can tell from the graph below traffic didn't return to previous levels to about 2-3 days from when the noindex tag was removed.   Rankings Impact of Noindexation: Now let's look at how this impacted our SERP rankings. The example above, was a truly interesting case because our Mets page returned to the index the night of the fix and I emailed my bosses to check it out as a good example of a recovering page, but by the time we got into work the next morning it had left the index again and I looked like a clown shoe. Fortunately, the page came back (again...) into the index the next day and was back up to its previous ranking by the end of the week. This is an example of a trend I noticed that many pages would come back into the index first and then return to ranking for their target terms a day or so later. The example below is one where we returned to the index but without the same rank as we had before. There isn't really a way to tell if this was impacted at all by the noindex situation, I suspect it was just a random Google dance related to the more frequent shakeups I have seen in event "tickets" related queries. Overall, our page 1 SERP positions have completely returned to prior levels. Conclusions: If you accidentally noindex pages on your site, of course they will stop getting traffic from organic search, but this will be dependent on the crawl rate of the pages (in our case it took ~5 days for them to drop out of the index) and 2-3 days for them to return to normal levels If you have a blog that gets crawled quickly, use that as a tool to help drive spiders back to the pages that were noindexed with strategic internal linking (of course wait until you have removed the noindex tag) Take advantage of friends & family to help with social shares and pump this up with a social giveaway Use Google Webmaster tools: 1) XML sitemap resubmit 2. Manual 'Submit to Index' 3. Sitemap indexation tracking You should have Multiple XML sitemaps set up into logical buckets for indexation tracking to faciliate the indexation tracking mentioned above Although your rankings might see short-term "dancing", an accidental noindex will not have a negative impact on them Lastly, don't be too worried, just follow some of the tactics above and you should be back in the index with the same rankings (have your boss email me if they are giving you crap - chad@seatgeek.com) Ok so that was probably too much information for just an accidental noindex situation, but when it happened to me it was scary and there wasn't a solid documentation on what to expect, so I wanted to produce this for the next person in my situation. Thanks for reading. Connect with me on Twitter if you are so inclined. Do you like this post? Yes No

Conquer Link Directory Best Practices for SEO Posted: 27 Sep 2011 02:11 PM PDT Posted by Cyrus Shepard Good news to all you link builders out there. SEOmoz just updated the PRO SEO Web Directory List. The long overdue update includes over 400 directories (up from 180) separated into three categories – Web, Local and Social. Wait, aren’t link directories dead? The practice of obtaining links from online directories has changed dramatically over the past 10 years. The stereotypes of the past are both true and dangerous. Spammy, low quality directories flood the lower cesspools of the Internet. An unbridled strategy of obtaining links from these non-discriminate directories can actually hurt your SEO. But times have changed, and strategies have become more evolved. Rethinking Directories We can move beyond thinking about directories as nothing more than paid links. For webmasters who use this approach, the links they obtain may not be worth the effort. An intelligent directory strategy provides depth to your SEO campaigns and offers tangible benefits including: A more diverse link profile Qualified referral traffic Citations for different vertical ranking algorithms Trust/Authority Signals … and, of course, the link. If you use different directories for different purposes, you can achieve this and more. A. Web Directories If links were easy for everyone, they would be less valuable for all of us. In general, the lower the bar of entry into any directory, the less inclusion into that directory is valued by the search engines. Some editorial directories raise the bar by charging a high cost of inclusion (Yahoo, Best of the Web) and being somewhat selective about whom they include. Three hundred dollars is a lot to pay for “inclusion review” but the truth is that for an established business, these links are like bread and butter. Other directories focus on a particular area, and thus are harder to get into. Examples of these “niche” directories include sites such as: Designflavr – CSS / Design Gallery Chart Porn – Infographics Blog Listing – Blog Directory Engineers Edge – Professional Directory Donations 4 Charity – Charities When pursuing directory links, keep the following tips in mind: Not every directory link is right for your site. Be selective and don't go for every link out there. Pace yourself. A good hint I got from Ian Lurie's Fat Free Guide is the 2:1 rule: for every two directory links you build, make sure to build one genuinely natural link. This helps to keep your link profile looking “natural”. Research. Understand where your link will be placed before you go after it. Check Google’s cache of the page to make sure they are indexing it. Large directories are often plagued by bad SEO, and not every link carries the weight it should. Seek relevancy. Ask yourself if this link has the potential to send qualified traffic to your site. Even if it's a small amount of traffic, it's probably worth the effort. I’d often rather have a hard-to-get link from a smaller niche site that an easy-to-get link from a larger well-known directory. B. Social Directories We know that the rise of Social SEO means sharing your content on sites like Facebook and Twitter can have a positive impact on your site’s traffic. But far too many people limit sharing to the big three (Twitter, Facebook and Google+) without considering other social sharing sites. The plethora of specialized social sites offer several benefits. 1. Member Profiles – Here’s a random profile from Mister Wong, a social bookmarking site. (thank you rgonzalo!) Mr. rgonzalo appears to be an authority on the site. Any content he shares will carry weight with the Mister Wong audience. 2. Content Publishing – Instead of a single website listing, social sites allow you to promote individual pieces of content. Using the above example, whenever Rgonzolo shares a URL, that content is likely linked to and noticed by search engines. 3. Increased participation increases visibility. You probably can’t participate in every social site out there. For web marketers, focusing on a few sites where you can devote your time, like Quora or CrunchBase, may be a good strategy. Those who become trusted authorities within their community are often rewarded with increased visibility of the content they share. C. Local Citation Directories Using local directories requires a shift in thinking for many webmasters, because it’s not always about the link, but about the citation. As David Mihm points out, the search engine’s local ranking algorithms work much differently than the search algorithms. For local SEO, search engines trust verifiable information from local portals such as Superpages and Judy’s Book. In most cases, if you are a verified business, gaining a citation from these sources is worth the effort and time. For more on local SEO directories, I highly recommend reading Mike Blumenthal and Andrew Shotland (and David Mihm, of course.) Directories = Diversity in Your Link Profile Just as you shouldn’t rely solely on directory links, you shouldn’t ignore them either. The goal is a diverse and blended link profile. Many webmasters have abandoned directory links due to the bad reputation they have gained over the past years. In truth, the variety and quality of the directories available today offer unique opportunities to expand your SEO reach and diversify your link profile in future-proof ways. I encourage you to check out the new PRO Directory list, it's an awesome resource. That said, any SEO can take advantage of the tactics in this post. Even with a curated list, using Web directories takes time and research. There are no shortcuts in link building, but the effort is worth it. Do you like this post? Yes No

You are subscribed to email updates from SEOmoz Daily SEO Blog To stop receiving these emails, you may unsubscribe now.	Email delivery powered by Google
Google Inc., 20 West Kinzie, Chicago IL USA 60610