Content Barriers: Understanding and Directing the Crawlers Part 4

February 01, 2010  |   Content,Internal Architecture,Maximus   |   0 Comment

Welcome to part 4 of the Understanding & Directing the Crawlers series. We’re going to discuss content barriers, which are entities on a website that restrict the spiders from properly crawling that specific content.  Although there are a ton of content barriers, here are the most common ones to give you a better idea:

  • Forms: Crawlers cannot interact with forms. 
  • Flash/AJAX: Crawlers cannot read any content that shows up in flash presentations.   
  • JavaScript: Crawlers won’t run code snippets.  FYI, javascript is a computer programming language that connects to a server from an internet browser to download pages.
  • Images: Crawlers generally can’t “read” a picture.  Most websites have banners at the top with the name of their company.  Just because you have a banner that says your website in big bold letters doesn’t mean that the crawlers see your company name.

So let’s take a look at how to correct these problems or find alternatives to find SEO benefit:

  • Forms: If desirable content lives behind it, provide another way for the crawler to navigate there.
  • Flash/AJAX: Other web application frameworks can be utilized here such as .aspx, .asp, .php, .cfm, etc.
  • JavaScript: Make sure your links don’t require code to work.
  • Images: Graphical menus should have text alt tags or CSS versions of links. Also avoid writing actual content into images

Hope this helps!  Stay tuned for more SEO tips!





About the author


Maximus Kang is the Director of SEO Strategy & Founder of Ranking Channel, a Seattle-based SEO consulting agency. With enterprise level experience at Expedia and agency experience at Optify, his SEO knowledge covers a wide spectrum. He also started his very . Follow him on Twitter or connect with him on Facebook.

New to SEO? You can learn How to Win Users & Influence Google.