Jan 21 2010

How to get Google to Access Password Protected Pages


Filed under: Search Marketing » Analytics, Technology » Google,
Tools:
Tweet This

Can Google Access Pages That Require a Login?

Google Analytics, yes; the Googlebot that indexes your pages so users can find them when they search Google? No, or at least, not yet. At some point, Google might provide the functionality for you to enter login credentials that its bot will then use to crawl and index your password protected pages. But for now, there is no way to get the Googlebot (which crawls and indexes your pages according to your sitemap file), to access your password protected pages. Still, there is a way to get search engine credit for your pages while still requiring users to enter a password to access your premium content.

Organizing Your Public and Premium Content

The answer to this dilemma is to provide some content for free, and for the rest, require a login. This way, users will find your free articles that are indexed in the SERPs (Search Engine Results Pages), and if they like them, they are more likely to subscribe to your premium, or password protected, content.

Another approach is to offer a teaser of each article for free, and then instead of providing a read more link to the rest of the article, provide a link to your login-protected page that contains the full article. This way, your free teasers get indexed, users get an idea of what the article is about, and if they want to keep reading, they can pay for the rest of the article.

While this example seems tailored to an article-based site, you can easily apply it to any premium content. Let's say you are operating a racing site, and you have sporting events that require registration. You can offer the description of the event for free, and then link to a registration page that is password protected.

How Does this Apply to Analytics?

Unlike the Googlebot, which needs access to crawl your pages, Analytics works on behalf of your users. That means, once your users login and access a password protected page, the Analytics script will execute and Google will receive the tracking data necessary to track and analyze your visitor's behavior.

Hopefully this article has given you some idea of how you can leverage your free content to gain more search engine traffic while at the same time adding incentive and value to your premium content and increasing your subscriber base.

Average: 5 (1 vote)
Select your preferred way to display the comments and click "Save settings" to activate your changes.

Google Analytics password

I find that I use Analytics ability to access password protected pages quite a bit. It's useful getting stats on my member pages, which on some of my websites are the primary drivers for traffic.

I would also have to agree with the previous commenter that having a search engine spider (ie. GoogleBot) access password protected pages defeats the purpose of having a password to begin with. If you don't want the "public" (ie. those conducting searches in the search engines) to access your page, then there's no reason for wanting the search engines to have access to it and index it for others to find.

Why would Google want to?

Actually, let me rephrase that - why would you want Google to access your password protected content? I figure it's password-protected for a reason, correct? If Google were to access it, it would effectively become public, thereby defeating the point of requiring a password to begin with. Or am I missing something?

  • Allowed HTML tags: <a> <em> <strong> <cite> <ul> <ol> <li> <dl> <dt> <dd><u>
  • Lines and paragraphs break automatically.
  • Textual smileys will be replaced with graphical ones.

More information about formatting options

CAPTCHA
This question is for testing whether you are a human visitor and to prevent automated spam submissions.