Ever experienced this? You ask Google to look something up; the engine returns
with a number of finds, but if you try to open the ones with the most promising
content, you are confronted with a registration page instead, and the stuff you
were looking for will not be revealed to you unless you agree to a credit card
transaction first....
The lesson you should
have learned here is: Obviously Google can go where you can't.
Can we solve this
problem? Yes, we can. We merely have to convince the site we want to enter,
that WE ARE GOOGLE.
In fact, many sites
that force users to register or even pay in order to search and use their
content, leave a backdoor open for the Googlebot, because a prominent presence
in Google searches is known to generate sales leads, site hits and exposure.
Examples of such sites
are Windows Magazine, .Net Magazine, Nature, and many, many newspapers around
the globe.
How then, can you
disguise yourself as a Googlebot? Quite simple: by changing your browser's User
Agent. Copy the following code segment and paste it into a fresh notepad file.
Save it as Useragent.reg and merge it into your registry.
Windows Registry Editor
Version 5.00
[HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Windows\CurrentVersion\Internet
Settings\5.0\User Agent]
@="Googlebot/2.1"
"Compatible"="+http://www.googlebot.com/bot.html"
Voila! You're done!
You may always change
it back again.... I know only one site that uses you User Agent to establish
your eligability to use its services, and that's the Windows Update site...
To restore the IE6 User
Agent, save the following code to NormalAgent.reg and merge with your registry:
Windows Registry Editor
Version 5.00
[HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Windows\CurrentVersion\Internet
Settings\5.0\User Agent]
@="Mozilla/4.0
(compatible; MSIE 6.0; Windows NT 5.1)"
Ps:
Opera allows for
on-the-fly switching of User Agents through its "Browser
Identification" function, while for Mozilla/FireFox browsers a switching
utility is available as an installable extension from this url:
help://chrispederick.myacen.com/work/firefox/useragentswitcher/download/
Ever experienced this?
You ask Google to look something up; the engine returns with a number of finds,
but if you try to open the ones with the most promising content, you are
confronted with a registration page instead, and the stuff you were looking for
will not be revealed to you unless you agree to a credit card transaction
first....
The lesson you should
have learned here is: Obviously Google can go where you can't.
Can we solve this
problem? Yes, we can. We merely have to convince the site we want to enter,
that WE ARE GOOGLE.
In fact, many sites
that force users to register or even pay in order to search and use their
content, leave a backdoor open for the Googlebot, because a prominent presence
in Google searches is known to generate sales leads, site hits and exposure.
Examples of such sites
are Windows Magazine, .Net Magazine, Nature, and many, many newspapers around
the globe.
How then, can you
disguise yourself as a Googlebot? Quite simple: by changing your browser's User
Agent. Copy the following code segment and paste it into a fresh notepad file.
Save it as Useragent.reg and merge it into your registry.
Windows Registry Editor
Version 5.00
[HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Windows\CurrentVersion\Internet
Settings\5.0\User Agent]
@="Googlebot/2.1"
"Compatible"="+http://www.googlebot.com/bot.html"
Voila! You're done!
You may always change
it back again.... I know only one site that uses you User Agent to establish
your eligability to use its services, and that's the Windows Update site...
To restore the IE6 User
Agent, save the following code to NormalAgent.reg and merge with your registry:
Windows Registry Editor
Version 5.00
[HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Windows\CurrentVersion\Internet
Settings\5.0\User Agent]
@="Mozilla/4.0
(compatible; MSIE 6.0; Windows NT 5.1)"
Ps:
Opera allows for
on-the-fly switching of User Agents through its "Browser
Identification" function, while for Mozilla/FireFox browsers a switching
utility is available as an installable extension from this url:
help://chrispederick.myacen.com/work/firefox/useragentswitcher/download/