taking a peek into google's robot???

Bumped across Google's own robots.txt, while on a search Url Exclusionurl exclusion robot.

An interesting find.
you should explore the contents... may be, just may be, you'd get to find some interesting tidbits you'd not known earlier.

:: sivaramasundar