* Posts by brambu

1 post • joined 17 Dec 2010

iPad media apps: Stealthed hobbits thwart Google's flaming Eye

brambu
Thumb Down

This article makes no sense.

Google respects a robots.txt file. Maybe the huffington post uses one for those elements of their website?

http://www.robotstxt.org/orig.html#code

Yeah, If I have a file called 'robots.txt' and it tells Google to go away, then Google will not index my site.

This isn't new.

SUBSCRIBE TO OUR WEEKLY TECH NEWSLETTER

Biting the hand that feeds IT © 1998–2021