wtf is a yahoo slurp spider. advanced note to stryder: I know what search engine spiders are, so just tell me in plain english, if you hit me with that nerdy techno gobledy gook i'm just gonna fall asleep anyway.
I started a cult in 4th or 5th grade where we worshipped a drainage pipe named "slurp." We showed our devotion by stuffing pieces of our lunch into it. Sacrifices.
That's about it. It's just a spider. Unless limited, they will be everywhere to capture everything about the site. I've heard of websites being brought down (almost like a DoS attack) because it sends so many.