This is one of a series of posts in which I will be highlighting each member of the Search Bloggers list, with commentary on one of their posts (new or old). Look for this series to continue once or twice a week for the next couple of months.
Meet Pierre Far, the Search Blogger of the Day. Today I'd like to highlight a post called What Do You Do With Unauthenticated Search Engine Bots?. Pierre brings up some interesting thoughts about what to do with those pesky bots. He just blocks them, but he mentions that others will either ignore them or feed them bogus info, which could get them banned (if they are MFAs that are just scraping). What about you? Do you even deal with them at all? If so, do you do things differently? Why? Let's get this conversation going, because it's a good one. Go read Pierre's post, and then comment there.
If you want to know more about today's Search Blogger of the Day, check out Pierre's about page.
That's the Search Blogger of the Day. If you are a search blogger, and aren't on the list yet, go here to find out how to be included. I plan to promote everyone on the list in various ways. Some will be informative, and some will be just plain fun. Don't miss out.
Thanks for the mention Donna! I’ve been enjoying this series a lot and I’ve subscribed to a few new blogs because of it.
As for the bots, well I’d love to hear what others do. It’s an important topic and also a bit fun 🙂
Thats I good article but I’d like to see some examples of how he blocks them. Via htaccess? How do you set up the ban-by banning ips? I have scrappers grabbing the content from my site so I’d really like to block them.
I like the idea. But I don’t mind the scrapers because many black hatters are getting smarter and include a link back to my site. This ok with me since I want links 😉 The problem comes when they don’t include the link. However, with wordpress I simply ping Google and my post is indexed almost instantly so I don’t worry about it much since Google can detect original content.