Archive for March, 2009

Python script to detect bad bots/people faking as Googlebot

Saturday, March 28th, 2009

A script for analyzing my webservers access.log is long overdue here is a small start. Just recently I noticed a bad bot was attempting to scrape whole of my site using Googlebot's useragent. Since im learning python, I thought it might be a nice experience to write a simple script ...