Archive for the ‘Python’ Category

Prospective search using python

Wednesday, July 22nd, 2009

Prospective search, or persistent search, is a relatively less common method of implementing search where the list of keywords is defined, and when provided a single document it determines the list of keywords applicable to it. This is different from traditional (or "retrospective") search, where many documents are stored into an ...

Python script to detect bad bots/people faking as Googlebot

Saturday, March 28th, 2009

A script for analyzing my webservers access.log is long overdue here is a small start. Just recently I noticed a bad bot was attempting to scrape whole of my site using Googlebot's useragent. Since im learning python, I thought it might be a nice experience to write a simple script ...