I’ve got ‘bots crawling all over me and they’re leaving some nasty slime.

I was trying to discover how the guy who commented on the Ft. Worth zoo got to my site so I took at look at my referrers for Friday.  Expression Engine has a blacklist that you can download from their central servers to keep out most referrer spam, but they still show up in the raw logs.  There is some nasty stuff in there (this is the output of a script that breaks up the Apache logs and shows only external referrals (e.g. removes any internal referrals from one page to another within the site)):


“http://sexnotes.net/handjob-galleries.php” ==> /index.php?/orglog/C24/
“http://sexnotes.net/handjob-pics.php” ==> /index.php?/orglog/C24/
“http://sexnotes.net/handjob-mpeg.php” ==> /index.php?/orglog/C24/
“http://sexnotes.net/hetero-handjobs.php” ==> /index.php?/orglog/C24/
“http://sexnotes.net/handjob-videos.php” ==> /index.php?/orglog/C24/
“http://sexnotes.net/handjob-movies.php” ==> /index.php?/orglog/C24/
“http://sexnotes.net/handjobs.php” ==> /index.php?/orglog/C24/
“http://sexnotes.net/russian-femdom.php” ==> /index.php?/orglog/C24/
“http://12.163.72.13/” ==> /index.php?/orglog/comments/542/
“http://books.livenet.pl” ==> /
“http://12.163.72.13/” ==> /index.php?/orglog/trackbacks/841/
“http://search.yahoo.com/search?p=gun+show+dfw&fr=FP-tab-web-t&toggle=1&ei=UTF-8” ==> /gunshows
“http://search.yahoo.com/search?p=gun+show+dfw&fr=FP-tab-web-t&toggle=1&ei=UTF-8” ==> /gunshows/
“http://www.google.com/search?hl=en&lr=&q=kimber+armory” ==> /armory/index.php?/armory/gun_entry/kimber_ultra_cdp_ii/
“http://www.google.com/ie?q=dallas+gun+show&hl=en&lr=” ==> /gunshows/
“http://drugsbook.com/vigrx.php” ==> /index.php?/orglog/C24/
“http://drugsbook.com/vigorelle.php” ==> /index.php?/orglog/C24/
“http://drugsbook.com/vigrx-oil.php” ==> /index.php?/orglog/C24/
“http://bontril.allwords.info” ==> /index.php?/orglog/C24/
“http://bontril.allwords.info/bontril-35mg.php” ==> /index.php?/orglog/C24/
“http://bontril.allwords.info/bontril-35mg.php” ==> /index.php?/orglog/C24/
“http://bontril.allwords.info/buy-bontril.php” ==> /index.php?/orglog/C24/
“http://bontril.allwords.info/buy-bontril.php” ==> /index.php?/orglog/C24/


Most of those didn’t get through, but some of them did because I hadn’t updated the blacklist in a while.  Of the 4182 referrers on Friday, 1315 were from “sexnotes.net”, 1351 were from “allwords.info”, and 676 were from “drugsbook.com.”  In fact, a quick scan of the logs shows only about 300 valid referrers (Google searches, weblog referrers, etc). 

But then my problems are small compared to what Little Green Footballs has to deal with.