MediaWiki talk:Titleblacklist

From OpenSimulator

(Difference between revisions)
Jump to: navigation, search
(hopefully-helpful info)
 
Line 3: Line 3:
  
 
These Bitcoin buffoons are seriously in need of some med's, legal or otherwise.
 
These Bitcoin buffoons are seriously in need of some med's, legal or otherwise.
 +
 +
EDIT:
 +
Another option to consider, not only to protect the wiki and all of OpenSimulator.org would be to update Apache Server and mod the httpd.conf  and reflect it in .htaccess    There are major lists of "Bad Bots" which you can further add in here but the material here is a darned good start to blocking the trashers & spammers as well as getting rid of the scrapers which can seriously slow down the website & server response times.
 +
 +
<code>
 +
    #  --- LINE 237 in apache\conf\httpd.conf
 +
    # Controls who can get stuff from this server.
 +
    #
 +
    Order allow,deny
 +
    Allow from all
 +
    #
 +
    # Good Bots
 +
    SetEnvIfNoCase User-Agent .*google.* search_robot
 +
    SetEnvIfNoCase User-Agent .*yahoo.* search_robot
 +
    # SetEnvIfNoCase User-Agent .*bot.* search_robot
 +
    SetEnvIfNoCase User-Agent .*ask.* search_robot
 +
    #
 +
    # Nasty IP's that hit us looking for things they shouldn't
 +
    Deny from 188.40.231.165
 +
    Deny from 50.22.21.218
 +
    Deny from 66.135.49.5
 +
    Deny from 60.231.215.42
 +
    Deny from 220.181.108.123
 +
    #
 +
    # BAD BOTS added by WS as they changed a little
 +
    SetEnvIfNoCase User-Agent ^$ bad_bot
 +
    SetEnvIfNoCase User-Agent "^Baiduspider+" bad_bot
 +
    SetEnvIfNoCase User-Agent "^Yandex" bad_bot
 +
    SetEnvIfNoCase User-Agent "^Exabot" bad_bot
 +
    SetEnvIfNoCase User-Agent "^Cityreview" bad_bot
 +
    SetEnvIfNoCase User-Agent "^Dotbot" bad_bot
 +
    SetEnvIfNoCase User-Agent "^Sogou" bad_bot
 +
    SetEnvIfNoCase User-Agent "^Sosospider" bad_bot
 +
    SetEnvIfNoCase User-Agent "^Twiceler" bad_bot
 +
    SetEnvIfNoCase User-Agent "Python-urllib/2.4" bad_bot
 +
    SetEnvIfNoCase User-Agent "^whitehat" bad_bot
 +
    SetEnvIfNoCase User-Agent "^BitKinex" bad_bot
 +
    SetEnvIfNoCase User-Agent "^w00tw00t^" bad_bot
 +
    SetEnvIfNoCase User-Agent "^ZmEu" bad_bot
 +
    SetEnvIfNoCase User-Agent "ZmEu" bad_bot
 +
    SetEnvIfNoCase User-Agent "Morfeus" bad_bot
 +
    #
 +
    # this ruleset is for unwanted useragents... possibly email harvesters
 +
    SetEnvIfNoCase User-Agent "^AESOP_com_SpiderMan" bad_bot
 +
    SetEnvIfNoCase User-Agent "^Alexibot" bad_bot
 +
    SetEnvIfNoCase User-Agent "Anonymouse.org" bad_bot
 +
    SetEnvIfNoCase User-Agent "^asterias" bad_bot
 +
    SetEnvIfNoCase User-Agent "^attach" bad_bot
 +
    SetEnvIfNoCase User-Agent "^BackDoorBot" bad_bot
 +
    SetEnvIfNoCase User-Agent "^BackWeb" bad_bot
 +
    SetEnvIfNoCase User-Agent "Bandit" bad_bot
 +
    SetEnvIfNoCase User-Agent "^Baiduspider" bad_bot
 +
    SetEnvIfNoCase User-Agent "^BatchFTP" bad_bot
 +
    SetEnvIfNoCase User-Agent "^Bigfoot" bad_bot
 +
    SetEnvIfNoCase User-Agent "^Black.Hole" bad_bot
 +
    SetEnvIfNoCase User-Agent "^BlackWidow" bad_bot
 +
    SetEnvIfNoCase User-Agent "^BlowFish" bad_bot
 +
    SetEnvIfNoCase User-Agent "^Bot\ mailto:craftbot@yahoo.com" bad_bot
 +
    SetEnvIfNoCase User-Agent "^BotALot" bad_bot
 +
    SetEnvIfNoCase User-Agent "Buddy" bad_bot
 +
    SetEnvIfNoCase User-Agent "^BuiltBotTough" bad_bot
 +
    SetEnvIfNoCase User-Agent "^Bullseye" bad_bot
 +
    SetEnvIfNoCase User-Agent "^BunnySlippers" bad_bot
 +
    SetEnvIfNoCase User-Agent "^Cegbfeieh" bad_bot
 +
    SetEnvIfNoCase User-Agent "^CheeseBot" bad_bot
 +
    SetEnvIfNoCase User-Agent "^CherryPicker" bad_bot
 +
    SetEnvIfNoCase User-Agent "^ChinaClaw" bad_bot
 +
    SetEnvIfNoCase User-Agent "Collector" bad_bot
 +
    SetEnvIfNoCase User-Agent "Copier" bad_bot
 +
    SetEnvIfNoCase User-Agent "^CopyRightCheck" bad_bot
 +
    SetEnvIfNoCase User-Agent "^cosmos" bad_bot
 +
    SetEnvIfNoCase User-Agent "^Crescent" bad_bot
 +
    SetEnvIfNoCase User-Agent "^Curl" bad_bot
 +
    SetEnvIfNoCase User-Agent "^Custo" bad_bot
 +
    SetEnvIfNoCase User-Agent "^DA" bad_bot
 +
    SetEnvIfNoCase User-Agent "^DISCo" bad_bot
 +
    SetEnvIfNoCase User-Agent "^DIIbot" bad_bot
 +
    SetEnvIfNoCase User-Agent "^DittoSpyder" bad_bot
 +
    SetEnvIfNoCase User-Agent "^Download" bad_bot
 +
    SetEnvIfNoCase User-Agent "^Download\ Demon" bad_bot
 +
    SetEnvIfNoCase User-Agent "^Download\ Devil" bad_bot
 +
    SetEnvIfNoCase User-Agent "^Download\ Wonder" bad_bot
 +
    SetEnvIfNoCase User-Agent "Downloader" bad_bot
 +
    SetEnvIfNoCase User-Agent "^dragonfly" bad_bot
 +
    SetEnvIfNoCase User-Agent "^Drip" bad_bot
 +
    SetEnvIfNoCase User-Agent "^eCatch" bad_bot
 +
    SetEnvIfNoCase User-Agent "^EasyDL" bad_bot
 +
    SetEnvIfNoCase User-Agent "^ebingbong" bad_bot
 +
    SetEnvIfNoCase User-Agent "^EirGrabber" bad_bot
 +
    SetEnvIfNoCase User-Agent "^EmailCollector" bad_bot
 +
    SetEnvIfNoCase User-Agent "^EmailSiphon" bad_bot
 +
    SetEnvIfNoCase User-Agent "^EmailWolf" bad_bot
 +
    SetEnvIfNoCase User-Agent "^EroCrawler" bad_bot
 +
    SetEnvIfNoCase User-Agent "^Exabot" bad_bot
 +
    SetEnvIfNoCase User-Agent "^Express\ WebPictures" bad_bot
 +
    SetEnvIfNoCase User-Agent "Extractor" bad_bot
 +
    SetEnvIfNoCase User-Agent "^EyeNetIE" bad_bot
 +
    SetEnvIfNoCase User-Agent "^FileHound" bad_bot
 +
    SetEnvIfNoCase User-Agent "^FlashGet" bad_bot
 +
    SetEnvIfNoCase User-Agent "^Foobot" bad_bot
 +
    SetEnvIfNoCase User-Agent "^flunky" bad_bot
 +
    SetEnvIfNoCase User-Agent "^FrontPage" bad_bot
 +
    SetEnvIfNoCase User-Agent "^GetRight" bad_bot
 +
    SetEnvIfNoCase User-Agent "^GetSmart" bad_bot
 +
    SetEnvIfNoCase User-Agent "^GetWeb!" bad_bot
 +
    SetEnvIfNoCase User-Agent "^Go!Zilla" bad_bot
 +
    SetEnvIfNoCase User-Agent "Google\ Wireless\ Transcoder" bad_bot
 +
    SetEnvIfNoCase User-Agent "^Go-Ahead-Got-It" bad_bot
 +
    SetEnvIfNoCase User-Agent "^gotit" bad_bot
 +
    SetEnvIfNoCase User-Agent "Grabber" bad_bot
 +
    SetEnvIfNoCase User-Agent "^GrabNet" bad_bot
 +
    SetEnvIfNoCase User-Agent "^Grafula" bad_bot
 +
    SetEnvIfNoCase User-Agent "^Harvest" bad_bot
 +
    SetEnvIfNoCase User-Agent "^hloader" bad_bot
 +
    SetEnvIfNoCase User-Agent "^HMView" bad_bot
 +
    SetEnvIfNoCase User-Agent "^httplib" bad_bot
 +
    SetEnvIfNoCase User-Agent "^HTTrack" bad_bot
 +
    SetEnvIfNoCase User-Agent "^humanlinks" bad_bot
 +
    SetEnvIfNoCase User-Agent "^ia_archiver" bad_bot
 +
    SetEnvIfNoCase User-Agent "^IlseBot" bad_bot
 +
    SetEnvIfNoCase User-Agent "^Image\ Stripper" bad_bot
 +
    SetEnvIfNoCase User-Agent "^Image\ Sucker" bad_bot
 +
    SetEnvIfNoCase User-Agent "Indy\ Library" bad_bot
 +
    SetEnvIfNoCase User-Agent "^InfoNaviRobot" bad_bot
 +
    SetEnvIfNoCase User-Agent "^InfoTekies" bad_bot
 +
    SetEnvIfNoCase User-Agent "^Intelliseek" bad_bot
 +
    SetEnvIfNoCase User-Agent "^InterGET" bad_bot
 +
    SetEnvIfNoCase User-Agent "^Internet\ Ninja" bad_bot
 +
    SetEnvIfNoCase User-Agent "^Iria" bad_bot
 +
    SetEnvIfNoCase User-Agent "^Jakarta" bad_bot
 +
    SetEnvIfNoCase User-Agent "^JennyBot" bad_bot
 +
    SetEnvIfNoCase User-Agent "^JetCar" bad_bot
 +
    SetEnvIfNoCase User-Agent "^JOC" bad_bot
 +
    SetEnvIfNoCase User-Agent "^JustView" bad_bot
 +
    SetEnvIfNoCase User-Agent "^Jyxobot" bad_bot
 +
    SetEnvIfNoCase User-Agent "^Kenjin.Spider" bad_bot
 +
    SetEnvIfNoCase User-Agent "^Keyword.Density" bad_bot
 +
    SetEnvIfNoCase User-Agent "^larbin" bad_bot
 +
    SetEnvIfNoCase User-Agent "^LeechFTP" bad_bot
 +
    SetEnvIfNoCase User-Agent "^LexiBot" bad_bot
 +
    SetEnvIfNoCase User-Agent "^lftp" bad_bot
 +
    SetEnvIfNoCase User-Agent "^libWeb/clsHTTP" bad_bot
 +
    SetEnvIfNoCase User-Agent "^likse" bad_bot
 +
    SetEnvIfNoCase User-Agent "^LinkextractorPro" bad_bot
 +
    SetEnvIfNoCase User-Agent "^LinkScan/8.1a.Unix" bad_bo
 +
    SetEnvIfNoCase User-Agent "^LNSpiderguy" bad_bott
 +
    SetEnvIfNoCase User-Agent "^LinkWalker" bad_bot
 +
    SetEnvIfNoCase User-Agent "^lwp-trivial" bad_bot
 +
    SetEnvIfNoCase User-Agent "^LWP::Simple" bad_bot
 +
    SetEnvIfNoCase User-Agent "^Magnet" bad_bot
 +
    SetEnvIfNoCase User-Agent "^Mag-Net" bad_bot
 +
    SetEnvIfNoCase User-Agent "^MarkWatch" bad_bot
 +
    SetEnvIfNoCase User-Agent "^Mass\ Downloader" bad_bot
 +
    SetEnvIfNoCase User-Agent "^Mata.Hari" bad_bot
 +
    SetEnvIfNoCase User-Agent "^Memo" bad_bot
 +
    SetEnvIfNoCase User-Agent "^Microsoft.URL" bad_bot
 +
    SetEnvIfNoCase User-Agent "^Microsoft\ URL\ Control" bad_bot
 +
    SetEnvIfNoCase User-Agent "^MIDown\ tool" bad_bot
 +
    SetEnvIfNoCase User-Agent "^MIIxpc" bad_bot
 +
    SetEnvIfNoCase User-Agent "^Mirror" bad_bot
 +
    SetEnvIfNoCase User-Agent "^Missigua\ Locator" bad_bot
 +
    SetEnvIfNoCase User-Agent "^Mister\ PiX" bad_bot
 +
    SetEnvIfNoCase User-Agent "^moget" bad_bot
 +
    SetEnvIfNoCase User-Agent "^Mozilla/3.Mozilla/2.01" bad_bot
 +
    SetEnvIfNoCase User-Agent "^Mozilla.*NEWT" bad_bot
 +
    SetEnvIfNoCase User-Agent "^NAMEPROTECT" bad_bot
 +
    SetEnvIfNoCase User-Agent "^Navroad" bad_bot
 +
    SetEnvIfNoCase User-Agent "^NearSite" bad_bot
 +
    SetEnvIfNoCase User-Agent "^NetAnts" bad_bot
 +
    SetEnvIfNoCase User-Agent "^Netcraft" bad_bot
 +
    SetEnvIfNoCase User-Agent "^NetMechanic" bad_bot
 +
    SetEnvIfNoCase User-Agent "^NetSpider" bad_bot
 +
    SetEnvIfNoCase User-Agent "^Net\ Vampire" bad_bot
 +
    SetEnvIfNoCase User-Agent "^NetZIP" bad_bot
 +
    SetEnvIfNoCase User-Agent "^NextGenSearchBot" bad_bot
 +
    SetEnvIfNoCase User-Agent "^NG" bad_bot
 +
    SetEnvIfNoCase User-Agent "^NICErsPRO" bad_bot
 +
    SetEnvIfNoCase User-Agent "^NimbleCrawler" bad_bot
 +
    SetEnvIfNoCase User-Agent "^Ninja" bad_bot
 +
    SetEnvIfNoCase User-Agent "^NPbot" bad_bot
 +
    SetEnvIfNoCase User-Agent "^Octopus" bad_bot
 +
    SetEnvIfNoCase User-Agent "^Offline\ Explorer" bad_bot
 +
    SetEnvIfNoCase User-Agent "^Offline\ Navigator" bad_bot
 +
    SetEnvIfNoCase User-Agent "^Openfind" bad_bot
 +
    SetEnvIfNoCase User-Agent "^OutfoxBot" bad_bot
 +
    SetEnvIfNoCase User-Agent "^PageGrabber" bad_bot
 +
    SetEnvIfNoCase User-Agent "^Papa\ Foto" bad_bot
 +
    SetEnvIfNoCase User-Agent "^pavuk" bad_bot
 +
    SetEnvIfNoCase User-Agent "^pcBrowser" bad_bot
 +
    SetEnvIfNoCase User-Agent "^PHP\ version\ tracker" bad_bot
 +
    SetEnvIfNoCase User-Agent "^Pockey" bad_bot
 +
    SetEnvIfNoCase User-Agent "^ProPowerBot/2.14" bad_bot
 +
    SetEnvIfNoCase User-Agent "^ProWebWalker" bad_bot
 +
    SetEnvIfNoCase User-Agent "^psbot" bad_bot
 +
    SetEnvIfNoCase User-Agent "^Pump" bad_bot
 +
    SetEnvIfNoCase User-Agent "^QueryN.Metasearch" bad_bot
 +
    SetEnvIfNoCase User-Agent "^RealDownload" bad_bot
 +
    SetEnvIfNoCase User-Agent "Reaper" bad_bot
 +
    SetEnvIfNoCase User-Agent "Recorder" bad_bot
 +
    SetEnvIfNoCase User-Agent "^ReGet" bad_bot
 +
    SetEnvIfNoCase User-Agent "^RepoMonkey" bad_bot
 +
    SetEnvIfNoCase User-Agent "^RMA" bad_bot
 +
    SetEnvIfNoCase User-Agent "Siphon" bad_bot
 +
    SetEnvIfNoCase User-Agent "sitecheck.internetseer.com" bad_bot
 +
    SetEnvIfNoCase User-Agent "^SiteSnagger" bad_bot
 +
    SetEnvIfNoCase User-Agent "^SlySearch" bad_bot
 +
    SetEnvIfNoCase User-Agent "^SmartDownload" bad_bot
 +
    SetEnvIfNoCase User-Agent "^Snake" bad_bot
 +
    SetEnvIfNoCase User-Agent "^Snapbot" bad_bot
 +
    SetEnvIfNoCase User-Agent "^Snoopy" bad_bot
 +
    SetEnvIfNoCase User-Agent "^sogou" bad_bot
 +
    SetEnvIfNoCase User-Agent "^SpaceBison" bad_bot
 +
    SetEnvIfNoCase User-Agent "^SpankBot" bad_bot
 +
    SetEnvIfNoCase User-Agent "^spanner" bad_bot
 +
    SetEnvIfNoCase User-Agent "^Sqworm" bad_bot
 +
    SetEnvIfNoCase User-Agent "Stripper" bad_bot
 +
    SetEnvIfNoCase User-Agent "Sucker" bad_bot
 +
    SetEnvIfNoCase User-Agent "^SuperBot" bad_bot
 +
    SetEnvIfNoCase User-Agent "^SuperHTTP" bad_bot
 +
    SetEnvIfNoCase User-Agent "^Surfbot" bad_bot
 +
    SetEnvIfNoCase User-Agent "^suzuran" bad_bot
 +
    SetEnvIfNoCase User-Agent "^Szukacz/1.4" bad_bot
 +
    SetEnvIfNoCase User-Agent "^tAkeOut" bad_bot
 +
    SetEnvIfNoCase User-Agent "^Teleport" bad_bot
 +
    SetEnvIfNoCase User-Agent "^Telesoft" bad_bot
 +
    SetEnvIfNoCase User-Agent "^TurnitinBot/1.5" bad_bot
 +
    SetEnvIfNoCase User-Agent "^The.Intraformant" bad_bot
 +
    SetEnvIfNoCase User-Agent "^TheNomad" bad_bot
 +
    SetEnvIfNoCase User-Agent "^TightTwatBot" bad_bot
 +
    SetEnvIfNoCase User-Agent "^Titan" bad_bot
 +
    SetEnvIfNoCase User-Agent "^toCrawl/UrlDispatcher" bad_bot
 +
    SetEnvIfNoCase User-Agent "^True_Robot" bad_bot
 +
    SetEnvIfNoCase User-Agent "^turingos" bad_bot
 +
    SetEnvIfNoCase User-Agent "^TurnitinBot" bad_bot
 +
    SetEnvIfNoCase User-Agent "^URLy.Warning" bad_bot
 +
    SetEnvIfNoCase User-Agent "^Vacuum" bad_bot
 +
    SetEnvIfNoCase User-Agent "^VCI" bad_bot
 +
    SetEnvIfNoCase User-Agent "^VoidEYE" bad_bot
 +
    SetEnvIfNoCase User-Agent "^Web\ Image\ Collector" bad_bot
 +
    SetEnvIfNoCase User-Agent "^Web\ Sucker" bad_bot
 +
    SetEnvIfNoCase User-Agent "^WebAuto" bad_bot
 +
    SetEnvIfNoCase User-Agent "^WebBandit" bad_bot
 +
    SetEnvIfNoCase User-Agent "^Webclipping.com" bad_bot
 +
    SetEnvIfNoCase User-Agent "^WebCopier" bad_bot
 +
    SetEnvIfNoCase User-Agent "^WebEMailExtrac.*" bad_bot
 +
    SetEnvIfNoCase User-Agent "^WebEnhancer" bad_bot
 +
    SetEnvIfNoCase User-Agent "^WebFetch" bad_bot
 +
    SetEnvIfNoCase User-Agent "^WebGo\ IS" bad_bot
 +
    SetEnvIfNoCase User-Agent "^Web.Image.Collector" bad_bot
 +
    SetEnvIfNoCase User-Agent "^WebLeacher" bad_bot
 +
    SetEnvIfNoCase User-Agent "^WebmasterWorldForumBot" bad_bot
 +
    SetEnvIfNoCase User-Agent "^WebReaper" bad_bot
 +
    SetEnvIfNoCase User-Agent "^WebSauger" bad_bot
 +
    SetEnvIfNoCase User-Agent "^WebSite" bad_bot
 +
    SetEnvIfNoCase User-Agent "^Website\ eXtractor" bad_bot
 +
    SetEnvIfNoCase User-Agent "^Website\ Quester" bad_bot
 +
    SetEnvIfNoCase User-Agent "^Webster" bad_bot
 +
    SetEnvIfNoCase User-Agent "^WebStripper" bad_bot
 +
    SetEnvIfNoCase User-Agent "^WebWhacker" bad_bot
 +
    SetEnvIfNoCase User-Agent "^WebZIP" bad_bot
 +
    SetEnvIfNoCase User-Agent "^Wget" bad_bot
 +
    SetEnvIfNoCase User-Agent "Whacker" bad_bot
 +
    SetEnvIfNoCase User-Agent "^Widow" bad_bot
 +
    SetEnvIfNoCase User-Agent "^WISENutbot" bad_bot
 +
    SetEnvIfNoCase User-Agent "^WWWOFFLE" bad_bot
 +
    SetEnvIfNoCase User-Agent "^WWW-Collector-E" bad_bot
 +
    SetEnvIfNoCase User-Agent "^Xaldon" bad_bot
 +
    SetEnvIfNoCase User-Agent "^Xenu" bad_bot
 +
    SetEnvIfNoCase User-Agent "^Zeus" bad_bot
 +
    SetEnvIfNoCase User-Agent "^Zyborg" bad_bot
 +
    </Directory>
 +
</code>
 +
.htacess  to match above
 +
<code>
 +
    Order Allow,Deny
 +
    Allow from all
 +
    Deny from env=bad_bot
 +
    Allow from env=search_robot
 +
</code>

Revision as of 12:06, 28 March 2012

Might be less tedious and troublesome to disable account creation for now and set it to e-mail verification. Updating MediaWiki to the latest version may also be of benefit as it has some better goodies to protect the system. See here @ http://lists.wikimedia.org/pipermail/mediawiki-announce/2012-March/000110.html

These Bitcoin buffoons are seriously in need of some med's, legal or otherwise.

EDIT: Another option to consider, not only to protect the wiki and all of OpenSimulator.org would be to update Apache Server and mod the httpd.conf and reflect it in .htaccess There are major lists of "Bad Bots" which you can further add in here but the material here is a darned good start to blocking the trashers & spammers as well as getting rid of the scrapers which can seriously slow down the website & server response times. 

   #  --- LINE 237 in apache\conf\httpd.conf
   # Controls who can get stuff from this server.
   #
   Order allow,deny
   Allow from all
   # 
   # Good Bots
   SetEnvIfNoCase User-Agent .*google.* search_robot
   SetEnvIfNoCase User-Agent .*yahoo.* search_robot
   # SetEnvIfNoCase User-Agent .*bot.* search_robot
   SetEnvIfNoCase User-Agent .*ask.* search_robot
   # 
   # Nasty IP's that hit us looking for things they shouldn't
   Deny from 188.40.231.165
   Deny from 50.22.21.218
   Deny from 66.135.49.5
   Deny from 60.231.215.42
   Deny from 220.181.108.123
   #
   # BAD BOTS added by WS as they changed a little
   SetEnvIfNoCase User-Agent ^$ bad_bot
   SetEnvIfNoCase User-Agent "^Baiduspider+" bad_bot	
   SetEnvIfNoCase User-Agent "^Yandex" bad_bot
   SetEnvIfNoCase User-Agent "^Exabot" bad_bot
   SetEnvIfNoCase User-Agent "^Cityreview" bad_bot
   SetEnvIfNoCase User-Agent "^Dotbot" bad_bot
   SetEnvIfNoCase User-Agent "^Sogou" bad_bot
   SetEnvIfNoCase User-Agent "^Sosospider" bad_bot
   SetEnvIfNoCase User-Agent "^Twiceler" bad_bot 
   SetEnvIfNoCase User-Agent "Python-urllib/2.4" bad_bot 
   SetEnvIfNoCase User-Agent "^whitehat" bad_bot 
   SetEnvIfNoCase User-Agent "^BitKinex" bad_bot 
   SetEnvIfNoCase User-Agent "^w00tw00t^" bad_bot 
   SetEnvIfNoCase User-Agent "^ZmEu" bad_bot
   SetEnvIfNoCase User-Agent "ZmEu" bad_bot
   SetEnvIfNoCase User-Agent "Morfeus" bad_bot
   #
   # this ruleset is for unwanted useragents... possibly email harvesters
   SetEnvIfNoCase User-Agent "^AESOP_com_SpiderMan" bad_bot
   SetEnvIfNoCase User-Agent "^Alexibot" bad_bot
   SetEnvIfNoCase User-Agent "Anonymouse.org" bad_bot
   SetEnvIfNoCase User-Agent "^asterias" bad_bot
   SetEnvIfNoCase User-Agent "^attach" bad_bot
   SetEnvIfNoCase User-Agent "^BackDoorBot" bad_bot
   SetEnvIfNoCase User-Agent "^BackWeb" bad_bot
   SetEnvIfNoCase User-Agent "Bandit" bad_bot
   SetEnvIfNoCase User-Agent "^Baiduspider" bad_bot
   SetEnvIfNoCase User-Agent "^BatchFTP" bad_bot
   SetEnvIfNoCase User-Agent "^Bigfoot" bad_bot
   SetEnvIfNoCase User-Agent "^Black.Hole" bad_bot
   SetEnvIfNoCase User-Agent "^BlackWidow" bad_bot
   SetEnvIfNoCase User-Agent "^BlowFish" bad_bot
   SetEnvIfNoCase User-Agent "^Bot\ mailto:craftbot@yahoo.com" bad_bot
   SetEnvIfNoCase User-Agent "^BotALot" bad_bot
   SetEnvIfNoCase User-Agent "Buddy" bad_bot
   SetEnvIfNoCase User-Agent "^BuiltBotTough" bad_bot
   SetEnvIfNoCase User-Agent "^Bullseye" bad_bot
   SetEnvIfNoCase User-Agent "^BunnySlippers" bad_bot
   SetEnvIfNoCase User-Agent "^Cegbfeieh" bad_bot
   SetEnvIfNoCase User-Agent "^CheeseBot" bad_bot
   SetEnvIfNoCase User-Agent "^CherryPicker" bad_bot
   SetEnvIfNoCase User-Agent "^ChinaClaw" bad_bot
   SetEnvIfNoCase User-Agent "Collector" bad_bot
   SetEnvIfNoCase User-Agent "Copier" bad_bot
   SetEnvIfNoCase User-Agent "^CopyRightCheck" bad_bot
   SetEnvIfNoCase User-Agent "^cosmos" bad_bot
   SetEnvIfNoCase User-Agent "^Crescent" bad_bot
   SetEnvIfNoCase User-Agent "^Curl" bad_bot
   SetEnvIfNoCase User-Agent "^Custo" bad_bot
   SetEnvIfNoCase User-Agent "^DA" bad_bot
   SetEnvIfNoCase User-Agent "^DISCo" bad_bot
   SetEnvIfNoCase User-Agent "^DIIbot" bad_bot
   SetEnvIfNoCase User-Agent "^DittoSpyder" bad_bot
   SetEnvIfNoCase User-Agent "^Download" bad_bot
   SetEnvIfNoCase User-Agent "^Download\ Demon" bad_bot
   SetEnvIfNoCase User-Agent "^Download\ Devil" bad_bot
   SetEnvIfNoCase User-Agent "^Download\ Wonder" bad_bot
   SetEnvIfNoCase User-Agent "Downloader" bad_bot
   SetEnvIfNoCase User-Agent "^dragonfly" bad_bot
   SetEnvIfNoCase User-Agent "^Drip" bad_bot
   SetEnvIfNoCase User-Agent "^eCatch" bad_bot
   SetEnvIfNoCase User-Agent "^EasyDL" bad_bot
   SetEnvIfNoCase User-Agent "^ebingbong" bad_bot
   SetEnvIfNoCase User-Agent "^EirGrabber" bad_bot
   SetEnvIfNoCase User-Agent "^EmailCollector" bad_bot
   SetEnvIfNoCase User-Agent "^EmailSiphon" bad_bot
   SetEnvIfNoCase User-Agent "^EmailWolf" bad_bot
   SetEnvIfNoCase User-Agent "^EroCrawler" bad_bot
   SetEnvIfNoCase User-Agent "^Exabot" bad_bot
   SetEnvIfNoCase User-Agent "^Express\ WebPictures" bad_bot
   SetEnvIfNoCase User-Agent "Extractor" bad_bot
   SetEnvIfNoCase User-Agent "^EyeNetIE" bad_bot
   SetEnvIfNoCase User-Agent "^FileHound" bad_bot
   SetEnvIfNoCase User-Agent "^FlashGet" bad_bot
   SetEnvIfNoCase User-Agent "^Foobot" bad_bot
   SetEnvIfNoCase User-Agent "^flunky" bad_bot
   SetEnvIfNoCase User-Agent "^FrontPage" bad_bot
   SetEnvIfNoCase User-Agent "^GetRight" bad_bot
   SetEnvIfNoCase User-Agent "^GetSmart" bad_bot
   SetEnvIfNoCase User-Agent "^GetWeb!" bad_bot
   SetEnvIfNoCase User-Agent "^Go!Zilla" bad_bot
   SetEnvIfNoCase User-Agent "Google\ Wireless\ Transcoder" bad_bot
   SetEnvIfNoCase User-Agent "^Go-Ahead-Got-It" bad_bot
   SetEnvIfNoCase User-Agent "^gotit" bad_bot
   SetEnvIfNoCase User-Agent "Grabber" bad_bot
   SetEnvIfNoCase User-Agent "^GrabNet" bad_bot
   SetEnvIfNoCase User-Agent "^Grafula" bad_bot
   SetEnvIfNoCase User-Agent "^Harvest" bad_bot
   SetEnvIfNoCase User-Agent "^hloader" bad_bot
   SetEnvIfNoCase User-Agent "^HMView" bad_bot
   SetEnvIfNoCase User-Agent "^httplib" bad_bot
   SetEnvIfNoCase User-Agent "^HTTrack" bad_bot
   SetEnvIfNoCase User-Agent "^humanlinks" bad_bot
   SetEnvIfNoCase User-Agent "^ia_archiver" bad_bot
   SetEnvIfNoCase User-Agent "^IlseBot" bad_bot
   SetEnvIfNoCase User-Agent "^Image\ Stripper" bad_bot
   SetEnvIfNoCase User-Agent "^Image\ Sucker" bad_bot
   SetEnvIfNoCase User-Agent "Indy\ Library" bad_bot
   SetEnvIfNoCase User-Agent "^InfoNaviRobot" bad_bot
   SetEnvIfNoCase User-Agent "^InfoTekies" bad_bot
   SetEnvIfNoCase User-Agent "^Intelliseek" bad_bot
   SetEnvIfNoCase User-Agent "^InterGET" bad_bot
   SetEnvIfNoCase User-Agent "^Internet\ Ninja" bad_bot
   SetEnvIfNoCase User-Agent "^Iria" bad_bot
   SetEnvIfNoCase User-Agent "^Jakarta" bad_bot
   SetEnvIfNoCase User-Agent "^JennyBot" bad_bot
   SetEnvIfNoCase User-Agent "^JetCar" bad_bot
   SetEnvIfNoCase User-Agent "^JOC" bad_bot
   SetEnvIfNoCase User-Agent "^JustView" bad_bot
   SetEnvIfNoCase User-Agent "^Jyxobot" bad_bot
   SetEnvIfNoCase User-Agent "^Kenjin.Spider" bad_bot
   SetEnvIfNoCase User-Agent "^Keyword.Density" bad_bot
   SetEnvIfNoCase User-Agent "^larbin" bad_bot
   SetEnvIfNoCase User-Agent "^LeechFTP" bad_bot
   SetEnvIfNoCase User-Agent "^LexiBot" bad_bot
   SetEnvIfNoCase User-Agent "^lftp" bad_bot
   SetEnvIfNoCase User-Agent "^libWeb/clsHTTP" bad_bot
   SetEnvIfNoCase User-Agent "^likse" bad_bot
   SetEnvIfNoCase User-Agent "^LinkextractorPro" bad_bot
   SetEnvIfNoCase User-Agent "^LinkScan/8.1a.Unix" bad_bo
   SetEnvIfNoCase User-Agent "^LNSpiderguy" bad_bott
   SetEnvIfNoCase User-Agent "^LinkWalker" bad_bot
   SetEnvIfNoCase User-Agent "^lwp-trivial" bad_bot
   SetEnvIfNoCase User-Agent "^LWP::Simple" bad_bot
   SetEnvIfNoCase User-Agent "^Magnet" bad_bot
   SetEnvIfNoCase User-Agent "^Mag-Net" bad_bot
   SetEnvIfNoCase User-Agent "^MarkWatch" bad_bot
   SetEnvIfNoCase User-Agent "^Mass\ Downloader" bad_bot
   SetEnvIfNoCase User-Agent "^Mata.Hari" bad_bot
   SetEnvIfNoCase User-Agent "^Memo" bad_bot
   SetEnvIfNoCase User-Agent "^Microsoft.URL" bad_bot
   SetEnvIfNoCase User-Agent "^Microsoft\ URL\ Control" bad_bot
   SetEnvIfNoCase User-Agent "^MIDown\ tool" bad_bot
   SetEnvIfNoCase User-Agent "^MIIxpc" bad_bot
   SetEnvIfNoCase User-Agent "^Mirror" bad_bot
   SetEnvIfNoCase User-Agent "^Missigua\ Locator" bad_bot
   SetEnvIfNoCase User-Agent "^Mister\ PiX" bad_bot
   SetEnvIfNoCase User-Agent "^moget" bad_bot
   SetEnvIfNoCase User-Agent "^Mozilla/3.Mozilla/2.01" bad_bot
   SetEnvIfNoCase User-Agent "^Mozilla.*NEWT" bad_bot
   SetEnvIfNoCase User-Agent "^NAMEPROTECT" bad_bot
   SetEnvIfNoCase User-Agent "^Navroad" bad_bot
   SetEnvIfNoCase User-Agent "^NearSite" bad_bot
   SetEnvIfNoCase User-Agent "^NetAnts" bad_bot
   SetEnvIfNoCase User-Agent "^Netcraft" bad_bot
   SetEnvIfNoCase User-Agent "^NetMechanic" bad_bot
   SetEnvIfNoCase User-Agent "^NetSpider" bad_bot
   SetEnvIfNoCase User-Agent "^Net\ Vampire" bad_bot
   SetEnvIfNoCase User-Agent "^NetZIP" bad_bot
   SetEnvIfNoCase User-Agent "^NextGenSearchBot" bad_bot
   SetEnvIfNoCase User-Agent "^NG" bad_bot
   SetEnvIfNoCase User-Agent "^NICErsPRO" bad_bot
   SetEnvIfNoCase User-Agent "^NimbleCrawler" bad_bot
   SetEnvIfNoCase User-Agent "^Ninja" bad_bot
   SetEnvIfNoCase User-Agent "^NPbot" bad_bot
   SetEnvIfNoCase User-Agent "^Octopus" bad_bot
   SetEnvIfNoCase User-Agent "^Offline\ Explorer" bad_bot
   SetEnvIfNoCase User-Agent "^Offline\ Navigator" bad_bot
   SetEnvIfNoCase User-Agent "^Openfind" bad_bot
   SetEnvIfNoCase User-Agent "^OutfoxBot" bad_bot
   SetEnvIfNoCase User-Agent "^PageGrabber" bad_bot
   SetEnvIfNoCase User-Agent "^Papa\ Foto" bad_bot
   SetEnvIfNoCase User-Agent "^pavuk" bad_bot
   SetEnvIfNoCase User-Agent "^pcBrowser" bad_bot
   SetEnvIfNoCase User-Agent "^PHP\ version\ tracker" bad_bot
   SetEnvIfNoCase User-Agent "^Pockey" bad_bot
   SetEnvIfNoCase User-Agent "^ProPowerBot/2.14" bad_bot
   SetEnvIfNoCase User-Agent "^ProWebWalker" bad_bot
   SetEnvIfNoCase User-Agent "^psbot" bad_bot
   SetEnvIfNoCase User-Agent "^Pump" bad_bot
   SetEnvIfNoCase User-Agent "^QueryN.Metasearch" bad_bot
   SetEnvIfNoCase User-Agent "^RealDownload" bad_bot
   SetEnvIfNoCase User-Agent "Reaper" bad_bot
   SetEnvIfNoCase User-Agent "Recorder" bad_bot
   SetEnvIfNoCase User-Agent "^ReGet" bad_bot
   SetEnvIfNoCase User-Agent "^RepoMonkey" bad_bot
   SetEnvIfNoCase User-Agent "^RMA" bad_bot
   SetEnvIfNoCase User-Agent "Siphon" bad_bot
   SetEnvIfNoCase User-Agent "sitecheck.internetseer.com" bad_bot
   SetEnvIfNoCase User-Agent "^SiteSnagger" bad_bot
   SetEnvIfNoCase User-Agent "^SlySearch" bad_bot
   SetEnvIfNoCase User-Agent "^SmartDownload" bad_bot
   SetEnvIfNoCase User-Agent "^Snake" bad_bot
   SetEnvIfNoCase User-Agent "^Snapbot" bad_bot
   SetEnvIfNoCase User-Agent "^Snoopy" bad_bot
   SetEnvIfNoCase User-Agent "^sogou" bad_bot
   SetEnvIfNoCase User-Agent "^SpaceBison" bad_bot
   SetEnvIfNoCase User-Agent "^SpankBot" bad_bot
   SetEnvIfNoCase User-Agent "^spanner" bad_bot
   SetEnvIfNoCase User-Agent "^Sqworm" bad_bot
   SetEnvIfNoCase User-Agent "Stripper" bad_bot
   SetEnvIfNoCase User-Agent "Sucker" bad_bot
   SetEnvIfNoCase User-Agent "^SuperBot" bad_bot
   SetEnvIfNoCase User-Agent "^SuperHTTP" bad_bot
   SetEnvIfNoCase User-Agent "^Surfbot" bad_bot
   SetEnvIfNoCase User-Agent "^suzuran" bad_bot
   SetEnvIfNoCase User-Agent "^Szukacz/1.4" bad_bot
   SetEnvIfNoCase User-Agent "^tAkeOut" bad_bot
   SetEnvIfNoCase User-Agent "^Teleport" bad_bot
   SetEnvIfNoCase User-Agent "^Telesoft" bad_bot
   SetEnvIfNoCase User-Agent "^TurnitinBot/1.5" bad_bot
   SetEnvIfNoCase User-Agent "^The.Intraformant" bad_bot
   SetEnvIfNoCase User-Agent "^TheNomad" bad_bot
   SetEnvIfNoCase User-Agent "^TightTwatBot" bad_bot
   SetEnvIfNoCase User-Agent "^Titan" bad_bot
   SetEnvIfNoCase User-Agent "^toCrawl/UrlDispatcher" bad_bot
   SetEnvIfNoCase User-Agent "^True_Robot" bad_bot
   SetEnvIfNoCase User-Agent "^turingos" bad_bot
   SetEnvIfNoCase User-Agent "^TurnitinBot" bad_bot
   SetEnvIfNoCase User-Agent "^URLy.Warning" bad_bot
   SetEnvIfNoCase User-Agent "^Vacuum" bad_bot
   SetEnvIfNoCase User-Agent "^VCI" bad_bot
   SetEnvIfNoCase User-Agent "^VoidEYE" bad_bot
   SetEnvIfNoCase User-Agent "^Web\ Image\ Collector" bad_bot
   SetEnvIfNoCase User-Agent "^Web\ Sucker" bad_bot
   SetEnvIfNoCase User-Agent "^WebAuto" bad_bot
   SetEnvIfNoCase User-Agent "^WebBandit" bad_bot
   SetEnvIfNoCase User-Agent "^Webclipping.com" bad_bot
   SetEnvIfNoCase User-Agent "^WebCopier" bad_bot
   SetEnvIfNoCase User-Agent "^WebEMailExtrac.*" bad_bot
   SetEnvIfNoCase User-Agent "^WebEnhancer" bad_bot
   SetEnvIfNoCase User-Agent "^WebFetch" bad_bot
   SetEnvIfNoCase User-Agent "^WebGo\ IS" bad_bot
   SetEnvIfNoCase User-Agent "^Web.Image.Collector" bad_bot
   SetEnvIfNoCase User-Agent "^WebLeacher" bad_bot
   SetEnvIfNoCase User-Agent "^WebmasterWorldForumBot" bad_bot
   SetEnvIfNoCase User-Agent "^WebReaper" bad_bot
   SetEnvIfNoCase User-Agent "^WebSauger" bad_bot
   SetEnvIfNoCase User-Agent "^WebSite" bad_bot
   SetEnvIfNoCase User-Agent "^Website\ eXtractor" bad_bot
   SetEnvIfNoCase User-Agent "^Website\ Quester" bad_bot
   SetEnvIfNoCase User-Agent "^Webster" bad_bot
   SetEnvIfNoCase User-Agent "^WebStripper" bad_bot
   SetEnvIfNoCase User-Agent "^WebWhacker" bad_bot
   SetEnvIfNoCase User-Agent "^WebZIP" bad_bot
   SetEnvIfNoCase User-Agent "^Wget" bad_bot
   SetEnvIfNoCase User-Agent "Whacker" bad_bot
   SetEnvIfNoCase User-Agent "^Widow" bad_bot
   SetEnvIfNoCase User-Agent "^WISENutbot" bad_bot
   SetEnvIfNoCase User-Agent "^WWWOFFLE" bad_bot
   SetEnvIfNoCase User-Agent "^WWW-Collector-E" bad_bot
   SetEnvIfNoCase User-Agent "^Xaldon" bad_bot
   SetEnvIfNoCase User-Agent "^Xenu" bad_bot
   SetEnvIfNoCase User-Agent "^Zeus" bad_bot
   SetEnvIfNoCase User-Agent "^Zyborg" bad_bot
   </Directory>

.htacess to match above 

   Order Allow,Deny
   Allow from all
   Deny from env=bad_bot
   Allow from env=search_robot

Retrieved from "http://opensimulator.org/index.php?title=MediaWiki_talk:Titleblacklist&oldid=29389"
Personal tools
General
About This Wiki