Thread: A List With Search Engine Spider User Agents

<div class='codetop'>CODE</div><div class='codemain' style='height:200px;white-space:pre;overflow:auto'>appie=spider: Walhello appie
architext=spider: ArchitextSpider
jeeves=spider: AskJeeves
bjaaland=spider: Bjaaland
ferret=spider: Wild Ferret Web Hopper #1, #2, #3
googlebot=spider: Googlebot
gulliver=spider: Northern Light Gulliver
harvest=spider: Harvest
htdig=spider: ht://Dig
linkwalker=spider: LinkWalker
lycos_=spider: Lycos
moget=spider: moget
muscatferret=spider: Muscat Ferret
myweb=spider: Internet Shinchakubin
nomad=spider: Nomad
scooter=spider: Scooter
slurp=spider: Inktomi Slurp
voyager=spider: Voyager
weblayers=spider: weblayers
antibot=spider: Antibot
digout4u=spider: Digout4u
echo=spider: EchO!
fast-webcrawler=spider: Fast-Webcrawler
ia_archiver=spider: Alexa (IA Archiver)
jennybot=spider: JennyBot
mercator=spider: Mercator
msnbot=spider: MSNBot
netcraft=spider: Netcraft
petersnews=spider: Petersnews
unlost_web_crawler=spider: Unlost Web Crawler
voila=spider: Voila
webbase=spider: WebBase
wisenutbot=spider: WISENutbot
fish=spider: Fish search
abcdatos=spider: ABCdatos BotLink
acme.spider=spider: Acme.Spider
ahoythehomepagefinder=spider: Ahoy! The Homepage Finder
alkaline=spider: Alkaline
anthill=spider: Anthill
arachnophilia=spider: Arachnophilia
arale=spider: Arale
araneo=spider: Araneo
aretha=spider: Aretha
ariadne=spider: ARIADNE
arks=spider: arks
aspider=spider: ASpider (Associative Spider)
atn.txt=spider: ATN Worldwide
atomz=spider: Atomz.com Search Robot
auresys=spider: AURESYS
backrub=spider: BackRub
bbot=spider: BBot
bigbrother=spider: Big Brother
blackwidow=spider: BlackWidow
blindekuh=spider: Die Blinde Kuh
bloodhound=spider: Bloodhound
borg-bot=spider: Borg-Bot
brightnet=spider: bright.net caching robot
bspider=spider: BSpider
cactvschemistryspider=spider: CACTVS Chemistry Spider
calif=spider: Calif
cassandra=spider: Cassandra
cgireader=spider: Digimarc Marcspider/CGI
checkbot=spider: Checkbot
christcrawler=spider: ChristCrawler.com
churl=spider: churl
cienciaficcion=spider: cIeNcIaFiCcIoN.nEt
collective=spider: Collective
combine=spider: Combine System
conceptbot=spider: Conceptbot
coolbot=spider: CoolBot
core=spider: Web Core / Roots
cosmos=spider: XYLEME Robot
cruiser=spider: Internet Cruiser Robot
cusco=spider: Cusco
cyberspyder=spider: CyberSpyder Link Test
desertrealm=spider: Desert Realm Spider
deweb=spider: DeWeb© Katalog/Index
dienstspider=spider: DienstSpider
digger=spider: Digger
diibot=spider: Digital Integrity Robot
direct_hit=spider: Direct Hit Grabber
dnabot=spider: DNAbot
download_express=spider: DownLoad Express
dragonbot=spider: DragonBot
dwcp=spider: DWCP (Dridus&#39; Web Cataloging Project)
e-collector=spider: e-collector
ebiness=spider: EbiNess
elfinbot=spider: ELFINBOT
emacs=spider: Emacs-w3 Search Engine
emcspider=spider: ananzi
esther=spider: Esther
evliyacelebi=spider: Evliya Celebi
fastcrawler=spider: FastCrawler
fdse=spider: Fluid Dynamics Search Engine robot
felix=spider: Felix IDE
fetchrover=spider: FetchRover
fido=spider: fido
finnish=spider: Hдmдhдkki
fireball=spider: KIT-Fireball
fouineur=spider: Fouineur
francoroute=spider: Robot Francoroute
freecrawl=spider: Freecrawl
funnelweb=spider: FunnelWeb
gama=spider: gammaSpider, FocusedCrawler
gazz=spider: gazz
gcreep=spider: GCreep
getbot=spider: GetBot
geturl=spider: GetURL
golem=spider: Golem
grapnel=spider: Grapnel/0.01 Experiment
griffon=spider: Griffon
gromit=spider: Gromit
gulperbot=spider: Gulper Bot
hambot=spider: HamBot
havindex=spider: havIndex
hometown=spider: Hometown Spider Pro
htmlgobble=spider: HTMLgobble
hyperdecontextualizer=spider: Hyper-Decontextualizer
iajabot=spider: iajaBot
iconoclast=spider: Popular Iconoclast
ilse=spider: Ingrid
imagelock=spider: Imagelock
incywincy=spider: IncyWincy
informant=spider: Informant
infoseek=spider: InfoSeek Robot 1.0
infoseeksidewinder=spider: Infoseek Sidewinder
infospider=spider: InfoSpiders
inspectorwww=spider: Inspector Web
intelliagent=spider: IntelliAgent
irobot=spider: I, Robot
iron33=spider: Iron33
israelisearch=spider: Israeli-search
javabee=spider: JavaBee
jbot=spider: JBot Java Web Robot
jcrawler=spider: JCrawler
jobo=spider: JoBo Java Web Robot
jobot=spider: Jobot
joebot=spider: JoeBot
jubii=spider: The Jubii Indexing Robot
jumpstation=spider: JumpStation
kapsi=spider: image.kapsi.net
katipo=spider: Katipo
kilroy=spider: Kilroy
ko_yappo_robot=spider: KO_Yappo_Robot
labelgrabber.txt=spider: LabelGrabber
larbin=spider: larbin
legs=spider: legs
linkidator=spider: Link Validator
linkscan=spider: LinkScan
lockon=spider: Lockon
logo_gif=spider: logo.gif Crawler
macworm=spider: Mac WWWWorm
magpie=spider: Magpie
marvin=spider: marvin/infoseek
mattie=spider: Mattie
mediafox=spider: MediaFox
merzscope=spider: MerzScope
meshexplorer=spider: NEC-MeshExplorer
mindcrawler=spider: MindCrawler
mnogosearch=spider: mnoGoSearch search engine software
momspider=spider: MOMspider
monster=spider: Monster
motor=spider: Motor
muncher=spider: Muncher
mwdsearch=spider: Mwd.Search
ndspider=spider: NDSpider
nederland.zoek=spider: Nederland.zoek
netcarta=spider: NetCarta WebMap Engine
netmechanic=spider: NetMechanic
netscoop=spider: NetScoop
newscan-online=spider: newscan-online
nhse=spider: NHSE Web Forager
northstar=spider: The NorthStar Robot
nzexplorer=spider: nzexplorer
objectssearch=spider: ObjectsSearch
occam=spider: Occam
octopus=spider: HKU WWW Octopus
openfind=spider: Openfind data gatherer
orb_search=spider: Orb Search
packrat=spider: Pack Rat
pageboy=spider: PageBoy
parasite=spider: ParaSite
patric=spider: Patric
pegasus=spider: pegasus
perignator=spider: The Peregrinator
perlcrawler=spider: PerlCrawler 1.0
phantom=spider: Phantom
phpdig=spider: PhpDig
piltdownman=spider: PiltdownMan
pimptrain=spider: Pimptrain.com&#39;s robot
pioneer=spider: Pioneer
pitkow=spider: html_analyzer
pjspider=spider: Portal Juice Spider
plumtreewebaccessor=spider: PlumtreeWebAccessor
poppi=spider: Poppi
portalb=spider: PortalB Spider
psbot=spider: psbot
python=spider: The Python Robot
raven=spider: Raven Search
rbse=spider: RBSE Spider
resumerobot=spider: Resume Robot
rhcs=spider: RoadHouse Crawling System
road_runner=spider: Road Runner: The ImageScape Robot
robbie=spider: Robbie the Robot
robi=spider: ComputingSite Robi/1.0
robocrawl=spider: RoboCrawl Spider
robofox=spider: RoboFox
robozilla=spider: Robozilla
roverbot=spider: Roverbot
rules=spider: RuLeS
safetynetrobot=spider: SafetyNet Robot
search-info=spider: Sleek
search_au=spider: Search.Aus-AU.COM
searchprocess=spider: SearchProcess
senrigan=spider: Senrigan
sgscout=spider: SG-Scout
shaggy=spider: ShagSeeker
shaihulud=spider: Shai&#39;Hulud
sift=spider: Sift
simbot=spider: Simmany Robot Ver1.0
site-valet=spider: Site Valet
sitetech=spider: SiteTech-Rover
skymob=spider: Skymob.com
slcrawler=spider: SLCrawler
smartspider=spider: Smart Spider
snooper=spider: Snooper
solbot=spider: Solbot
speedy=spider: Speedy Spider
spider_monkey=spider: spider_monkey
spiderbot=spider: SpiderBot
spiderline=spider: Spiderline Crawler
spiderman=spider: SpiderMan
spiderview=spider: SpiderView™
spry=spider: Spry Wizard Robot
ssearcher=spider: Site Searcher
suke=spider: Suke
suntek=spider: suntek search engine
sven=spider: Sven
tach_bw=spider: TACH Black Widow
tarantula=spider: Tarantula
tarspider=spider: tarspider
techbot=spider: TechBOT
templeton=spider: Templeton
titan=spider: TITAN
titin=spider: TitIn
tkwww=spider: The TkWWW Robot
tlspider=spider: TLSpider
ucsd=spider: UCSD Crawl
udmsearch=spider: UdmSearch
urlck=spider: URL Check
valkyrie=spider: Valkyrie
verticrawl=spider: Verticrawl
victoria=spider: Victoria
visionsearch=spider: vision-search
voidbot=spider: void-bot
vwbot=spider: VWbot
w3index=spider: The NWI Robot
w3m2=spider: W3M2
wallpaper=spider: WallPaper (alias crawlpaper)
wanderer=spider: the World Wide Web Wanderer
wapspider=spider: w@pSpider by wap4.com
webbandit=spider: WebBandit Web Spider
webcatcher=spider: WebCatcher
webcopy=spider: WebCopy
webfetcher=spider: webfetcher
webfoot=spider: The Webfoot Robot
webinator=spider: Webinator
weblinker=spider: WebLinker
webmirror=spider: WebMirror
webmoose=spider: The Web Moose
webquest=spider: WebQuest
webreader=spider: Digimarc MarcSpider
webreaper=spider: WebReaper
websnarf=spider: Websnarf
webspider=spider: WebSpider
webvac=spider: WebVac
webwalk=spider: webwalk
webwalker=spider: WebWalker
webwatch=spider: WebWatch
whatuseek=spider: whatUseek Winona
whowhere=spider: WhoWhere Robot
wired-digital=spider: Wired Digital
wmir=spider: w3mir
wolp=spider: WebStolperer
wombat=spider: The Web Wombat
worm=spider: The World Wide Web Worm
wwwc=spider: WWWC Ver 0.2.5
wz101=spider: WebZinger
xget=spider: XGET
aport=spider: Aport
awbot=spider: AWBot
baiduspider=spider: BaiDuSpider
bobby=spider: Bobby
boris=spider: Boris
bumblebee=spider: Bumblebee (relevare.com)
cscrawler=spider: CsCrawler
daviesbot=spider: DaviesBot
exactseek=spider: ExactSeek Crawler
ezresult=spider: Ezresult
gigabot=spider: GigaBot
gnodspider=spider: GNOD Spider
grub=spider: Grub.org
henrythemiragorobot=spider: Mirago
holmes=spider: Holmes
internetseer=spider: InternetSeer
justview=spider: JustView
linkbot=spider: LinkBot
linkchecker=spider: LinkChecker
mediapartners-google=spider: Google AdSense
metager-linkchecker=spider: MetaGer LinkChecker
microsoft_url_control=spider: Microsoft URL Control
nagios=spider: Nagios
msiecrawler=spider: MSIECrawler
perman=spider: Perman surfer
pompos=spider: Pompos
rambler=spider: StackRambler
redalert=spider: Red Alert
shoutcast=spider: Shoutcast Directory Service
slysearch=spider: SlySearch
surveybot=spider: SurveyBot
turnitinbot=spider: Turn It In
turtle=spider: Turtle
turtlescanner=spider: Turtle
ultraseek=spider: Ultraseek
webclipping.com=spider: WebClipping.com
webcompass=spider: webcompass
wonderer=spider: Web Wombat Redback Spider
yahoo-verticalcrawler=spider: Yahoo Vertical Crawler
yandex=spider: Yandex bot
zealbot=spider: ZealBot
zyborg=spider: Zyborg</div>

Thanx Gums