A crawler/spider is a program of search engines which visit on the web pages automatically to read, store and index them; whatever on the web pages. Its another name are web spider, web robot, ants, bots, worms etc. The major search engines spiders are listed below.
Search Engines - Spiders or Crawler Name
Google Googlebot
Yahoo Yahoo Slurp
MSN MSNbot
Ask Teoma
Altavista Scooter
Excite Architext spider
Inktomi.com Slurp
Alexa ia_archiver
Looksmart MantraAgent
Lycus Lycos_Spider_(T-Rex)
Cuil Twiceler
Search Engines - Spiders or Crawler Name
Google Googlebot
Yahoo Yahoo Slurp
MSN MSNbot
Ask Teoma
Altavista Scooter
Excite Architext spider
Inktomi.com Slurp
Alexa ia_archiver
Looksmart MantraAgent
Lycus Lycos_Spider_(T-Rex)
Cuil Twiceler
Good job!! I was looking for spiders name of major Search Engines.
ReplyDeleteThanks Buddy.
thanks for sharing such an good info with us!
ReplyDeleteThanks
Maria