Ip of the major search engines
Robot: Googlebot IP | User-agent: Googlebot/2.1 (+http://www.google.com/bot.html) ou Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
| Host (DNS) | IP address |
| crawl**.googlebot.com | 66.249.**.** |
Robot: MSNBot IP | User-agent: msnbot/1.0 (+http://search.msn.com/msnbot.htm) ou msnbot/0.3 (+http://search.msn.com/msnbot.htm)
| Host (DNS) | IP address |
| msnbot.msn.com ou adresse IP | 207.68.146.*** |
| msnbot.msn.com ou adresse IP | 65.54.188.*** |
Robot: Yahoo! Slurp IP | User-agent: Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp)
| Host (DNS) | IP address |
| xxxxx.inktomisearch.com | 66.196.***.*** |
| xxxxx.inktomisearch.com | 68.142.***.*** |
Robot: VoilaBot IP | User-agent: Mozilla/4.0 (compatible; MSIE 5.0; Windows 95) VoilaBot BETA 1.2 (http://www.voila.com/)
| Host (DNS) | IP address |
| x1crawler*-1-0.x-echo.com | 195.101.94.*** |
Robot: ZyBorg IP | User-agent: Mozilla/4.0 compatible ZyBorg/1.0 (wn.zyborg@looksmart.net; http://www.WISEnutbot.com)
| Host (DNS) | IP address |
| 64.241.243.65 | 64.241.243.65 |
| an-zyborg-g**.looksmart.com | 209.249.67.1** |
| fdevoid1.looksmart.com | 64.241.242.177 |
Robot: Fast Web Crawler IP | User-agent: FAST-WebCrawler/3.6 (atw-crawler at fast dot no; http://fast.no/support/crawler.asp)
| Host (DNS) | IP address |
| c***.sac2.fastsearch.net | 66.77.73.*** |
IP | User-agent: FAST-WebCrawler/3.7/FirstPage (atw-crawler at fast dot no;http://fast.no/support/crawler.asp)
| Host (DNS) | IP address |
| ***.sac2.fastsearch.net | 66.77.73.*** |
IP | User-agent: FAST-WebCrawler/3.8 (atw-crawler at fast dot no; http://fast.no/support/crawler.asp)
| Host (DNS) | IP address |
| m***.sac2.fastsearch.net | 66.77.73.*** |
Robot: DeepIndex bot IP | User-agent: DeepIndex
| Host (DNS) | IP address |
| deepindex.net1.nerim.net | 62.212.117.198 |
Robots: Teoma, DirectHit
IP | User-agent: Mozilla/2.0 (compatible; Ask Jeeves/Teoma)
| Host (DNS) | IP address |
| egspd***.teoma.com | 65.214.36.*** |
| ghost.directhit.com | 65.214.38.10 |
Robots: appie IP | User-agent: appie 1.1 (www.walhello.com)
| Host (DNS) | IP address |
| qn-212-127-141-180.quicknet.nl | 212.127.141.180 |
| qn-213-73-184-**.quicknet.nl | 213.73.184.** |
Robots: Gigabot IP | User-agent: Gigabot/1.0
| Host (DNS) | IP address |
| gigablast.com | 216.243.113.1 |
Robots: HenriLeRobotMirago IP | User-agent: HenriLeRobotMirago
| Host (DNS) | IP address |
| 217.205.60.225 | 217.205.60.225 |
Robots: Psbot IP | User-agent: psbot/0.1 (+http://www.picsearch.com/bot.html)
| Host (DNS) | IP address |
| sp5.picsearch.com | 62.119.21.157 |
Robots: Szukacz robot IP | User-agent: Szukacz/1.5 (robot; www.szukacz.pl/jakdzialarobot.html; info@szukacz.pl)
| Host (DNS) | IP address |
| robot.szukacz.pl | 193.218.115.6 |
Robots: Openbot IP | User-agent: Openfind data gatherer, Openbot/3.0+(robot- response@openfind.com.tw;+http://www.openfind.com.tw/robot.html)
| Host (DNS) | IP address |
| robot2.openfind.com.tw | 210.59.144.149 |
| 66.237.60.22 | 66.237.60.22 |
Robots: dloader
IP | User-agent: dloader(NaverRobot)/1.0
| Host (DNS) | IP address |
| 218.145.25.*** | 218.145.25.*** |
| |