Printable View
Go to google and type:
giambra family and friends plan
Speakup is getting spidered very quickly through the search engines.
THis was an interesting site that came up too with that seach
http://www.buffalobeast.com/58/PFbriefs58.htm
Warning though.. it's harsh.
Some facts on being spidered when done correctly.
Below is a data which shows for the month of October how many times speakupwny.com has been spidered by search engines. The more the better. Now people want to know why this is important. The more often your site is spider the sooner your content started to appear in search engines. On the plus side, lets say you have a brand new site no one knows about. The search engines don't know about it either. When you have your site listed on a popular site you will get spidered much faster. The robots will spider to the links on the site usually after the main site is indexed.
The first column is the search engine spidering, then how many times for the month of october, then how many times the robot.txt file was read and lastly, how much bandwidth each index uses. These are the top 10.
Robots.txt is an important file. It tells the search engine how and what should be indexed.
MSNBot 13938+112 221.50 MB 28 Oct 2004 - 04:05
Inktomi Slurp 2158+499 26.80 MB 28 Oct 2004 - 04:02
Googlebot 1142+95 22.50 MB 28 Oct 2004 - 03:57
Alexa (IA Archiver) 529+61 7.63 MB 28 Oct 2004 - 03:57
Unknown robot (identified by hit on 'robots.txt') 0+513 22.04 KB 28 Oct 2004 - 03:04
WISENutbot 292+5 5.17 MB 28 Oct 2004 - 04:02
AskJeeves 214+77 2.67 MB 27 Oct 2004 - 11:35
LinkWalker 249+1 3.10 MB 06 Oct 2004 - 02:09
Unknown robot (identified by 'crawl') 226+11 1.84 MB 27 Oct 2004 - 18:24
Turn It In 215+4 2.11 MB 08 Oct 2004 - 00:34