Results 1 to 2 of 2

Thread: Search engine experimentation.

  1. #1
    Tony Fracasso - Admin
    Join Date
    May 2003
    Location
    Buffalo, New York, United States
    Posts
    64,947

    Search engine experimentation.

    Go to google and type:

    giambra family and friends plan

    Speakup is getting spidered very quickly through the search engines.

    THis was an interesting site that came up too with that seach

    http://www.buffalobeast.com/58/PFbriefs58.htm

    Warning though.. it's harsh.

  2. #2
    Tony Fracasso - Admin
    Join Date
    May 2003
    Location
    Buffalo, New York, United States
    Posts
    64,947
    Some facts on being spidered when done correctly.

    Below is a data which shows for the month of October how many times speakupwny.com has been spidered by search engines. The more the better. Now people want to know why this is important. The more often your site is spider the sooner your content started to appear in search engines. On the plus side, lets say you have a brand new site no one knows about. The search engines don't know about it either. When you have your site listed on a popular site you will get spidered much faster. The robots will spider to the links on the site usually after the main site is indexed.

    The first column is the search engine spidering, then how many times for the month of october, then how many times the robot.txt file was read and lastly, how much bandwidth each index uses. These are the top 10.

    Robots.txt is an important file. It tells the search engine how and what should be indexed.


    MSNBot 13938+112 221.50 MB 28 Oct 2004 - 04:05
    Inktomi Slurp 2158+499 26.80 MB 28 Oct 2004 - 04:02
    Googlebot 1142+95 22.50 MB 28 Oct 2004 - 03:57
    Alexa (IA Archiver) 529+61 7.63 MB 28 Oct 2004 - 03:57
    Unknown robot (identified by hit on 'robots.txt') 0+513 22.04 KB 28 Oct 2004 - 03:04
    WISENutbot 292+5 5.17 MB 28 Oct 2004 - 04:02
    AskJeeves 214+77 2.67 MB 27 Oct 2004 - 11:35
    LinkWalker 249+1 3.10 MB 06 Oct 2004 - 02:09
    Unknown robot (identified by 'crawl') 226+11 1.84 MB 27 Oct 2004 - 18:24
    Turn It In 215+4 2.11 MB 08 Oct 2004 - 00:34

Thread Information

Users Browsing this Thread

There are currently 1 users browsing this thread. (0 members and 1 guests)

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •