Google (troll or crawl)

Discussion in 'Backup and Security' started by bearice, Dec 15, 2010.

  1. Does google trolls the web/internet for information or does google crawls the web for information? I am getting confused between troll and crawl.
  2. Google uses web crawlers or sometimes called spyders that go out and find new pages and data. It effectively copies this information and keeps it on 500,000 low cost servers. So when you do a web search, google actually searches for the information on its own database.

    The google algorythm is designed to return to sites and update the data more frequently if sites continually add new information. So if you have a static web page, the spyders will return say once a month. If you have a news site, they may return once a minute.
  3. everytime a website has new uploads or data google bots index the new information..either the bots are in the server of the webservers...there is no way a google server would log in crawling..the google bots are in the webservers.and sends the new data.

  4. would that requre a lot of computing power going through the entire website..some sites ban google bots.

    many websites submit their new data to google or popular sites.

  5. Troll and crawl have totally different meaning.

    Troll, according to wikipedia, is an internet slang which means someone who posts inflammatory, extraneous, or off-topic messages in an online community, such as an online discussion forum, chat room, or blog, with the primary intent of provoking other users into a desired emotional response or of otherwise disrupting normal on-topic discussion.

    Whereas "crawl" or "web crawler", is a computer program that browses the World Wide Web in a methodical, automated manner or in an orderly fashion.
  6. Posting information on the internet then banning google bots on your site is kind of stupid. The whole idea of posting information to the web is to have as many people as possible exposed to it. So if you're going to ban google search spyders, why put anything on the web at all.
  7. Eight


    Web Crawlers were around from the early days of the web, all the search engines used them.