Registered: Jan 2010
Posts: 3095

Does google trolls the web/internet for information or does google crawls the web for information? I am getting confused between troll and crawl.

Registered: May 2002
Posts: 1690

Google uses web crawlers or sometimes called spyders that go out and find new pages and data. It effectively copies this information and keeps it on 500,000 low cost servers. So when you do a web search, google actually searches for the information on its own database.

The google algorythm is designed to return to sites and update the data more frequently if sites continually add new information. So if you have a static web page, the spyders will return say once a month. If you have a news site, they may return once a minute.

Registered: Dec 2010
Posts: 342

everytime a website has new uploads or data google bots index the new information..either the bots are in the server of the webservers...there is no way a google server would log in crawling..the google bots are in the webservers.and sends the new data.

---

Quote from bearice:

Does google trolls the web/internet for information or does google crawls the web for information? I am getting confused between troll and crawl.

---

Registered: Dec 2010
Posts: 342

would that requre a lot of computing power going through the entire website..some sites ban google bots.

many websites submit their new data to google or popular sites.

---

Quote from Runningbear:

Google uses web crawlers or sometimes called spyders that go out and find new pages and data. It effectively copies this information and keeps it on 500,000 low cost servers. So when you do a web search, google actually searches for the information on its own database.

The google algorythm is designed to return to sites and update the data more frequently if sites continually add new information. So if you have a static web page, the spyders will return say once a month. If you have a news site, they may return once a minute.

---

Registered: Jan 2010
Posts: 414

Troll and crawl have totally different meaning.

Troll, according to wikipedia, is an internet slang which means someone who posts inflammatory, extraneous, or off-topic messages in an online community, such as an online discussion forum, chat room, or blog, with the primary intent of provoking other users into a desired emotional response or of otherwise disrupting normal on-topic discussion.

Whereas "crawl" or "web crawler", is a computer program that browses the World Wide Web in a methodical, automated manner or in an orderly fashion.

Registered: May 2002
Posts: 1690

Posting information on the internet then banning google bots on your site is kind of stupid. The whole idea of posting information to the web is to have as many people as possible exposed to it. So if you're going to ban google search spyders, why put anything on the web at all.

Advantage Futures

Futures Brokerage & Clearing

AMP Global Clearing

Futures and FX Trading

Bright Trading

Professional Equities Trading

CTS

Futures Trading Software

DaytradingBias.com

Professional Trading Analytics

ECHOtrade

Professional Trading Firm

eSignal

Trading Software Provider

FXCM

Forex Trading Services

Global Futures

Futures, Options & FX Trading

Interactive Brokers

Pro Gateway to World Markets

JC Trading Group

Direct Access Trading

MB Trading

Direct Access Trading

MultiCharts

Trading Software Provider

NinjaTrader

Trading Software Provider

OANDA

Currency Trading

optionshouse

Option Trading & Education

Rithmic

Futures Trade Execution Platform

SpeedTrader

Direct Access Trading

SpreadProfessor

Spread Trading Instruction

thinkorswim by TD Ameritrade

Direct Access Trading

TradersStudio

System Building & Backtesting

Trading Technologies

Trading Software Provider

Trend Following

Trading Systems Provider