Site Server Search - how does a search engine work?

This is Interesting: Free IT Magazines  
Home > Archive > Site Server Search > August 2004 > how does a search engine work?





You are viewing an archived Text-only version of the thread. To view this thread in it's original format and/or if you want to reply to this thread please [click here]

Author how does a search engine work?
Eli Aran

2004-07-29, 5:52 pm

how does a search engine work technically speaking?
how could it possibly know a certain word exists in 2 million web pages?
how does he manage to give me 2 million search results in 0.3 seconds?
I am completely amazed!




---
Outgoing mail is certified Virus Free.
Checked by AVG anti-virus system (http://www.grisoft.com).
Version: 6.0.730 / Virus Database: 485 - Release Date: 28-Jul-04


David De Giacomi [dotNetHell.it]

2004-07-29, 5:52 pm

> how does a search engine work technically speaking?
> how could it possibly know a certain word exists in 2 million web pages?
> how does he manage to give me 2 million search results in 0.3 seconds?
> I am completely amazed!


Because a search engine is a distributed system.
The google architecture is composed by a large number of servers (about
50,000).
fifty thousand servers, yes that's true with 12 data centers around the
world.
that's why you get answers in a few seconds.

basically a system like this use algorithms and indexes to rapidly find the
occurences of the
searched word/s in differnet documents. sometimes results are also cached
in the system memory. so the system gives you the answer in 0.01 seconds.
bye.

--
David De Giacomi
Microsoft MVP
http://www.dotnethell.it - Have a problem? Get a Solution ;-)


Zeto Enterprises

2004-08-10, 2:51 am

Nothing to be amazed of, really. There will be more machines join to form
more bigger supercomputer group. Oringally, google decided instead of having
one supercomputing machine, to have thousands of machines devided into groups
which will serve as one.

I won't be superised that MSN is doing the same thing as it will no longer
feed data from an outsider. It will feed its own data.

"Eli Aran" wrote:

> how does a search engine work technically speaking?
> how could it possibly know a certain word exists in 2 million web pages?
> how does he manage to give me 2 million search results in 0.3 seconds?
> I am completely amazed!
>
>
>
>
> ---
> Outgoing mail is certified Virus Free.
> Checked by AVG anti-virus system (http://www.grisoft.com).
> Version: 6.0.730 / Virus Database: 485 - Release Date: 28-Jul-04
>
>
>

Sponsored Links






Free braindumps | Software forum | Database administration forum

Copyright 2003 - 2008 webservertalk.com