Web crawler-is a program used by search engines such as
Google, Yahoo or MSN to keep the World Wide Web.
Those programs allow the user to search the web through the keywords and phrases taped in the
page. One of the web crawler examples is Google information that you are looking for you need to
tape in the provided space and Google will automatically find and show all websites and links, linked
to the word/-phrase you taped. Also Google shows the Graphics connected to the thing you are
looking for.
Directories- are similar to the Web crawlers. Directories information is gathered by human efforts,
and web crawlers are based on true facts and figures, but this is not always right. Web directories
don’t display lists of webpages based on keywords, instead it lists web sites by category and
subcategory. The categorization is usually based on the whole web site rather just one page or set of
keywords, and sites are often limited to inclusion in only few categories listing one or two
categories.
An example of a directory will be YAHOO- which is a worldwide directory.
To make search more precise we may use a speech marks and search will only find the websites only
with the words which are inside of speech marks. For example ''Robert Sutton school''.
Comparing with Google search, Yahoo has 20,900,000 shown results, and Google 2,330,000, which
clearly showing that Yahoo is better to use because it takes the user to find straight away what they
are looking for because of lees results shown and time for looking will be much less.
Hybrid search engine -it is a type of computer search engine, which presents results from web
directories that, has been edited by humans along with generated results based on web crawling. A
hybrid search engine will prefer one type of listing over another. Also hybrid search engine is
common to show both type of results. HSE combine results from directories and web crawlers, and
is becoming more common to use.
As an example of HSE- Hybrid Search Engine may be BING:
Quotes -are very useful in web searching, because they allow us to find only what we are looking for
and may save us a time. By making quotes we are making word outstanding from other words.
When you use quotation marks around the phrase you are telling the search engine to only bring
back pages that include these search term exactly how you taped them in order, proximity...etc. For
example if we are looking for ''HP Laptop'' it will be easier for us put it in the quotes, because it will
link both words together ''HP Laptop'', and will not looking for just HP or an Laptop
Wildcards- are used to ''wildcard'' characters to throw a broader search net in most search engines
and directories. Wildcard characters include * which is used to represent any character, ~which is
used as a first character for any users home directory,?;which is used to represent single characters
and [] which is used to enclose a number of characters. Wildcards are used mainly to broaden the
search .For example when you are looking for sites that discuss with textiles, don’t put textiles alone
but textiles*. This will return pages that contain the word ''textile'' as well as pages that contain
''textiles'', ''texturing'', ''textile industry'' and many more. As an example will be Google Search
Keywords-They are more narrowed down you can get your Web searches from beginning, the more
successful Web search usually will be. For example if you are looking for ''tea'', you will get way
more results back than you could use; if you will narrowed it to ''earl grey tea'', you will be more
successful.
Meta-search engines
Children’s search engines
Speciality search engines
BEFORE AND AFTER KEYWORD SEARCH
MINI CD MUSIC TECHNOLOGY
Search engine type
directories
hybrid
Web crawler
Search engine
Yahoo
Bing
Google
Before
270,000,000
259,000,000
70,200,000
after
88,600,000
76,000,000
4,370,000
YAHOO DIRECTORIES BEFORE AND AFTER MAKING QUOTE MARKS ''MINI CD MUSIC
TECHNOLOGY''
GOOGLE WEB CRAWLER BEFORE AND AFTER QUOTE MARKS ''MINI CD MUSIC TECHNOLOGY
BING HYBRID BEFORE AND AFTER QUOTES MARKS ''MINI CD MUSIC TECHNOLOGY''
Search engine type
directories
hybrid
Web crawler
Search engine
Yahoo
Bing
Google
Before
58,100,000
75,800,000
4,370,000
after
85,000,000
88,600,000
4,370,000
YAHOO DIRECTORIES BEFORE AND AFTER WILDCARDS MINI CD and MINI CD~
GOOGLE WEB CRAWLER BEFORE AND AFTER WILDCARD and WILDCARD~
BING HYBRID BEFORE AND AFTER WILDCARD MINI CD = MINI CD FALA
Search engine type
directories
hybrid
Web crawler
Search engine
Yahoo
Bing
Google
Before
270,000,000
259,000,000
70,200,000
after
271,000,000
260,000,000
70,200,000