INDEXERS AND ALGORITHMS

As I have said before a spider finds websites/web pages once you have typed in a phrase or keyword, it then downloads and stores the page to another program, called an indexer. Everything has to be indexed otherwise chaos would reign. So every web page the spider collects with all the keywords and phrases that you have typed in for the search are stored altogether for future use.

The search engine sifts through the millions of pages recorded in the index to find matches to a search and ranks them in order of what it believes is most relevant.

Once the page is stored by the indexer HTML tags and store links are removed. The content of the page is then broken down and put into sections and is stored online in a database so that when you request a search on your keywords the results will come from there.

However it is much more involved than that and the following article will explain it more fully. I will chat about ALGORITHMS the next time I'm on this Blog.

"After a Search Engine spider or robot has found, downloaded and stored the page another program, called an indexer, processes the page using its own proprietary algorithm.

A search engine indexer will carve the page up into its various components removing all the HTML tags and store links in a queue. The contents of the meta keyword tag, description tag, titles, headings, links, body copy, bold, and italic are analysed. Some indexers compress the page by removing stop words; finally the much cut down page is stored in an online searchable database.

The indexer uses a complex mathematical formula or algorithm to analyse and weight key areas of a page. Every indexer uses a unique algorithm and these algorithms are constantly being modified and bettered by the search engines to filter out Spam and to ensure that the most relevant pages get better rankings.

Because of the unique nature of these algorithms a page 1 listing in Lycos does not guarantee a similar listing in Google or any other search engine."

Copyright information
This article is free to reproduce but must be reproduced in its entirety & this copyright statement and link to Indiciumweb must be included.
http://www.indiciumweb.co.uk/marketing/seo-tutorials/search-engines/inf_indexer.htm