Unit 10: Web Information Retrieval

Information Retrieval on the web is extremely difficult, due to the Internet's enourmous size and the sheer variety of information it contains. There are no formatting or information organization standards for the Web. There have been many different methods used to create a search engine that could navigate the Internet effectively. Initial models required uses to submit a web site for indexing. Sites such as Yahoo! attempted to categorize websites so that users could browse without using queries. Google's approach, crawling the web and indexing information based on the structure of hypertext, has proven to be the most effective.