Articles, reports and other literature on search engines or web crawlers.
Anna Patterson explains the problems of search engine design in practical terms in this lengthy article.
As Microsoft enters the internet search engine market, the BBC compare five of the main providers: Google, Yahoo, MSN, Ask Jeeves and A9.
A complaint filed with the United States Federal Trade Commission by Ralph Nader's Commercial Alert service, which charges the major search engines of inserting advertisements in search engine results without clear disclosure that the ads are ads.
Ben Edelman evaluates DNS, Google, and RealNames for their respective accuracies in providing correct and relevant content. Research suggests that Google offers the highest accuracy.
Research paper which offers a solution for increased indexing efficiency.
An essay by John Hubbard analyzing the question of what is the best way to index the Internet, with references.
Thanks to DMOZ, which built a great web directory for nearly two decades and freely shared it with the web. About us