Directory of Evaluation of Search Services Resources

Home > Computers > Internet > Searching > Directories > DMOZ > Research Papers > Evaluation of Search Services

Resources in This Category

• Automatic Evaluation of World Wide Web Search Services

  http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.11.7192&rep=rep1&type=pdf
  By Abdur Chowdhury, America Online Inc., and Ian Soboroff, National Institute of Standards and Technology, USA. 2002. The authors present a method for comparing search engines automatically based on how they rank known item search results. The queries are constructed using query log analysis, the result is automatically constructed via analysis of editor comments from ODP. Five search services are compared: Lycos, Netscape, Fast, Google, HotBot, with the result that some services perform better than others, but the majority are statistically equivalent.

• Can Social Bookmarking Improve Web Search?

  http://dbpubs.stanford.edu/pub/showDoc.Fulltext?lang=en&doc=2008-2&format=pdf&compression=&name=2008-2.pdf
  By Paul Heymann, Georgia Koutrika, and Hector Garcia-Molina Dept. of Computer Science, Stanford University Stanford, CA, USA. The paper includes eleven experiments designed to evaluate different aspects of social bookmarking and their impact on web search, using del.icio.us bookmarking data, Yahoo! and AOL search data, and ODP data gathered between May and June of 2007.

• Random Sampling from a Search Engine´s Corpus

  http://www.ee.technion.ac.il/people/zivby/papers/se/se.techreport.pdf
  By Ziv Bar-Yossef and Maxim Gurevich. Technical report, August 2006. Two novel algorithms for random sampling are used to collect comparative statistics on the corpora of Google, MSN Search and Yahoo. ODP is used to create a test search engine and query pool.

• Using Titles and Category Names from Editor-driven Taxonomies for Automatic Evaluation

  http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.10.5658&rep=rep1&type=pdf
  By Steven M. Beitzel, Eric C. Jensen, Abdur Chowdhury and David Grossman. Illinois Institute of Technology, USA. In: Proceedings of the twelfth international conference on Information and knowledge management, 2003. Evaluation of IR systems has always been difficult because of the need for manually assessed relevance judgments: large editor-driven taxonomies on the web make a new evaluation approach possible. ODP´s taxonomy is used to compare and contrast two methodologies.

 

Home > Computers > Internet > Searching > Directories > DMOZ > Research Papers > Evaluation of Search Services

 

---

 

Thanks to DMOZ, which built a great web directory for nearly two decades and freely shared it with the web. About us