WWW2007: Program
Top of Menu Home CFP Program Committees Key Dates Location Hotel Registration Students Sponsors Media Submission Tutorials Workshops Travel Info Proceedings

Poster Papers

Track: Search

Paper Title:
Automatic Search Engine Performance Evaluation with Click-through Data Analysis

Authors:

  • Yiqun Liu (Tsinghua University)
  • Yupeng Fu (Tsinghua University)
  • Min Zhang (Tsinghua University)
  • Shaoping Ma (Tsinghua University)
  • Liyun Ru (Sohu Incorporation)

Abstract:
Performance evaluation is an important issue in Web search engine researches. Traditional evaluation methods rely on lots of human efforts and are therefore quite time-consuming. With click through data analysis, we proposed an automatic search engine performance evaluation method. This method is a Cranfield-like one and it generates navigational type query topics and answers automatically based on search users query and click behavior. Experimental results based on a commercial Chinese search engines user logs show that the automatically method gets a similar evaluation result with traditional assessor-based ones.

PDF version

























sponsors