Automatic Discovery of
Ranking Functions for
Effective Search and Mining on the Internet

With the advent of the Internet, online resources are
increasingly available.
Many users choose popular search engines to perform an online search to
satisfy their information need. However, these search engines tend to turn
up many non-relevant documents, which make their retrieval precision very
low. How to find appropriate ranking metrics to retrieve more relevant
documents and fewer non-relevant documents for users remains a big challenge
to the information retrieval community. We propose a new discovery framework
that combines the merits of genetic algorithms/programming and relevance
feedback techniques to automatically generate and refine the ranking functions
used for document matching and prioritization process. This new discovery
framework can not only be used to fine-tune and optimize a search engine's
ranking strategy to improve the performance for consensus search, but also be
used in user preference modeling for personalized search and discovery. Publications:
- W. Fan, P. Pathak, L. Wallace, Nonlinear ranking function representations in genetic programming-based ranking discovery for personalized Web search, Decision Support Systems, 42(3), 1338-1349, 2006.
- W. Fan, M. D. Gordon, P. Pathak, On linear mixture of experts approach to information retrieval, Decision Support Systems, 42(2), 975-987, 2006.
- W. Fan, M. D. Gordon, P. Pathak, An integrated two-stage model for intelligent information routing,” Decision Support Systems, 42(1), 362-374, 2006.
- M. D. Gordon, W. Fan, P. Pathak, Adaptive Web search: evolving a program that finds information, IEEE Intelligent Systems, 21(5), 72-77, 2006.
- A. Lacerda, M. Cristo, M. Gonçalves, W. Fan, N. Ziviani, Learning to advertise, in the Proceedings of the 29th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Seattle, WA, 2006.
- W. Fan, M. D. Gordon and P. Pathak,
Genetic programming based
discovery of ranking functions for effective web search,
Journal of Management Information Systems (JMIS),
21(4), pp. 37-56, 2005.
- W.
Fan, M. Luo, L. Wang, W. Xi, E. A. Fox,
Tuning before feedback: combining ranking function discovery and blind
feedback for robust retrieval, in the
Proceedings of the 27th Annual International ACM SIGIR Conference,
U. K., 2004.
- W. Fan, M. D. Gordon, P. Pathak, W. Xi and
E. A. Fox, Ranking function optimization for effective web search by genetic
programming: an empirical study, in the
Proceedings of 37th Hawaii International Conference on System Sciences (HICSS),
2004.
Nominated for the best conference paper.
- W. Fan, E. Fox and P. Pathak, H. Wu,
The
effects of fitness functions on genetic programming-based ranking discovery
for web search,
Journal of the American Society for Information Science and Technology,
55(7), 626-638, 2004.
- W. Fan, M. D. Gordon, P. Pathak, A generic ranking function discovery framework by genetic programming for
information retrieval,
Information
Processing and Management, 40(4), 587-602, 2004.
- W. Fan, M. D. Gordon, P. Pathak, Discovery of context-specific ranking functions for effective information
retrieval using genetic programming,
IEEE Transactions on Knowledge and Data Engineering,
16(4), 523-527, 2004.
- L. Wang, W. Fan, R. Yang, W. Xi, M. Luo, Y.
Zhou, E. A. Fox, Ranking function discovery by genetic programming for
robust retrieval, in the
Proceedings of the Twelfth TREC Conference,
2003
- W. Fan, M. D. Gordon, P. Pathak,
Personalization of search engine services for effective retrieval and
knowledge management, in the
Proceedings of the 2000 International Conference on Information Systems (ICIS),
2000, Brisbane, Australia.
- P. Pathak, M. D. Gordon, W. Fan,
Effective information retrieval using genetic
algorithms based matching function adaptation, in the
Proceedings of the 33rd Hawaii International Conference on System Science (HICSS),
2000, Hawaii, USA.
- W. Fan, M. D. Gordon, P. Pathak,
Automatic generation of matching functions by
genetic programming for effective information retrieval, in the Proceedings of the 1999 Americas Conference on Information Systems
, August 13-15, 1999, Milwaukee, WI, USA.
|