Talk by Dr. Kanoulas

We are going to have a talk by Dr. Evangelos Kanoulas (Google, Zurich) on Monday 13 January, 14h00 - 15h00 in the south campus (details below).

There will be cake in the kitchen before the talk (around 13h00), where you can meet the speaker. There will also be a dinner the evening after the talk in central Copenhagen. Let me know if you are interested in joining.

Title: Simulations for Information Retrieval Experimentation


Information retrieval effectiveness evaluation typically takes one of two forms: batch experiments based on static test collections, or online experiments tracking user's interactions with a live system. Test collection experiments are sometimes viewed as introducing too many simplifying assumptions to accurately predict the usefulness of a system to its users. As a result, there is great interest in creating test collections that better model the variability encountered in real-life search scenarios. This includes experimenting over a variety of queries, corpora or even users and their interactions with the search results. In this talk I will discuss different ways of incorporating user behaviour in batch experimentation, how to model the variance introduced to measurements of effectiveness, and how to extend our statistical significance test arsenal to allow comparing retrieval algorithms.


Evangelos Kanoulas is a postdoc research scientist at Google Zurich. Prior to that he was a research associate at the Information School of the University of Sheffield. He obtained his PhD from Northeastern University in 2009. His research interests lie in Information Retrieval and Natural Language Processing. He has published research papers and organized tutorials/workshops at major information retrieval venues such as SIGIR, CIKM and ECIR. He is the recipient of a Marie Curie International Incoming Fellowship (2010). Further, Evangelos was actively involved in coordinating the TREC Million Query Track (2007-2009), while he is one of the coordinators for the TREC Session Track (2010-2014).

Google Scholar:



Room 24-5-62, DIKU south campus, Njalsgade 128, Copenhagen, DK-2300

Date & Time:

Monday 13 January 2014, 14h00 - 15h00.