Information retrieval, experimental models and statistical analysis

This paper introduces some of the considerations behind the teaching of research methodology at the Royal School of Library and Information Science at the masters level. The module in research methodology is illustrated in relation to information retrieval experiments. Theoretical and practical problems with experimental settings are analysed in relation to the different approaches of information retrieval research. Sampling problems are extremely relevant both for teaching research methodology and for planning investigations in information retrieval. The concept of a model is introduced and also the elements of the topics of the statistical part of the module in relation to typical research questions in information retrieval.