Accepted papers, tutorials, and workshops

Below is the list of papers accepted to CHIIR 2021 (in no particular order).

Go to: Full Papers; Perspective Papers; Short Papers; Demonstrations and Resources; Tutorials; Workshops; Doctoral Consortium

Full Papers

My Mouse, My Rules: Privacy Issues of Behavioral User Profiling via Mouse Tracking

Luis A. Leiva (Aalto University, Finland), Ioannis Arapakis (Telefonica Research, Spain), Costas Iordanou (Cyprus University of Technology, Cyprus)

Searching to Learn with Instructional Scaffolding

Arthur Câmara (Delft University of Technology, Netherlands), Nirmal Roy (Delft University of Technology, Netherlands), David Maxwell (Delft University of Technology, Netherlands), Claudia Hauff (Delft University of Technology, Netherlands)

Exploring Gaze-Based Prediction Strategies for Preference Detection in Dynamic Interface Elements

Melanie Heck (University of Mannheim, Germany), Janick Edinger (University of Hamburg, Germany), Jonathan Bünemann (University of Mannheim, Germany), Christian Becker (University of Mannheim, Germany)

The Effect of Nudges and Boosts on Browsing Privacy in a Naturalistic Environment

Anna-Marie Ortloff (University of Regensburg, Germany), Steven Zimmerman (University of Essex, United Kingdom), David Elsweiler (University of Regensburg, Germany), Niels Henze (University of Regensburg, Germany)

LuckyFind: Leveraging Surprise to Improve User Satisfaction and Inspire Curiosity in a Recommender System

Xi Niu (The University of North Carolina at Charlotte, USA), Ahmad Al-Doulat (The University of North Carolina at Charlotte, USA)

User Perceptions of an Intelligent Personal Assistant’s Personality

Irene Lopatovska (Pratt Institute, USA), Diedre Brown (Pratt Institute, USA), Elena Korshakova (Pratt Institute, USA), Yiqiao Li (Pratt Institute, USA), Jie Min (Pratt Institute, USA), Amber Pasiak (Pratt Institute, USA), Kaige Zheng (Pratt Institute, USA)

Query suggestions as summarization in exploratory search

Alan Medlar (University of Helsinki, Finland), Jing Li (University of Helsinki, Finland), Dorota Glowacka (University of Helsinki, Finland)

Tip of the Tongue Known-Item Retrieval: A Case Study in Movie Identification

Jaime Arguello (The University of North Carolina at Chapel Hill, USA), Adam Ferguson (Microsoft, Canada), Emery Fine (Microsoft, Canada), Bhaskar Mitra (Microsoft, Canada), Hamed Zamani (University of Massachusetts at Amhest, USA), Fernando Diaz (Microsoft, Canada)

I’ve Got All My Readers With Me: A Model of Reading as a Social Activity

Huiwen Zhang (The University of Melbourne, Australia), Dana McKay (The University of Melbourne, Australia), George Buchanan (The University of Melbourne, Australia)

Investigating the Influence of Ads on User Search Performance, Behaviour, and Experience during Information Seeking

Olivia Foulds (University of Strathclyde, United Kingdom), Leif Azzopardi (University of Strathclyde, United Kingdom), Martin Halvey (University of Strathclyde, United Kingdom)

Incorporating Active Reading Tools for Search As Learning

Nirmal Roy (TU Delft, Netherlands), Manuel Valle Torre (TU Delft, Netherlands), Ujwal Gadiraju (TU Delft, Netherlands), David Maxwell (TU Delft, Netherlands), Claudia Hauff (TU Delft, Netherlands)

An Intent Taxonomy for Questions Asked in Web Search

B. Barla Cambazoglu (RMIT University, Australia), Leila Tavakoli (RMIT University, Australia), Falk Scholer (RMIT University, Australia), Mark Sanderson (RMIT University, Australia), Bruce Croft (University of Massachusetts Amherst, USA)

Quantifying Human-Perceived Answer Utility in Non-factoid Question Answering

B. Barla Cambazoglu (RMIT University, Australia), Valeriia Baranova (RMIT University, Australia), Falk Scholer (RMIT University, Australia), Mark Sanderson (RMIT University, Australia), Leila Tavakoli (RMIT University, Australia), Bruce Croft (University of Massachusetts Amherst, USA)

OrgBox: A Knowledge Representation Tool to Support Complex Search Tasks

Bogeum Choi (The University of North Carolina at Chapel Hill, USA), Jaime Arguello (The University of North Carolina at Chapel Hill, USA), Robert Capra (The University of North Carolina at Chapel Hill, USA), Austin Ward (The University of North Carolina at Chapel Hill, USA)

Adaptation in Information Search and Decision-Making under Time Constraints

Anita Crescenzi (The University of North Carolina at Chapel Hill, USA), Robert Capra (The University of North Carolina at Chapel Hill, USA), Bogeum Choi (The University of North Carolina at Chapel Hill, USA), Yuan Li (The University of North Carolina at Chapel Hill, USA)

Perspective Papers

A Manifesto for Resource Re-Use in Interactive Information Retrieval

Toine Bogers (Aalborg University, Denmark), Maria Gaede (Humboldt-Universität zu Berlin, Berlin School of Library and Information Science, Germany), Mark Hall (The Information School, University of Sheffield, United Kingdom), Marijn Koolen (Royal Netherlands Academy of Arts and Sciences - Humanities Cluster, Netherlands), Vivien Petras (Humboldt-Universität zu Berlin, Germany)

Cognitive Biases in Search

Leif Azzopardi (University of Strathclyde, United Kingdom)

Recommenders with a mission: assessing diversity in news recommendations

Sanne Vrijenhoek (Universiteit van Amsterdam, Netherlands), Mesut Kaya (Independent, Turkey), Nadia Metoui (Universiteit van Amsterdam, Netherlands), Judith Möller (Universiteit van Amsterdam, Netherlands), Daan Odijk (RTL, Netherlands), Natali Helberger (Universiteit van Amsterdam, Netherlands)

Lady Chatterley’s Library: Books and Reading as Public Performance and Private Act

Dana McKay (The University of Melbourne, Australia), Michael Twidale (University of Illinois at Urbana-Champaign, USA), George Buchanan (The University of Melbourne, Australia)

Interest Development, Knowledge Learning, and Interactive IR: Toward a State-based Approach to Search as Learning

Jiqun Liu (University of Oklahoma, USA), Yong Ju Jung (University of Oklahoma, USA)

Untangling Cost, Effort, and Load in Information Seeking and Retrieval

Molly McGregor (University of Strathclyde, United Kingdom), Leif Azzopardi (University of Strathclyde, United Kingdom), Martin Halvey (University of Strathclyde, United Kingdom)

Rethinking Interest in Studies of Interactive Information Retrieval

Luanne Sinnamon (University of British Columbia, Canada), Limor Tamim (University of British Columbia, Canada), Samuel Dodson (University of British Columbia, Canada), Heather L. O'Brien (University of British Columbia, Canada)

Short Papers

Robust Visualisation of Dynamic Text Collections: Measuring and Comparing Dimensionality Reduction Algorithms

Tim Repke (Hasso Plattner Institute, University of Potsdam, Germany, Germany), Ralf Krestel (Hasso Plattner Institute, University of Potsdam, Germany, Germany)

Break the Loop: Gender Imbalance in Music Recommenders

Andres Ferraro (Universitat Pompeu Fabra, Spain), Xavier Serra (Universitat Pompeu Fabra, Spain), Christine Bauer (Utrecht University, Netherlands)

Starting Conversations with Search Engines - Interfaces that Elicit Natural Language Queries

Andrea Papenmeier (GESIS - Leibniz Institute of the Social Sciences, Germany), Alfred Sliwa (University of Duisburg-Essen, Germany), Dagmar Kern (GESIS - Leibniz Institute of the Social Sciences, Germany), Daniel Hienert (GESIS - Leibniz Institute of the Social Sciences, Germany), Ahmet Aker (University of Duisburg-Essen, Germany), Norbert Fuhr (University of Duisburg-Essen, Germany)

Classifying Speech Acts using Multi-channel Deep Attention Network for Task-oriented Conversational Search Agents

Souvick Ghosh (San José State University, USA), Satanu Ghosh (Independent Researcher, India)

Visually Linked Keywords to Support Exploratory Browsing

Soumya Shukla (University of Regina, Canada), Orland Hoeber (University of Regina, Canada)

Impact of Response Latency on User Behaviour in Mobile Web Search

Ioannis Arapakis (Telefonica Research, Spain), Souneil Park (Telefonica Research, Spain), Martin Pielot (Google, Germany)

Summary and prejudice: online reading preferences of users with intellectual disability

Saminda Balasuriya (Queensland University of Technology, Australia), Laurianne Sitbon (Queensland University of Technology, Australia), Jinglan Zhang (Queensland University of Technology, Australia), Khairi Anuar (Queensland University of Technology, Australia)

Needs for Relatedness: LGBTQ+ Individuals’ Information Seeking and Sharing in an Online Community

Romy Menghao Jia (University of South Australia, Australia), Jia Tina Du (University of South Australia, Australia), Yuxiang Chris Zhao (Nanjing University of Science and Technology, China)

Visualizing Searcher Gaze Patterns

Mustafa Abualsaud (University of Waterloo, Canada), Mark Smucker (University of Waterloo, Canada), Charles Clarke (University of Waterloo, Canada)

The Children's Perspective on How Emojis Help Them to Recognise Relevant Results: Do Actions Speak Louder Than Words?

Mohammad Aliannejadi (University of Amsterdam, Netherlands), Monica Landoni (Università della Svizzera italiana, Switzerland), Theo Huibers (University of Twente, Netherlands), Emiliana Murgia (Università degli Studi di Milano-Bicocca, Italy), Maria Soledad Pera (PIReT - Dept. of Computer Science, Boise State University, USA)

Dataset of Natural Language Queries for E-Commerce

Andrea Papenmeier (GESIS - Leibniz Institute of the Social Sciences, Germany), Alfred Sliwa (University of Duisburg-Essen, Germany), Dagmar Kern (GESIS - Leibniz Institute of the Social Sciences, Germany), Daniel Hienert (GESIS - Leibniz Institute of the Social Sciences, Germany), Ahmet Aker (University of Duisburg-Essen, Germany), Norbert Fuhr (University of Duisburg-Essen, Germany)

An analysis of information types and cognitive activities involved in cross-session search

Yuan Li (The University of North Carolina at Chapel Hill, USA), Austin Ward (The University of North Carolina at Chapel Hill, USA), Rob Capra (The University of North Carolina at Chapel Hill, USA)

Bridging Task Expressions and Search Queries

Chirag Shah (University of Washington, USA), Ryen White (Microsoft, USA)

The "Active Search" Hypothesis: How Search Strategies Relate to Creative Learning

Srishti Palani (University of California, San Diego, USA), Zijian Ding (University of California, San Diego, USA), Stephen Macneil (University of California, San Diego, USA), Steven Dow (University of California, San Diego, USA)

Demonstrations and Resources

Different Keystrokes for Different Folks: Visualizing Crowdworker Querying Behavior

Rodger Benham (RMIT University, Australia), Joel Mackenzie (The University of Melbourne, Australia), J. Shane Culpepper (RMIT University, Australia), Alistair Moffat (The University of Melbourne, Australia)

Supporting Cross-Session Cross-Device Search in an Academic Digital Library

Sebastian Gomes (University of Regina, Canada), Orland Hoeber (University of Regina, Canada)

Tutorials

User Models, Metrics and Measures of Search: A Tutorial on the CWL Evaluation Framework

  • Leif Azzopardi (University of Strathclyde)
  • Alistair Moffat (The University of Melbourne)
  • Paul Thomas (Microsoft)
  • Guido Zuccon (The University of Queensland)

Evaluation is central to Information Retrieval, and is how we compare the quality of systems. One important principle of evaluation is that the measured score should reflect the user's experience with the system, and hence, conversely, that there should be a connection between the way that the system's users are modeled as behaving, and the characteristics of the metric. In this tutorial we will introduce the CWL approach to user modelling, and describe the recent approaches to evaluation that it has facilitated. The tutorial will be presented as a mix of live-to-camera presentation, recorded in-depth videos, and hands-on activities using the CWL toolkit for your own evaluation tasks. A followup consultation session will also be provided, to allow extended questions and individual discussion with the four presenters.

Between Rigour and Ethics in Studies Involving Participants With Disabilities: A Tutorial

  • Gerd Berget (Oslo Metropolitan University)
  • Andrew MacFarlane (City, University of London)

Research is conducted within the field of interactive information retrieval on a broad diversity of users, with more interest recently in working with minority groups, such as people with disabilities. The tutorial addresses best practice when conducting research on cohorts that might be regarded as “vulnerable participants”. Previous research has showed that rigorous experiments for all types of users can be difficult, and there are many issues to be raised with regard to the tension between rigor and ethics. The tutorial examines these issues by engaging attendees with particular groups using scenarios and personas.

The PhD Journey: Reaching Out and Lending a Hand

  • Johanne R. Trippas (University of Melbourne)
  • David Maxwell (Delft University of Technology)

A PhD student over their candidature develops many new skills, including: (i) advancing research ideas; (ii) conducting research; (iii) engaging with others about their research — locally and internationally; (iv) developing a profile as an independent researcher; and (v) developing their teaching portfolio. Ofcourse, a candidate is likely to encounter many highs and lows during their candidature. This tutorial will aim to introduce techniques to help advance the PhD process. It will empower attendees to share their own do’s and don’ts, review their practices for success, and refine productivity strategies. It will provide an impartial platform for an open and honest discussion about the PhD journey.

Workshops

BIRDS 2021—Bridging the Gap between Information Science, Information Retrieval and Data Science

  • Ingo Frommholz (University of Bedfordshire)
  • Haiming Liu (University of Bedfordshire)
  • Massimo Melucci (University of Padua)

BIRDS — Bridging the Gap between Information Science, Information Retrieval and Data Science — aims to foster the cross-fertilization of Information Science (IS), Information Retrieval (IR), Human-computer Interaction (HCI) and Data Science (DS). Recognizing the commonalities and differences between these communities, the full-day workshop will bring together experts and researchers in IS, IR, HCI and DS to discuss how they can learn from each other to provide more human-driven data and information exploration and retrieval solutions. Therefore, we welcome submissions conveying interdisciplinary ideas on how to utilize, for instance, IS and HCI concepts and theories in IR and/or DS approaches to support users in data and information access, exploration and analysis.

Third Workshop on Evaluation of Personalisation in Information Retrieval (WEPIR 2021)

  • Gareth Jones (Dublin City University)
  • Nicholas Belkin (Rutgers University)
  • Noriko Kando (National Institute of Informatics, Tokyo)
  • Gabriella Pasi (University of Milando-Bicocca)

The Third Workshop on Evaluation of Personalisation in Information Retrieval (WEPIR 2021) at CHIIR 2021 will bring together researchers interested in developing methods for the evaluation of personalisation in information retrieval. WEPIR 2021 will build on the successful previous WEPIRs at CHIIR 2018 and CHIIR 2019, and will have a strong emphasis on active participation by workshop attendees. The focus of WEPIR 2021 will be on the exploration of a number of specific use cases in the evaluation of personalisation in information retrieval. Workshop participants will be assigned to a breakout group to work together on the development of a method to address one of the use cases. Each group will seek to identify specific relevant factors relating to their use case in terms of factors including user activities, data to be collected, ethical issues, and evaluation metrics. Groups will share their findings in a final plenary session. The overall goal of the workshop is to work towards developing a general set of principles and guidelines for addressing the evaluation of specific instances of the use of personalisation in information retrieval tasks.

Future Conversations

  • Johanne Trippas (University of Melbourne)
  • Paul Thomas (Microsoft)
  • Damiano Spina (RMIT University)
  • Hideo Joho (University of Tsukuba)

The Future Conversations workshop at CHIIR’21 looks to the future of search, recommendation, and information interaction to ask: where are the opportunities for conversational interactions? What do we need to do to get there? Furthermore, who stands to benefit? The workshop will be hands-on and interactive. Rather than a series of technical talks, we are soliciting position statements on opportunities, problems, and solutions in conversational search in all modalities (written, spoken, or multimodal). Each attendee will have the chance to write a position statement, and each statement will be critiqued by another attendee to kick-start the discussion.

Made to Measure: A Workshop on Human-Centred Metrics for Information Seeking

  • George Buchanan (University of Melbourne)
  • Dana McKay (University of Melbourne)
  • Charlie Clarke (University of Waterloo)
  • Leif Azzopardi (Strathclyde University)
  • Johanne Trippas (University of Melbourne)

Search engines are predominantly made to measure: The key axis of development in over 40 years of information retrieval research has been improvements in precision, recall, click rates and other technical measures of their performance. From the perspective of understanding human and software as two parts of an interactive, work to understand humans and their needs is a vital part of the whole, and yet this is currently not so widely measured. Human effort, experience and behaviour are all vital elements of interactive information work that would similarly benefit from metrication and measurement.

This workshop aims to understand and diversify what can be measured, and discuss how the measuring might result in real improvements to information interfaces for the human beings that use them. We are interested in search, browsing, serendipity, collection overview, synthesis and any other information work that involves humans working with computers. New, radical and tentative ideas for measurement are all welcome.

Doctoral Consortium

Integration of Images into the Patent Retrieval Process

Wiebke Thode (University of Hildesheim, Germany)

Toward a Conceptual Model for Users’ Online Open Government Data Interaction

Fanghui Xiao (University of Pittsburgh, USA)

Context-independent Representation of Task

Shawon Sarkar (University of Washington, USA)

A Longitudinal Study to Understand Learning During Search

Nilavra Bhattacharya (The University of Texas at Austin, USA)

Information Use and the Shaping of Archives

Alexandra Leigh (City, University of London / The National Archives, United Kingdom)