ChatGPT-Assisted Information Retrieval: A Comparative Study of User Behavior in Academic Information Retrieval

Zhao Liu, Xuyan Wang, Lei Li

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

This study explores the differences in user behavior between ChatGPT-Assisted and traditional information retrieval modes during academic research. By setting up five academic information retrieval tasks with varying cognitive levels remembering, understanding, analyzing, evaluating, and creating and recruiting 20 first-year master's students, the participants were randomly assigned to complete the tasks under one of the retrieval modes. The results indicate that in each task type, the ChatGPT-Assisted mode reduced the number of clicks on the search engine results page, the number of URLs visited, the duration of URL browsing, and the total retrieval time, suggesting that ChatGPT assistance can enhance retrieval efficiency. Further analysis revealed that the assistance effect of ChatGPT was more significant in remembering, understanding, and creating tasks. This study supports the necessity and feasibility of further exploring ChatGPT's application in the field of information retrieval.

Original languageEnglish
Title of host publicationJCDL 2024 - Proceedings of the 24th ACM/IEEE Joint Conference on Digital Libraries
EditorsJian Wu, Xiao Hu, Terhi Nurmikko-Fuller, Sam Chu, Ruixian Yang, J. Stephen Downie
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9798400710933
DOIs
StatePublished - 13 Mar 2025
Externally publishedYes
Event24th ACM/IEEE Joint Conference on Digital Libraries, JCDL 2024 - Hong Kong, Hong Kong
Duration: 16 Dec 202420 Dec 2024

Publication series

NameProceedings of the ACM/IEEE Joint Conference on Digital Libraries
ISSN (Print)1552-5996

Conference

Conference24th ACM/IEEE Joint Conference on Digital Libraries, JCDL 2024
Country/TerritoryHong Kong
CityHong Kong
Period16/12/2420/12/24

Keywords

  • ChatGPT-Assisted information retrieval
  • Experimental study
  • User behavior

Fingerprint

Dive into the research topics of 'ChatGPT-Assisted Information Retrieval: A Comparative Study of User Behavior in Academic Information Retrieval'. Together they form a unique fingerprint.

Cite this