UT Libraries Faculty: Other Publications and Presentations
Source Publication
2025 Charleston Conference
Document Type
Poster
Publication Date
Fall 11-5-2025
DOI
https://doi.org/10.17605/OSF.IO/6JHR5
Abstract
In the fall of 2025, five librarians at the University of Tennessee Knoxville Libraries gathered to conduct research on how ChatGPT can be used to evaluate open access journals. 18 diamond open access Library and Information Science journals were chosen using filters from the Directory of Open Access Journals. We developed a set of journal quality criteria based on the OASPA’s “Principles of Transparency and Best Practice in Scholarly Publishing.” We then created two main rubrics: one rubric for the human researchers and ChatGPT to evaluate journal quality based on the established set of criteria, and one rubric for the human researchers to measure how ChatGPT performed in its evaluation. A poster depicting our study results was accepted to the 2025 Charleston Conference.
Recommended Citation
Chin, Olivia; Wood, Mikayla; Gavel, Sidney; McDonald, Luke; and Harriman, Alexander, "Man vs. Machine: Evaluating Open Access LIS Journals" (2025). UT Libraries Faculty: Other Publications and Presentations.
https://trace.tennessee.edu/utk_libfac/20
Included in
Information Literacy Commons, Scholarly Communication Commons, Scholarly Publishing Commons