Effectiveness of academic library research guides for building college students’ information literacy skills: A scoping review

Erica Lynn DeFrain, Leslie Sult, Nicole Pagowsky

Abstract

Academic library research guides, ubiquitous tools for teaching information literacy, lack robust evidence for their effectiveness. This scoping review considered 1,724 publications, ultimately reporting on findings from 61 studies meeting inclusion criteria. Studies reviewed were highly individualized and primarily exploratory and correlational, with most using mixed methods designs analyzing data from student surveys and web traffic sources. Most studies focused on student satisfaction or guide usability as indicators of learning effectiveness, with few assessments of skills acquisition. We undertook this scoping review to assist practitioners in developing more impactful learning tools and practices as they create and assess guides.

Keywords

Library Instruction and Information Literacy; Assessment and Evaluation

References

Almeida, N., & Tidal, J. (2017). Mixed methods not mixed messages: Improving LibGuides with student usability data. Evidence Based Library & Information Practice, 12(4), 62–77. https://doi.org/10.18438/B8CD4T

Archer, J., Hanlon, A. M., & Levine, J. A. (2009). Investigating primary source literacy. The Journal of Academic Librarianship, 35(5), 410–420. https://doi.org/10.1016/j.acalib.2009.06.017

Arksey, H., & O’Malley, L. (2005). Scoping studies: Towards a methodological framework. International Journal of Social Research Methodology, 8(1), 19–32. https://doi.org/10.1080/1364557032000119616

Baker, R. L. (2014). Designing LibGuides as instructional tools for critical thinking and effective online learning. Journal of Library & Information Services in Distance Learning, 8(3/4), 107–117. https://doi.org/10.1080/1533290X.2014.944423

Barker, A. E. G., & Hoffman, A. T. (2021). Student-centered design: Creating LibGuides students can actually use. College & Research Libraries, 82(1), 75–91. https://doi.org/10.5860/crl.82.1.75

Becker, D. A., Arendse, J., Tshetsha, V., Davids, Z., & Kiva-Johnson, V. (2022). The development of LibGuides at Cape Peninsula University of Technology Libraries and the impact of the COVID-19 lockdown on their usage. IFLA Journal, 48(1), 57–68. https://doi.org/10.1177/03400352211046025

Becker, D., Hartle, H., & Mhlauli, G. (2017). Assessment of use and quality of library services, accessibility and facilities by students at Cape Peninsula University of Technology. South African Journal of Libraries & Information Science, 83(1), 11–25. https://doi.org/10.7553/83-1-1642

Bisalski, H. C., Helms, M. M., & Whitesell, M. (2017). Preparing undergraduate students for the major field test in business. Journal of Education for Business, 92(1), 9–15. https://doi.org/10.1080/08832323.2016.1261791

Bowen, A. (2012). A LibGuides presence in a Blackboard environment. Reference Services Review, 40(3), 449–468. https://doi.org/10.1108/00907321211254698

Bowen, A. (2014). LibGuides and web-based library guides in comparison: Is there a pedagogical advantage? Journal of Web Librarianship, 8(2), 147–171. https://doi.org/10.1080/19322909.2014.903709

Bowen, A., Ellis, J., & Chaparro, B. (2018). Long nav or short nav? Student responses to two different navigational interface designs in LibGuides version 2. Journal of Academic Librarianship, 44(3), 391–403. https://doi.org/10.1016/j.acalib.2018.03.002

Brewer, L., Rick, H., & Grondin, K. A. (2017). Improving digital library experiences and support with online research guides. Online Learning, 21(3), 135–150. https://doi.org/10.24059/olj.v21i3.1237

Carey, J., Pathak, A., & Johnson, S. C. (2020). Use, perceptions, and awareness of LibGuides among undergraduate and graduate health professions students. Evidence Based Library & Information Practice, 15(3), 157–172. https://doi.org/10.18438/eblip29653

Chiware, M. (2014). The efficacy of course-specific library guides to support essay writing at the University of Cape Town. South African Journal of Libraries & Information Science, 80(2), 27–35. https://doi.org/10.7553/80-2-1522

Cobus-Kuo, L., Gilmour, R., & Dickson, P. (2013). Bringing in the experts: Library research guide usability testing in a computer science class. Evidence Based Library & Information Practice, 8(4), 43–59. https://doi.org/10.18438/B8GP5W

Courtois, M. P., Higgins, M. E., & Kapur, A. (2005). Was this guide helpful? Users’ perceptions of subject guides. Reference Services Review, 33(2), 188–196. https://doi.org/10.1108/00907320510597381

Craane, B., Dijkstra, P. U., Stappaerts, K., & De Laat, A. (2012). Methodological quality of a systematic review on physical therapy for temporomandibular disorders: Influence of hand search and quality scales. Clinical Oral Investigations, 16(1), 295–303. https://doi.org/10.1007/s00784-010-0490-y

Dalton, M., & Pan, R. (2014). Snakes or ladders? Evaluating a LibGuides pilot at UCD Library. Journal of Academic Librarianship, 40(5), 515–520. https://doi.org/10.1016/j.acalib.2014.05.006

Daly, E. (2010). Embedding library resources into learning management systems: A way to reach Duke undergrads at their points of need. College & Research Libraries News, 71(4), 208–212. https://doi.org/10.5860/crln.71.4.8358

DeFrain, E., Sult, L., & Pagowsky, N. (2022). Effectiveness of academic library research guides for building college students’ information literacy skills: A scoping review protocol. https://doi.org/10.17605/OSF.IO/2SMQ4

Dotson, D. S. (2021). LibGuides gone viral: A giant LibGuides project during remote working. Science & Technology Libraries, 40(3), 243–259. https://doi.org/10.1080/0194262X.2021.1884169

Dunsmore, C. (2002). A qualitative study of web-mounted pathfinders created by academic business libraries. Libri, 52(3). https://doi.org/10.1515/LIBR.2002.137

Fagerheim, B., Lundstrom, K., Davis, E., & Cochran, D. (2017). Extending our reach: Automatic integration of course and subject guides. Reference & User Services Quarterly, 56(3), 180–188. https://doi.org/10.5860/rusq.56n3.180

Gardner, J. J. (1977). Pathfinders, Library. In A. Kent, H. Lancour, J. E. Daily, & W. Z. Nasri (Eds.), Encyclopedia of library and information science (Vol. 21, pp. 468–473). Dekker.

Gardois, P., Colombi, N., Grillo, G., & Villanacci, M. C. (2012). Implementation of Web 2.0 services in academic, medical and research libraries: A scoping review. Health Information & Libraries Journal, 29(2), 90–109. https://doi.org/10.1111/j.1471-1842.2012.00984.x

German, E., Grassian, E., & LeMire, S. (2017). LibGuides for instruction A service design point of view from an academic library. Reference & User Services Quarterly, 56(3), 162-167.

Gerrish, T., & Martin, S. (2023). Student preferences for reference services at a remote biological station library. Portal: Libraries & the Academy, 23(4), 637–653. https://doi.org/10.1353/pla.2023.a908695

Gibbons, S. (2003). Building upon the MyLibrary concept to better meet the information needs of college students. D-Lib Magazine, 9(3). https://doi.org/10.1045/march2003-gibbons

Gilman, N. V., Sagàs, J., Camper, M., & Norton, A. P. (2017). A faculty-librarian collaboration success story: Implementing a teach-the-teacher library and information literacy instruction model in a first-year agricultural science course. Library Trends, 65(3), 339–358. https://doi.org/10.1353/lib.2017.0005

Goodsett, M. (2020). Best practices for teaching and assessing critical thinking in information literacy online learning objects. The Journal of Academic Librarianship, 46(5), 102163. https://doi.org/10.1016/j.acalib.2020.102163

Greenwell, S. (2016). Using the I-LEARN model for information literacy instruction. Journal of Information Literacy, 10(1), 67–85.

Griffin, M., & Taylor, T. I. (2018). Employing analytics to guide a data-driven review of LibGuides. Journal of Web Librarianship, 12(3), 147–159.

Hansen, L. A. (2014). Second-language writer and instructor perceptions of the effectiveness of a curriculum-integrated research skills library guide [M.A., The University of Utah].

Harbeson, E. L. (1972). Teaching reference and bibliography: The pathfinder approach. Journal of Education for Librarianship, 13(2), 111. https://doi.org/10.2307/40322211

Head, A., & Eisenberg, M. (2010). Assigning Inquiry: How Handouts for Research Assignments Guide Today’s College Students (SSRN Scholarly Paper ID 2281494). Social Science Research Network. https://doi.org/10.2139/ssrn.2281494

Hemmig, W. (2005). Online pathfinders: Toward an experience-centered model. Reference Services Review, 33(1), 66–87.

Hennesy, C., & Adams, A. L. (2021). Measuring actual practices: A computational analysis of LibGuides in academic libraries. Journal of Web Librarianship, 15(4), 219–242. https://doi.org/10.1080/19322909.2021.1964014

Hintz, K., Farrar, P., Eshghi, S., Sobol, B., Naslund, J.-A., Lee, T., Stephens, T., & McCauley, A. (2010). Letting students take the lead: A user-centred approach to evaluating subject guides. Evidence Based Library & Information Practice, 5(4), 39–52. https://doi.org/10.18438/B87C94

Hoffmann, T. C., Glasziou, P. P., Boutron, I., Milne, R., Perera, R., Moher, D., Altman, D. G., Barbour, V., Macdonald, H., Johnston, M., Lamb, S. E., Dixon-Woods, M., McCulloch, P., Wyatt, J. C., Chan, A.-W., & Michie, S. (2014). Better reporting of interventions: Template for intervention description and replication (TIDieR) checklist and guide. BMJ (Clinical Research Ed.), 348, g1687. https://doi.org/10.1136/bmj.g1687

Hsieh, M. L., Dawson, P. H., Hofmann, M. A., Titus, M. L., & Carlin, M. T. (2014). Four pedagogical approaches in helping students learn information literacy skills. Journal of Academic Librarianship, 40(3/4), 234–246. https://doi.org/10.1016/j.acalib.2014.03.012

Jackson, R., & Stacy-Bates, K. K. (2016). The Enduring landscape of online subject research guides. Reference & User Services Quarterly, 55(3), 219. https://doi.org/10.5860/rusq.55n3.219

Kline, E., Wallace, N., Sult, L., & Hagedon, M. (2017). Embedding the library in the LMS: Is it a good investment for your organization’s information literacy program? In T. Maddison & M. Kumaran (Eds.), Distributed Learning (pp. 255–269). Chandos Publishing. https://doi.org/10.1016/B978-0-08-100598-9.00014-3

Lauseng, D. L., Howard, C., Scoulas, J. M., & Berry, A. (2021). Assessing online library guide use and open educational resource (oer) potential: An evidence-based decision-making approach. Journal of Web Librarianship, 15(3), 128–153. https://doi.org/10.1080/19322909.2021.1935396

Lee, J., Hayden, K. A., Ganshorn, H., & Pethrick, H. (2021). A Content analysis of systematic review online library guides. Evidence Based Library and Information Practice, 16(1), 60–77. https://doi.org/10.18438/eblip29819

Lee, L., Hime, L., & Dominicis, E. (2003). Just-in-time course guides. Florida Libraries, 46(2), 8–10.

Lee, Y. Y., & Lowe, M. S. (2018). Building positive learning experiences through pedagogical research guide design. Journal of Web Librarianship, 12(4), 205–231. https://doi.org/10.1080/19322909.2018.1499453

Leighton, H. V., & May, D. (2013). The Library course page and instruction: Perceived helpfulness and use among students. Internet Reference Services Quarterly, 18(2), 127–138. https://doi.org/10.1080/10875301.2013.804019

Li, Y. (2016). Using new venture competitions to link the library and business students. Qualitative & Quantitative Methods in Libraries, 5(3), 551–559.

Lierman, A., Scott, B., Warren, M., & Turner, C. (2019). Testing for transition: Evaluating the usability of research guides around a platform migration. Information Technology & Libraries, 38(4), 76–97. https://doi.org/10.6017/ital.v38i4.11169

Lilly. (2022, May 2). 15 Years of Springshare! The Springy Share. https://blog.springshare.com/2022/05/02/15-years-of-springshare/

Little, J. (2010). Cognitive load theory and library research guides. Internet Reference Services Quarterly, 15(1), 53–63.

Magi, T. J. (2003). What’s best for students? Comparing the effectiveness of a traditional print pathfinder and a web-based research tool. Portal: Libraries and the Academy, 3(4), 671–686. https://doi.org/10.1353/pla.2003.0090

Mahaffy, M. (2012). Student use of library research guides following library instruction. Communications in Information Literacy, 6(2), 202–213. https://doi.org/10.15760/comminfolit.2013.6.2.129

Metter, E., & Willis, E. (1993). Creating a handbook for an academic library: Rationale and process. Research Strategies, 11(4), 32–220.

Miles, M. J., & Bergstrom, S. J. (2009). Classification of library resources by subject on the library website: Is there an optimal number of subject labels? Information Technology & Libraries, 28(1), 16–20. https://doi.org/10.6017/ital.v28i1.3167

Miller, L. N. (2014). First year medical students use library resources emphasized during instruction sessions. Evidence Based Library & Information Practice, 9(1), 48–50. https://doi.org/10.18438/B8F316

Miner, J., & Alexander, R. (2010). LibGuides in political science: Improving student access, research, and information literacy. Journal of Information Literacy, 4(1), 40–54. https://doi.org/10.11645/4.1.1467

Mubofu, C., & Malekani, A. (2021). Accessibility of library resources and support services by distance learners. Journal of Library & Information Services in Distance Learning, 15(4), 267–279. https://doi.org/10.1080/1533290X.2021.2021345

Murphy, S. A., & Black, E. L. (2013). Embedding guides where students learn: Do design choices and librarian behavior make a difference? Journal of Academic Librarianship, 39(6), 528–534. https://doi.org/10.1016/j.acalib.2013.06.007

Mussell, J., & Croft, R. (2013). Discovery layers and the distance student: Online search habits of students. Journal of Library & Information Services in Distance Learning, 7(1/2), 18–39. https://doi.org/10.1080/1533290X.2012.705561

Nicholson, K. P. (2017, October 26). The “Value Agenda”: Negotiating a Path Between Compliance and Critical Practice [[Keynote]]. Canadian Libraries Assessment Workshop (CLAW), University of Victoria.

Oakleaf, M. J. (2010). The value of academic libraries: A comprehensive research review and report. Association of College and Research Libraries, American Library Association.

Olshausen, M. (2018). A statistical approach to assessing research guide use at Central Washington University. PNLA Quarterly, 82(3/4), 23–34.

Ouellelte, D. (2011). Subject Guides in Academic Libraries: A User-Centred Study of Uses and Perceptions. Les Guides Par Sujets Dans Les Bibliothèques Académiques : Une Étude Des Utilisations et Des Perceptions Centrée Sur l’utilisateur., 35(4), 436–451.

Pagowsky, N. (2021). The contested one-shot: Deconstructing power structures to imagine new futures. College & Research Libraries. https://doi-org.libproxy.unl.edu/10.5860/crl.82.3.300

Paschke-Wood, J., Dubinsky, E., & Sult, L. (2020). Creating a student-centered alternative to research guides: Developing the infrastructure to support novice learners. In the Library with the Lead Pipe.

Paul, S., Wright, L. B., & Clevenger-Schmertzing, L. (2020). Going the distance: Flipped classrooms and the research appointment. Southeastern Librarian, 68(3), 3–13.

Peters, M. D. J., Godfrey, C., McInerney, P., Khalil, H., Larsen, P., Marnie, C., Pollock, D., Tricco, A. C., & Munn, Z. (2022). Best practice guidance and reporting items for the development of scoping review protocols. JBI Evidence Synthesis, 20(4), 953–968. https://doi.org/10.11124/JBIES-21-00242

Pickens-French, K., & Mcdonald, K. (2013). Changing trenches, changing tactics: A library’s frontline redesign in a new cms. Journal of Library & Information Services in Distance Learning, 7(1/2), 53–72. https://doi.org/10.1080/1533290X.2012.705613

Rafferty, R. S. (2013). The impact of library instruction: Do first-year medical students use library resources specifically highlighted during instructional sessions? Journal of the Medical Library Association, 101(3), 213–217. https://doi.org/10.3163/1536-5050.101.3.011

Rothstein, S. (1989). Point of need/maximum service: An experiment in library instruction. Reference Librarian, 25–26, 253–284.

Scoulas, J. M. (2021). STEM undergraduate students: Library use, perceptions and GPA. Performance Measurement & Metrics, 22(2), 137–148. https://doi.org/10.1108/PMM-04-2020-0021

Sharrar, G. S. (2017). Are course pages useful? Getting beyond implementation and usability. UNC Chapel Hill Theses, MP4449–MP4449.

Singal, A. G., Higgins, P. D. R., & Waljee, A. K. (2014). A Primer on Effectiveness and Efficacy Trials. Clinical and Translational Gastroenterology, 5(1), e45. https://doi.org/10.1038/ctg.2013.13

Sinkinson, C., Alexander, S., Hicks, A., & Kahn, M. (2012). Guiding design: Exposing librarian and student mental models of research guides. portal: Libraries and the Academy, 12(1), 63–84. https://doi.org/10.1353/pla.2012.0008

Slemons, M. H. (2013). Design standards for LibGuides: Does better design lead to greater use? [Master’s, University of North Carolina at Chapel Hill].

Smith, C. H. (2007). Meta-assessment of online research guides usage. Reference Librarian, 47(1), 79–93. https://doi.org/10.1300/J120v47n97_08

Soskin, M. D., & Eldblom, N. (1984). Integrating the Term Paper into Economics Courses at Liberal Arts Colleges: Industry Case Studies Papers at SUNY-Potsdam (63454646; ED246732; pp. 1–30).

Stewart, C. (2022). Future states of the research library. 303, 3–11. https://doi.org/10.29242/rli.303.1

Stone, S. M., Sara Lowe, M., & Maxson, B. K. (2018). Does course guide design impact student learning? College & Undergraduate Libraries, 25(3), 280–296. https://doi.org/10.1080/10691316.2018.1482808

Tang, Y., & Tseng, H. W. (2014). Distance students’ attitude toward library help seeking. Journal of Academic Librarianship, 40(3/4), 307–312. https://doi.org/10.1016/j.acalib.2014.04.008

Taylor, A., Nelson, J., O’Donnell, S., Davies, E., & Hillary, J. (2022). The Skills Imperative 2035: What does the literature tell us about essential skills most needed for work? National Foundation for Educational Research.

Thomas, J., Kneale, D., McKenzie, J. E., Brennan, S. E., & Soumyadeep, B. (2023). Chapter 2: Determining the scope of the review and the questions it will address. In: Higgins JPT, Thomas J, Chandler J, Cumpston M, Li T, Page MJ, Welch VA (editors). (Updated August 2023). Cochrane, 2023. Available from. In J. Higgins, J. Thomas, J. Chandler, M. Cumpston, T. Li, M. Page, & V. Welch (Eds.), Cochrane Handbook for Systematic Reviews of Interventions version 6.4. Cochrane. https://www.training.cochrane.org/handbook

Thorngate, S., & Hoden, A. (2017). Exploratory usability testing of user interface options in LibGuides 2. College & Research Libraries, 78(6), 844–861. https://doi.org/10.5860/crl.78.6.844

Tomlin, N., Tewell, E., Mullins, K., & Dent, V. (2017). In their own voices: An ethnographic perspective on student use of library information sources. Journal of Library Administration, 57(6), 631–650. https://doi.org/10.1080/01930826.2017.1340776

Tricco, A. C., Lillie, E., Zarin, W., K. O’Brien, K., Colquhoun, H., Levac, D., Moher, D., D.J. Peters, M., Horsley, T., Weeks, L., Hempel, S., A. Akl, E., Chang, C., McGowan, J., Stewart, L., Hartling, L., Aldcroft, A., G. Wilson, M., Garritty, C., … E. Straus, S. (2018). PRISMA Extension for Scoping Reviews (PRISMA-ScR): Checklist and Explanation. Annals of Internal Medicine. https://doi.org/10.7326/M18-0850

Vassar, M., Atakpo, P., & Kash, M. J. (2016). Manual search approaches used by systematic reviewers in dermatology. Journal of the Medical Library Association: JMLA, 104(4), 302–304. https://doi.org/10.3163/1536-5050.104.4.009

Vileno, L. (2007). From paper to electronic, the evolution of pathfinders: A review of the literature. Reference Services Review, 35(3), 434–451. https://doi.org/10.1108/00907320710774300

Wharton, L., & Pritchard, M. (2020). A successful long-term relationship: Three years of LTI integrations in Canvas. Journal of Electronic Resources Librarianship, 32(4), 286–303. https://doi.org/10.1080/1941126X.2020.1821993

Wineburg, S., Breakstone, J., McGrew, S., Smith, M. D., & Ortega, T. (2022). Lateral reading on the open Internet: A district-wide field study in high school government classes. Journal of Educational Psychology. https://doi.org/10.1037/edu0000740

Copyright Erica Lynn DeFrain, Leslie Sult, Nicole Pagowsky


Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.

Article Views (By Year/Month)