Effectiveness of academic library research guides for building college students’ information literacy skills: A scoping review
Abstract
Academic library research guides, ubiquitous tools for teaching information literacy, lack robust evidence for their effectiveness. This scoping review considered 1,724 publications, ultimately reporting on findings from 61 studies meeting inclusion criteria. Studies reviewed were highly individualized and primarily exploratory and correlational, with most using mixed methods designs analyzing data from student surveys and web traffic sources. Most studies focused on student satisfaction or guide usability as indicators of learning effectiveness, with few assessments of skills acquisition. We undertook this scoping review to assist practitioners in developing more impactful learning tools and practices as they create and assess guides.
Keywords
References
Almeida, N., & Tidal, J. (2017). Mixed methods not mixed messages: Improving LibGuides with student usability data. Evidence Based Library & Information Practice, 12(4), 62–77. https://doi.org/10.18438/B8CD4T
Archer, J., Hanlon, A. M., & Levine, J. A. (2009). Investigating primary source literacy. The Journal of Academic Librarianship, 35(5), 410–420. https://doi.org/10.1016/j.acalib.2009.06.017
Arksey, H., & O’Malley, L. (2005). Scoping studies: Towards a methodological framework. International Journal of Social Research Methodology, 8(1), 19–32. https://doi.org/10.1080/1364557032000119616
Baker, R. L. (2014). Designing LibGuides as instructional tools for critical thinking and effective online learning. Journal of Library & Information Services in Distance Learning, 8(3/4), 107–117. https://doi.org/10.1080/1533290X.2014.944423
Barker, A. E. G., & Hoffman, A. T. (2021). Student-centered design: Creating LibGuides students can actually use. College & Research Libraries, 82(1), 75–91. https://doi.org/10.5860/crl.82.1.75
Becker, D. A., Arendse, J., Tshetsha, V., Davids, Z., & Kiva-Johnson, V. (2022). The development of LibGuides at Cape Peninsula University of Technology Libraries and the impact of the COVID-19 lockdown on their usage. IFLA Journal, 48(1), 57–68. https://doi.org/10.1177/03400352211046025
Becker, D., Hartle, H., & Mhlauli, G. (2017). Assessment of use and quality of library services, accessibility and facilities by students at Cape Peninsula University of Technology. South African Journal of Libraries & Information Science, 83(1), 11–25. https://doi.org/10.7553/83-1-1642
Bisalski, H. C., Helms, M. M., & Whitesell, M. (2017). Preparing undergraduate students for the major field test in business. Journal of Education for Business, 92(1), 9–15. https://doi.org/10.1080/08832323.2016.1261791
Bowen, A. (2012). A LibGuides presence in a Blackboard environment. Reference Services Review, 40(3), 449–468. https://doi.org/10.1108/00907321211254698
Bowen, A. (2014). LibGuides and web-based library guides in comparison: Is there a pedagogical advantage? Journal of Web Librarianship, 8(2), 147–171. https://doi.org/10.1080/19322909.2014.903709
Bowen, A., Ellis, J., & Chaparro, B. (2018). Long nav or short nav? Student responses to two different navigational interface designs in LibGuides version 2. Journal of Academic Librarianship, 44(3), 391–403. https://doi.org/10.1016/j.acalib.2018.03.002
Brewer, L., Rick, H., & Grondin, K. A. (2017). Improving digital library experiences and support with online research guides. Online Learning, 21(3), 135–150. https://doi.org/10.24059/olj.v21i3.1237
Carey, J., Pathak, A., & Johnson, S. C. (2020). Use, perceptions, and awareness of LibGuides among undergraduate and graduate health professions students. Evidence Based Library & Information Practice, 15(3), 157–172. https://doi.org/10.18438/eblip29653
Chiware, M. (2014). The efficacy of course-specific library guides to support essay writing at the University of Cape Town. South African Journal of Libraries & Information Science, 80(2), 27–35. https://doi.org/10.7553/80-2-1522
Cobus-Kuo, L., Gilmour, R., & Dickson, P. (2013). Bringing in the experts: Library research guide usability testing in a computer science class. Evidence Based Library & Information Practice, 8(4), 43–59. https://doi.org/10.18438/B8GP5W
Courtois, M. P., Higgins, M. E., & Kapur, A. (2005). Was this guide helpful? Users’ perceptions of subject guides. Reference Services Review, 33(2), 188–196. https://doi.org/10.1108/00907320510597381
Craane, B., Dijkstra, P. U., Stappaerts, K., & De Laat, A. (2012). Methodological quality of a systematic review on physical therapy for temporomandibular disorders: Influence of hand search and quality scales. Clinical Oral Investigations, 16(1), 295–303. https://doi.org/10.1007/s00784-010-0490-y
Dalton, M., & Pan, R. (2014). Snakes or ladders? Evaluating a LibGuides pilot at UCD Library. Journal of Academic Librarianship, 40(5), 515–520. https://doi.org/10.1016/j.acalib.2014.05.006
Daly, E. (2010). Embedding library resources into learning management systems: A way to reach Duke undergrads at their points of need. College & Research Libraries News, 71(4), 208–212. https://doi.org/10.5860/crln.71.4.8358
DeFrain, E., Sult, L., & Pagowsky, N. (2022). Effectiveness of academic library research guides for building college students’ information literacy skills: A scoping review protocol. https://doi.org/10.17605/OSF.IO/2SMQ4
Dotson, D. S. (2021). LibGuides gone viral: A giant LibGuides project during remote working. Science & Technology Libraries, 40(3), 243–259. https://doi.org/10.1080/0194262X.2021.1884169
Dunsmore, C. (2002). A qualitative study of web-mounted pathfinders created by academic business libraries. Libri, 52(3). https://doi.org/10.1515/LIBR.2002.137
Fagerheim, B., Lundstrom, K., Davis, E., & Cochran, D. (2017). Extending our reach: Automatic integration of course and subject guides. Reference & User Services Quarterly, 56(3), 180–188. https://doi.org/10.5860/rusq.56n3.180
Gardner, J. J. (1977). Pathfinders, Library. In A. Kent, H. Lancour, J. E. Daily, & W. Z. Nasri (Eds.), Encyclopedia of library and information science (Vol. 21, pp. 468–473). Dekker.
Gardois, P., Colombi, N., Grillo, G., & Villanacci, M. C. (2012). Implementation of Web 2.0 services in academic, medical and research libraries: A scoping review. Health Information & Libraries Journal, 29(2), 90–109. https://doi.org/10.1111/j.1471-1842.2012.00984.x
German, E., Grassian, E., & LeMire, S. (2017). LibGuides for instruction A service design point of view from an academic library. Reference & User Services Quarterly, 56(3), 162-167.
Gerrish, T., & Martin, S. (2023). Student preferences for reference services at a remote biological station library. Portal: Libraries & the Academy, 23(4), 637–653. https://doi.org/10.1353/pla.2023.a908695
Gibbons, S. (2003). Building upon the MyLibrary concept to better meet the information needs of college students. D-Lib Magazine, 9(3). https://doi.org/10.1045/march2003-gibbons
Gilman, N. V., Sagàs, J., Camper, M., & Norton, A. P. (2017). A faculty-librarian collaboration success story: Implementing a teach-the-teacher library and information literacy instruction model in a first-year agricultural science course. Library Trends, 65(3), 339–358. https://doi.org/10.1353/lib.2017.0005
Goodsett, M. (2020). Best practices for teaching and assessing critical thinking in information literacy online learning objects. The Journal of Academic Librarianship, 46(5), 102163. https://doi.org/10.1016/j.acalib.2020.102163
Greenwell, S. (2016). Using the I-LEARN model for information literacy instruction. Journal of Information Literacy, 10(1), 67–85.
Griffin, M., & Taylor, T. I. (2018). Employing analytics to guide a data-driven review of LibGuides. Journal of Web Librarianship, 12(3), 147–159.
Hansen, L. A. (2014). Second-language writer and instructor perceptions of the effectiveness of a curriculum-integrated research skills library guide [M.A., The University of Utah].
Harbeson, E. L. (1972). Teaching reference and bibliography: The pathfinder approach. Journal of Education for Librarianship, 13(2), 111. https://doi.org/10.2307/40322211
Head, A., & Eisenberg, M. (2010). Assigning Inquiry: How Handouts for Research Assignments Guide Today’s College Students (SSRN Scholarly Paper ID 2281494). Social Science Research Network. https://doi.org/10.2139/ssrn.2281494
Hemmig, W. (2005). Online pathfinders: Toward an experience-centered model. Reference Services Review, 33(1), 66–87.
Hennesy, C., & Adams, A. L. (2021). Measuring actual practices: A computational analysis of LibGuides in academic libraries. Journal of Web Librarianship, 15(4), 219–242. https://doi.org/10.1080/19322909.2021.1964014
Hintz, K., Farrar, P., Eshghi, S., Sobol, B., Naslund, J.-A., Lee, T., Stephens, T., & McCauley, A. (2010). Letting students take the lead: A user-centred approach to evaluating subject guides. Evidence Based Library & Information Practice, 5(4), 39–52. https://doi.org/10.18438/B87C94
Hoffmann, T. C., Glasziou, P. P., Boutron, I., Milne, R., Perera, R., Moher, D., Altman, D. G., Barbour, V., Macdonald, H., Johnston, M., Lamb, S. E., Dixon-Woods, M., McCulloch, P., Wyatt, J. C., Chan, A.-W., & Michie, S. (2014). Better reporting of interventions: Template for intervention description and replication (TIDieR) checklist and guide. BMJ (Clinical Research Ed.), 348, g1687. https://doi.org/10.1136/bmj.g1687
Hsieh, M. L., Dawson, P. H., Hofmann, M. A., Titus, M. L., & Carlin, M. T. (2014). Four pedagogical approaches in helping students learn information literacy skills. Journal of Academic Librarianship, 40(3/4), 234–246. https://doi.org/10.1016/j.acalib.2014.03.012
Jackson, R., & Stacy-Bates, K. K. (2016). The Enduring landscape of online subject research guides. Reference & User Services Quarterly, 55(3), 219. https://doi.org/10.5860/rusq.55n3.219
Kline, E., Wallace, N., Sult, L., & Hagedon, M. (2017). Embedding the library in the LMS: Is it a good investment for your organization’s information literacy program? In T. Maddison & M. Kumaran (Eds.), Distributed Learning (pp. 255–269). Chandos Publishing. https://doi.org/10.1016/B978-0-08-100598-9.00014-3
Lauseng, D. L., Howard, C., Scoulas, J. M., & Berry, A. (2021). Assessing online library guide use and open educational resource (oer) potential: An evidence-based decision-making approach. Journal of Web Librarianship, 15(3), 128–153. https://doi.org/10.1080/19322909.2021.1935396
Lee, J., Hayden, K. A., Ganshorn, H., & Pethrick, H. (2021). A Content analysis of systematic review online library guides. Evidence Based Library and Information Practice, 16(1), 60–77. https://doi.org/10.18438/eblip29819
Lee, L., Hime, L., & Dominicis, E. (2003). Just-in-time course guides. Florida Libraries, 46(2), 8–10.
Lee, Y. Y., & Lowe, M. S. (2018). Building positive learning experiences through pedagogical research guide design. Journal of Web Librarianship, 12(4), 205–231. https://doi.org/10.1080/19322909.2018.1499453
Leighton, H. V., & May, D. (2013). The Library course page and instruction: Perceived helpfulness and use among students. Internet Reference Services Quarterly, 18(2), 127–138. https://doi.org/10.1080/10875301.2013.804019
Li, Y. (2016). Using new venture competitions to link the library and business students. Qualitative & Quantitative Methods in Libraries, 5(3), 551–559.
Lierman, A., Scott, B., Warren, M., & Turner, C. (2019). Testing for transition: Evaluating the usability of research guides around a platform migration. Information Technology & Libraries, 38(4), 76–97. https://doi.org/10.6017/ital.v38i4.11169
Lilly. (2022, May 2). 15 Years of Springshare! The Springy Share. https://blog.springshare.com/2022/05/02/15-years-of-springshare/
Little, J. (2010). Cognitive load theory and library research guides. Internet Reference Services Quarterly, 15(1), 53–63.
Magi, T. J. (2003). What’s best for students? Comparing the effectiveness of a traditional print pathfinder and a web-based research tool. Portal: Libraries and the Academy, 3(4), 671–686. https://doi.org/10.1353/pla.2003.0090
Mahaffy, M. (2012). Student use of library research guides following library instruction. Communications in Information Literacy, 6(2), 202–213. https://doi.org/10.15760/comminfolit.2013.6.2.129
Metter, E., & Willis, E. (1993). Creating a handbook for an academic library: Rationale and process. Research Strategies, 11(4), 32–220.
Miles, M. J., & Bergstrom, S. J. (2009). Classification of library resources by subject on the library website: Is there an optimal number of subject labels? Information Technology & Libraries, 28(1), 16–20. https://doi.org/10.6017/ital.v28i1.3167
Miller, L. N. (2014). First year medical students use library resources emphasized during instruction sessions. Evidence Based Library & Information Practice, 9(1), 48–50. https://doi.org/10.18438/B8F316
Miner, J., & Alexander, R. (2010). LibGuides in political science: Improving student access, research, and information literacy. Journal of Information Literacy, 4(1), 40–54. https://doi.org/10.11645/4.1.1467
Mubofu, C., & Malekani, A. (2021). Accessibility of library resources and support services by distance learners. Journal of Library & Information Services in Distance Learning, 15(4), 267–279. https://doi.org/10.1080/1533290X.2021.2021345
Murphy, S. A., & Black, E. L. (2013). Embedding guides where students learn: Do design choices and librarian behavior make a difference? Journal of Academic Librarianship, 39(6), 528–534. https://doi.org/10.1016/j.acalib.2013.06.007
Mussell, J., & Croft, R. (2013). Discovery layers and the distance student: Online search habits of students. Journal of Library & Information Services in Distance Learning, 7(1/2), 18–39. https://doi.org/10.1080/1533290X.2012.705561
Nicholson, K. P. (2017, October 26). The “Value Agenda”: Negotiating a Path Between Compliance and Critical Practice [[Keynote]]. Canadian Libraries Assessment Workshop (CLAW), University of Victoria.
Oakleaf, M. J. (2010). The value of academic libraries: A comprehensive research review and report. Association of College and Research Libraries, American Library Association.
Olshausen, M. (2018). A statistical approach to assessing research guide use at Central Washington University. PNLA Quarterly, 82(3/4), 23–34.
Ouellelte, D. (2011). Subject Guides in Academic Libraries: A User-Centred Study of Uses and Perceptions. Les Guides Par Sujets Dans Les Bibliothèques Académiques : Une Étude Des Utilisations et Des Perceptions Centrée Sur l’utilisateur., 35(4), 436–451.
Pagowsky, N. (2021). The contested one-shot: Deconstructing power structures to imagine new futures. College & Research Libraries. https://doi-org.libproxy.unl.edu/10.5860/crl.82.3.300
Paschke-Wood, J., Dubinsky, E., & Sult, L. (2020). Creating a student-centered alternative to research guides: Developing the infrastructure to support novice learners. In the Library with the Lead Pipe.
Paul, S., Wright, L. B., & Clevenger-Schmertzing, L. (2020). Going the distance: Flipped classrooms and the research appointment. Southeastern Librarian, 68(3), 3–13.
Peters, M. D. J., Godfrey, C., McInerney, P., Khalil, H., Larsen, P., Marnie, C., Pollock, D., Tricco, A. C., & Munn, Z. (2022). Best practice guidance and reporting items for the development of scoping review protocols. JBI Evidence Synthesis, 20(4), 953–968. https://doi.org/10.11124/JBIES-21-00242
Pickens-French, K., & Mcdonald, K. (2013). Changing trenches, changing tactics: A library’s frontline redesign in a new cms. Journal of Library & Information Services in Distance Learning, 7(1/2), 53–72. https://doi.org/10.1080/1533290X.2012.705613
Rafferty, R. S. (2013). The impact of library instruction: Do first-year medical students use library resources specifically highlighted during instructional sessions? Journal of the Medical Library Association, 101(3), 213–217. https://doi.org/10.3163/1536-5050.101.3.011
Rothstein, S. (1989). Point of need/maximum service: An experiment in library instruction. Reference Librarian, 25–26, 253–284.
Scoulas, J. M. (2021). STEM undergraduate students: Library use, perceptions and GPA. Performance Measurement & Metrics, 22(2), 137–148. https://doi.org/10.1108/PMM-04-2020-0021
Sharrar, G. S. (2017). Are course pages useful? Getting beyond implementation and usability. UNC Chapel Hill Theses, MP4449–MP4449.
Singal, A. G., Higgins, P. D. R., & Waljee, A. K. (2014). A Primer on Effectiveness and Efficacy Trials. Clinical and Translational Gastroenterology, 5(1), e45. https://doi.org/10.1038/ctg.2013.13
Sinkinson, C., Alexander, S., Hicks, A., & Kahn, M. (2012). Guiding design: Exposing librarian and student mental models of research guides. portal: Libraries and the Academy, 12(1), 63–84. https://doi.org/10.1353/pla.2012.0008
Slemons, M. H. (2013). Design standards for LibGuides: Does better design lead to greater use? [Master’s, University of North Carolina at Chapel Hill].
Smith, C. H. (2007). Meta-assessment of online research guides usage. Reference Librarian, 47(1), 79–93. https://doi.org/10.1300/J120v47n97_08
Soskin, M. D., & Eldblom, N. (1984). Integrating the Term Paper into Economics Courses at Liberal Arts Colleges: Industry Case Studies Papers at SUNY-Potsdam (63454646; ED246732; pp. 1–30).
Stewart, C. (2022). Future states of the research library. 303, 3–11. https://doi.org/10.29242/rli.303.1
Stone, S. M., Sara Lowe, M., & Maxson, B. K. (2018). Does course guide design impact student learning? College & Undergraduate Libraries, 25(3), 280–296. https://doi.org/10.1080/10691316.2018.1482808
Tang, Y., & Tseng, H. W. (2014). Distance students’ attitude toward library help seeking. Journal of Academic Librarianship, 40(3/4), 307–312. https://doi.org/10.1016/j.acalib.2014.04.008
Taylor, A., Nelson, J., O’Donnell, S., Davies, E., & Hillary, J. (2022). The Skills Imperative 2035: What does the literature tell us about essential skills most needed for work? National Foundation for Educational Research.
Thomas, J., Kneale, D., McKenzie, J. E., Brennan, S. E., & Soumyadeep, B. (2023). Chapter 2: Determining the scope of the review and the questions it will address. In: Higgins JPT, Thomas J, Chandler J, Cumpston M, Li T, Page MJ, Welch VA (editors). (Updated August 2023). Cochrane, 2023. Available from. In J. Higgins, J. Thomas, J. Chandler, M. Cumpston, T. Li, M. Page, & V. Welch (Eds.), Cochrane Handbook for Systematic Reviews of Interventions version 6.4. Cochrane. https://www.training.cochrane.org/handbook
Thorngate, S., & Hoden, A. (2017). Exploratory usability testing of user interface options in LibGuides 2. College & Research Libraries, 78(6), 844–861. https://doi.org/10.5860/crl.78.6.844
Tomlin, N., Tewell, E., Mullins, K., & Dent, V. (2017). In their own voices: An ethnographic perspective on student use of library information sources. Journal of Library Administration, 57(6), 631–650. https://doi.org/10.1080/01930826.2017.1340776
Tricco, A. C., Lillie, E., Zarin, W., K. O’Brien, K., Colquhoun, H., Levac, D., Moher, D., D.J. Peters, M., Horsley, T., Weeks, L., Hempel, S., A. Akl, E., Chang, C., McGowan, J., Stewart, L., Hartling, L., Aldcroft, A., G. Wilson, M., Garritty, C., … E. Straus, S. (2018). PRISMA Extension for Scoping Reviews (PRISMA-ScR): Checklist and Explanation. Annals of Internal Medicine. https://doi.org/10.7326/M18-0850
Vassar, M., Atakpo, P., & Kash, M. J. (2016). Manual search approaches used by systematic reviewers in dermatology. Journal of the Medical Library Association: JMLA, 104(4), 302–304. https://doi.org/10.3163/1536-5050.104.4.009
Vileno, L. (2007). From paper to electronic, the evolution of pathfinders: A review of the literature. Reference Services Review, 35(3), 434–451. https://doi.org/10.1108/00907320710774300
Wharton, L., & Pritchard, M. (2020). A successful long-term relationship: Three years of LTI integrations in Canvas. Journal of Electronic Resources Librarianship, 32(4), 286–303. https://doi.org/10.1080/1941126X.2020.1821993
Wineburg, S., Breakstone, J., McGrew, S., Smith, M. D., & Ortega, T. (2022). Lateral reading on the open Internet: A district-wide field study in high school government classes. Journal of Educational Psychology. https://doi.org/10.1037/edu0000740

This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
