Developing a Gain-in-research-ability Test to Navigate and Assess Course-based Undergraduate Research Experiences
DOI:
https://doi.org/10.56103/nactaj.v68i1.130Keywords:
gain in research ability test, course-based undergraduate research experiences, anticipated learning outcomes, assessmentAbstract
Course-based undergraduate research experiences (CUREs) benefit student learning by providing accessible authentic research opportunities. However, the uniqueness of each disciple and variation in instructors’ perception of CUREs make it challenging to reach a consensus on how to effectively assess students’ research abilities in a CURE laboratory. To address this question, we developed a Gain in Research Ability Test (GRAT) based on seven areas of competencies in research (Identify, Question, Plan, Conduct, Analyze, Conclude, and Communicate). The GRAT framework orchestrates the learning objectives and research activities, providing a quantitative assessment of student learning outcomes. The GRAT scores before and after the interventions revealed a significant growth in students’ research abilities, consistent with students’ perception of the GRAT-navigated research experience. As the seven areas of competencies in research are commonly observed across disciplines, the GRAT framework circumvents disciplinary boundaries and sets universal milestones for the assessment of CURE. Future larger-scale and cross-discipline studies are warranted to explore the potential of GRAT to provide a common metric for substance and consistency in the assessment of students’ gain in research ability across disciplines.
Downloads
References
Auchincloss, L.C., Laursen, S.L., Branchaw, J.L., Eagan, K., Graham, M., Hanauer, D.I., Lawrie, G., McLinn, C.M., Pelaez, N., Rowland, S., et al. (2014). Assessment of course-based undergraduate research experiences: a meeting report. CBE Life Sci Educ 13, 29-40.
Brownell, S.E., Wenderoth, M.P., Theobald, R., Okoroafor, N., Koval, M., Freeman, S., Walcher-Chevillet, C.L., and Crowe, A.J. (2014). How Students Think about Experimental Design: Novel Conceptions Revealed by in-Class Activities. Bioscience 64, 125-137.
Cheng, Z., Anderson, T.R., and Pelaez, N. (2022). Backward designing a lab course to promote authentic research experience according to students’ gains in research abilities. Trends in Teaching Experimentation in the Life Sciences: Putting Research into Practice to Drive Institutional Change (Ed Pelaez N, Gardner S, Anderson T) Springer Nature, Switzerland, pp93-107.
Cheng, Z., and Shelnutt, K. (2021). Integrating Experiential Learning Theory And Citizen Science Practice Through Community Outreach Projects To Enhance Student Learning. NACTA Journal 65, 398-405.
Cooper, K.M., Knope, M.L., Munstermann, M.J., and Brownell, S.E. (2020). Students Who Analyze Their Own Data in a Course-Based Undergraduate Research Experience (CURE) Show Gains in Scientific Identity and Emotional Ownership of Research. J Microbiol Biol Edu 21.
Corwin, L.A., Graham, M.J., and Dolan, E.L. (2015a). Modeling course-based undergraduate research experiences: an agenda for future research and evaluation. CBE Life Sci Educ 14, es1.
Corwin, L.A., Runyon, C., Robinson, A., and Dolan, E.L. (2015b). The Laboratory Course Assessment Survey: A Tool to Measure Three Dimensions of Research-Course Design. CBE Life Sci Educ 14, ar37.
Craig, P.A. (2020). Something old, something new: Teaching the BMB lab. Biochem Mol Biol Edu 48, 640-642.
Dasgupta, A.P., Anderson, T.R., and Pelaez, N. (2014). Development and Validation of a Rubric for Diagnosing Students' Experimental Design Knowledge and Difficulties. Cbe-Life Sci Educ 13, 265-284.
Deane, T., Nomme, K., Jeffery, E., Pollock, C., and Birol, G. (2014). Development of the Biological Experimental Design Concept Inventory (BEDCI). Cbe-Life Sci Educ 13, 540-551.
Goodwin, E.C., Cary, J.R., and Shortlidge, E.E. (2022). Not the same CURE: Student experiences in course-based undergraduate research experiences vary by graduate teaching assistant. Plos One 17, e0275313.
Harsh, J., Esteb, J.J., and Maltese, A.V. (2017). Evaluating the development of chemistry undergraduate researchers' scientific thinking skills using performance-data: first findings from the performance assessment of undergraduate research (PURE) instrument. Chem Educ Res Pract 18, 472-485.
Irby, S.M., Pelaez, N.J., and Anderson, T.R. (2018a). Anticipated learning outcomes for a biochemistry course-based undergraduate research experience aimed at predicting protein function from structure: Implications for assessment design. Biochem Mol Biol Educ 46, 478-492.
Irby, S.M., Pelaez, N.J., and Anderson, T.R. (2018b). How to Identify the Research Abilities That Instructors Anticipate Students Will Develop in a Biochemistry Course-Based Undergraduate Research Experience (CURE). CBE Life Sci Educ 17, es4.
Irby, S.M., Pelaez, N.J., and Anderson, T.R. (2020). Student Perceptions of Their Gains in Course-Based Undergraduate Research Abilities Identified as the Anticipated Learning Outcomes for a Biochemistry CURE. J Chem Educ 97, 56-65.
Krim, J.S., Cote, L.E., Schwartz, R.S., Stone, E.M., Cleeves, J.J., Barry, K.J., Burgess, W., Buxner, S.R., Gerton, J.M., Horvath, L., et al. (2019). Models and Impacts of Science Research Experiences: A Review of the Literature of CUREs, UREs, and TREs. Cbe-Life Sci Educ 18.
Linn, M.C., Palmer, E., Baranger, A., Gerard, E., and Stone, E. (2015). Education. Undergraduate research experiences: impacts and opportunities. Science 347, 1261757.
Lopatto, D., Rosenwald, A.G., DiAngelo, J.R., Hark, A.T., Skerritt, M., Wawersik, M., Allen, A.K., Alvarez, C., Anderson, S., Arrigo, C., et al. (2020). Facilitating Growth through Frustration: Using Genomics Research in a Course-Based Undergraduate Research Experience. J Microbiol Biol Edu 21.
McLaughlin, J.S., Favre, D.E., Weinstein, S.E., and Goedhart, C.M. (2017). The Impact of a Four-Step Laboratory Pedagogical Framework on Biology Students’ Perceptions of Laboratory Skills, Knowledge, and Interest in Research. J Colleg Sci Teaching 47, 83-91.
Pelaez, N., Anderson, T.R., Gardner, S.M., Yin, Y., Abraham, J.K., Bartlett, E.L., Gormally, C., Hill, J.P., Hoover, M., Hurney, C.A., et al. (2017). The basic competencies of biological experimentation: Concept-skill statements. Purdue ePubs PIBERG Instructional Innovation Materials (Paper 4)
Rybarczyk, B.J., Walton, K.L., and Grillo, W.H. (2014). The development and implementation of an instrument to assess students' data analysis skills in molecular biology. J Microbiol Biol Educ 15, 259-267.
Shanks, R.A., Robertson, C.L., Haygood, C.S., Herdliksa, A.M., Herdliska, H.R., and Lloyd, S.A. (2017). Measuring and Advancing Experimental Design Ability in an Introductory Course without Altering Existing Lab Curriculum. J Microbiol Biol Educ 18.
Shortlidge, E.E., and Brownell, S.E. (2016). How to Assess Your CURE: A Practical Guide for Instructors of Course-Based Undergraduate Research Experiences. J Microbiol Biol Edu 17, 399-408.
