Assessment design decisions in practice: profile identification in approaches to assessment design
Loading...
Full text at PDC
Publication date
2021
Advisors (or tutors)
Editors
Journal Title
Journal ISSN
Volume Title
Publisher
Taylor & Francis
Citations
Exportar
Citation
Fernández Ruiz, J., Panadero, E., García- Pérez, D., & Pinedo, L. (2022). Assessment design decisions in practice: Profile identification in approaches to assessment design. Assessment and Evaluation in Higher Education, 47(4), 606-621. https://doi.org/10.1080/02602938.2021.1937512
Abstract
This study aims to identify different profiles of higher education teachers based on the way they design their assessment methods. It also explores differential characteristics in each profile and differences in the assessment methods preferred by the teachers and those implemented in their subjects. Sixteen teachers from four universities participated carrying out a think-aloud simulation task: designing the assessment methods for a set of learning outcomes. Teachers’ testimony during the task was transcribed and categorized using content analysis and an open-coding procedure. Three different patterns were identified: (a) focus on the feasibility of the assessment tasks, (b) on the alignment with the learning outcomes, or (c) alignment with teaching methods. Most of the participants focused only in one of the three elements. Teachers also designed different assessment methods in the simulation task in comparison with the ones they use in their subjects, despite the guidelines of assessing the same learning outcomes. A lack of resources is claimed as the reason of these differences. Implications for future research are discussed.
Description
Research funded by: Spanish Ministry of Economy and Competitiveness (Ministerio de Economía y Competitividad) National I+D Call (Convocatoria Excelencia) project reference EDU2016-79714-P; and personal grant (Formación de Personal Investigador) reference BES-2017-080054.
Referencias bibliográficas:
• American Federation of Teachers, National Council on Measurement in Education, and National Education Association (AFT, NCME, and NEA). 1990. “ The Standards for Teacher Competence in the Educational Assessment of Students.” Educational Measurement: Issues and Practice 9 (4): 30–32.
• Andrade, H. L., and M. Heritage. 2017. Using Formative Assessment to Enhance Learning, Achievement, and Academic Self-Regulation. New York: Routledge.
• Bearman, M., P. Dawson, S. Bennett, M. Hall, E. Molloy, D. Boud, and G. Joughin. 2017. “ How University Teachers Design Assessments: A Cross-Disciplinary Study.” Higher Education 74 (1): 49–64. doi: 10.1007/s10734-016-0027-7.
• Bennett, S., L. Thomas, S. Agostinho, L. Lockyer, J. Jones, and B. Harper. 2011. “ Understanding the Design Context for Australian University Teachers: Implications for the Future of Learning Design.” Learning, Media and Technology 36 (2): 151–167. doi: 10.1080/17439884.2011.553622.
• Black, P., and D. Wiliam. 1998. “ Assessment and Classroom Learning.” Assessment in Education: principles, Policy & Practice 5 (1): 7–74.
• Boud, D., and N. Falchikov. 2006. “ Aligning Assessment with Long‐Term Learning.” Assessment & Evaluation in Higher Education 31 (4): 399–413. doi: 10.1080/02602930600679050.
• Brookhart, S. M. 2011. “ Educational Assessment Knowledge and Skills for Teachers.” Educational Measurement: Issues and Practice 30 (1): 3–12. doi: 10.1111/j.1745-3992.2010.00195.x.
• Carless, D. 2015. “ Exploring Learning-Oriented Assessment Processes.” Higher Education 69 (6): 963–976. doi: 10.1007/s10734-014-9816-z.
• Cauley, K. M., and J. H. McMillan. 2010. “ Formative Assessment Techniques to Support Student Motivation and Achievement.” The Clearing House: A Journal of Educational Strategies, Issues and Ideas 83 (1): 1–6. doi: 10.1080/00098650903267784.
• Fan, Y. C., T. H. Wang, and K. H. Wang. 2011. “ A Web-Based Model for Developing Assessment Literacy of Secondary in-Service Teachers.” Computers & Education 57 (2): 1727–1740. doi: 10.1016/j.compedu.2011.03.006.
• Fernández Ruiz, J., and E. Panadero. 2020. “ Comparison between Conceptions and Assessment Practices among Secondary Education Teachers: More Differences than Similarities.” Journal for the Study of Education and Development 43 (2): 309–346. doi: 10.1080/02103702.2020.1722414.
• Fernández Ruiz, J., E. Panadero, and D. García-Pérez. 2021. “ Assessment from a Disciplinary Approach: Design and Implementation in Three Undergraduate Programmes.” Manuscript submitted for publication.
• Hall, T. J., and M. A. Smith. 2006. “ Teacher Planning, Instruction and Reflection: What we Know about Teacher Cognitive Processes.” Quest 58 (4): 424–442. doi: 10.1080/00336297.2006.10491892.
• Higgins, M., F. Grant, and P. Thompson. 2010. “ Formative Assessment: Balancing Educational Effectiveness and Resource Efficiency.” Journal for Education in the Built Environment 5 (2): 4–24. doi: 10.11120/jebe.2010.05020004.
• Hill, M., B. Cowie, A. Gilmore, and L. F. Smith. 2010. “ Preparing Assessment-Capable Teachers: What Should Preservice Teachers Know and Be Able to Do? ” Assessment Matters 2: 43–64. doi: 10.18296/am.0085.
• Hornby, W. 2005. “ Dogs, Stars, Rolls Royces and Old Double-Decker Buses: Efficiency and Effectiveness in Assessment.” In Enhancing Practice: Reflections on Assessment: Volume 1, 15–28. Gloucester: Quality Assurance Agency for Higher Education.
• Ibarra-Sáiz, M. S., and G. Rodríguez-Gómez. 2010. “ An Approach to the Dominant Discourse of Learning Assessment in Higher Education.” Revista de Educación 351: 385–407.
• Izci, K., and G. Caliskan. 2017. “ Development of Prospective Teachers’ Conceptions of Assessment and Choices of Assessment Tasks.” International Journal of Research in Education and Science 3 (2): 464–474.
• Jessop, T., and C. Tomas. 2017. “ The Implications of Programme Assessment Patterns for Student Learning.” Assessment & Evaluation in Higher Education 42 (6): 990–999. doi: 10.1080/02602938.2016.1217501.
• Korthagen, F., J. Loughran, and T. Russell. 2006. “ Developing Fundamental Principles for Teacher Education Programs and Practices.” Teaching and Teacher Education 22 (8): 1020–1041. doi: 10.1016/j.tate.2006.04.022.
• Lyon, E. G. 2013. “ Conceptualizing and Exemplifying Science Teachers’ Assessment Expertise.” International Journal of Science Education 35 (7): 1208–1229. doi: 10.1080/09500693.2013.770180.
• Macdonald, R., and G. Joughin. 2009. “ Changing Assessment in Higher Education: A Model in Support of Institution-Wide Improvement.” In Assessment, Learning and Judgement in Higher Education, edited by G. Joughin, 1–21. Rotterdam, Netherlands: Springer.
• McMillan, J. H. 2005. “ Understanding and Improving Teachers’ Classroom Assessment Decision Making: Implications for Theory and Practice.” Educational Measurement: Issues and Practice 22 (4): 34–43. doi: 10.1111/j.1745-3992.2003.tb00142.x.
• McMillan, J. H., and S. Moore. 2020. “ Better Being Wrong (Sometimes): Classroom Assessment That Enhances Student Learning and Motivation.” The Clearing House: A Journal of Educational Strategies, Issues and Ideas 93 (2): 85–92. doi: 10.1080/00098655.2020.1721414.
• Meyer, L. H., S. Davidson, L. McKenzie, M. Rees, H. Anderson, R. Fletcher, P. M. Johnston, et al. 2010. “ An Investigation of Tertiary Assessment Policy and Practice: Alignment and Contradictions.” Higher Education Quarterly 64 (3): 331–350. doi: 10.1111/j.1468-2273.2010.00459.x.
• Norton, L., B. Norton, and L. Shannon. 2013. “ Revitalising Assessment Design: What is Holding New Lecturers Back? ” Higher Education 66 (2): 233–251. doi: 10.1007/s10734-012-9601-9.
• Norton, L., O. Aiyegbayo, K. Harrington, J. Elander, and P. Reddy. 2010. “ New Lecturers’ Beliefs about Learning, Teaching and Assessment in Higher Education: The Role of the PGCLTHE Programme.” Innovations in Education and Teaching International 47 (4): 345–356. doi: 10.1080/14703297.2010.518426.
• Norton, L., T. E. Richardson, J. Hartley, S. Newstead, and J. Mayes. 2005. “ Teachers’ Beliefs and Intentions concerning Teaching in Higher Education.” Higher Education 50 (4): 537–571. doi: 10.1007/s10734-004-6363-z.
• Panadero, E., and M. Romero. 2014. “ To Rubric or Not to Rubric? The Effects of Self-Assessment on Self-Regulation, Performance and Self-Efficacy.” Assessment in Education: Principles, Policy & Practice 21 (2): 133–148.
• Panadero, E., G. Brown, and M. Courtney. 2014. “ Teachers’ Reasons for Using Self-Assessment: A Survey Self-Report of Spanish Teachers.” Assessment in Education: Principles, Policy & Practice 21 (4): 365–383.
• Panadero, E., G. T. Brown, and J. W. Strijbos. 2016. “ The Future of Student Self-Assessment: A Review of Known Unknowns and Potential Directions.” Educational Psychology Review 28 (4): 803–830. doi: 10.1007/s10648-015-9350-2.
• Panadero, E., J. Fraile, J. Fernández Ruiz, D. Castilla-Estévez, and M. A. Ruiz. 2019. “ Spanish University Assessment Practices: Examination Tradition with Diversity by Faculty.” Assessment & Evaluation in Higher Education 44 (3): 379–397. doi: 10.1080/02602938.2018.1512553.
• Picos, A. P., and V. M. López-Pastor. 2013. “ Haz lo Que yo Digo Pero No lo Que yo Hago: Sistemas de Evaluación Del Alumnado en la Formación Inicial Del Profesorado. Do What I Say, Not What I Do: Student Assessment Systems.” Revista de Educación 361: 279–305.
• Postareff, L., V. Virtanen, N. Katajavuori, and S. Lindblom-Ylänne. 2012. “ Academics’ Conceptions of Assessment and Their Assessment Practices.” Studies in Educational Evaluation 38 (3-4): 84–92. doi: 10.1016/j.stueduc.2012.06.003.
• Quesada-Serra, V., G. Rodríguez-Gómez, and M. S. Ibarra-Sáiz. 2016. “ What Are we Missing? Spanish Lecturers’ Perceptions of Their Assessment Practices.” Innovations in Education and Teaching International 53 (1): 48–59. doi: 10.1080/14703297.2014.930353.
• Sato, M., R. C. Wei, and L. Darling-Hammond. 2008. “ Improving Teachers’ Assessment Practices through Professional Development: The Case of National Board Certification.” American Educational Research Journal 45 (3): 669–700. doi: 10.3102/0002831208316955.
• Smith, J. 2011. “ Beyond Evaluative Studies: Perceptions of Teaching Qualifications from Probationary Lecturers in the UK.” International Journal for Academic Development 16 (1): 71–81. doi: 10.1080/1360144X.2011.546236.
• Stiggins, R. 2007. “ Assessment through the Student’s Eyes.” Educational Leadership 64 (8): 22.
• Watkins, D., B. Dahlin, and M. Ekholm. 2005. “ Awareness of the Backwash Effect of Assessment: A Phenomenographic Study of the Views of Hong Kong and Swedish Lecturers.” Instructional Science 33 (4): 283–309. doi: 10.1007/s11251-005-3002-8.
• Wu, Q., and T. Jessop. 2018. “ Formative Assessment: Missing in Action in Both Research-Intensive and Teaching Focused Universities? ” Assessment & Evaluation in Higher Education 43 (7): 1019–1031. doi: 10.1080/02602938.2018.1426097.
• Xu, Y., and G. T. Brown. 2016. “ Teacher Assessment Literacy in Practice: A Reconceptualization.” Teaching and Teacher Education 58: 149–162. doi: 10.1016/j.tate.2016.05.010.