THE IMPACT OF A PROFICIENCY-BASED ASSESSMENT AND REASSESSMENT OF LEARNING OUTCOMES SYSTEM ON STUDENT ACHIEVEMENT AND ATTITUDES

Michael a. posner

Villanova University

michael.posner@villanova.edu

ABSTRACT

This research compares a student-centered, proficiency-based assessment and reassessment of learning outcomes (PARLO) system to traditional assessment in a college-level introductory statistics class. The PARLO class was assessed on learning outcomes using a three-tiered proficiency scale and given the opportunity to resubmit assignments to increase their rating. Students' attitudes towards statistics improved more in the PARLO group, but no differences between groups were found on the CAOS test or on a common final exam. Within the PARLO group, students with a higher resubmission rate scored better on the final exam and those who resubmitted and achieved proficiency performed similarly to those achieving proficiency with the first submission. Assessing proficiency on specific learning outcomes allowed both students and the instructor to better evaluate learning.

Keywords: Statistics education research; Formative assessment; Assignment resubmission

__________________________

Statistics Education Research Journal, 10(1), 3-14, http://www.stat.auckland.ac.nz/serj

Ó International Association for Statistical Education (IASE/ISI), May, 2011

REFERENCES

Allan, J. (1996). Learning outcomes in higher education. Studies in Higher Education, 21(1), 93-108.

Allensworth, E. (2005). Graduation and dropout trends in Chicago: A look at cohorts of students from 1991 through 2004. Chicago: Consortium on Chicago School Research.

American Statistical Association. (2007). Using statistics effectively in mathematics education research (SMER Report). Alexandria: Author.

[Online: http://www.amstat.org/education/pdfs/UsingStatisticsEffectivelyinMathEdResearch.pdf ]

Becker, K. (2006, May). Death to deadlines: A 21st century look at the use of deadlines and late penalties in programming assignments. Paper presented at WCCCE 2006 - The Western Canadian Conference on Computing Education, Calgary, Alberta.

[Online: http://dspace.ucalgary.ca/bitstream/1880/46725/1/Death-to-Deadlines.pdf ]

Becker, W. E. (2004). Quantitative research on teaching methods in tertiary education. In W. E. Becker and M. L. Andrews (Eds.), The scholarship of teaching and learning in higher education: Contributions of research universities (pp. 265-310). Bloomington, IN: Indiana University Press.

Biggs, J. B. (1980). The relationship between developmental level and the quality of school learning. In S. Modgil & C. Modgil (Eds.), Toward a theory of psychological development within a Piagetian framework. Windsor, England: National Foundation for Educational Research Publishing.

Bingham, J. (1999). Guide to developing learning outcomes. The Learning and Teaching Institute Sheffield Hallam University, UK: Sheffield Hallam University.

Black, P., Harrison, C., Lee, C., Marshall, B., & Wiliam, B. (2003). Assessment for learning: Putting it into practice. Berkshire, England: Open University Press.

Black, P., & Wiliam, D. (1998a). Inside the black box: Raising standards through classroom assessment. Phi Delta Kappan, 80(2), 139-148.

Black, P., & Wiliam, D. (1998b). Assessment and classroom learning. Assessment in Education, 5(1), 7-74.

Bloom, B. S. (1981). All our children learning: A primer for parents, teachers, and other educators. New York: McGraw-Hill Paperbacks.

Butler, R. (1988). Enhancing and undermining intrinsic motivation: The effects of task-involving and ego-involving evaluation on interest and performance. British Journal of Educational Psychology, 58(1), 1-14.

Chicago Public Schools, Office of Performance. (2010). One Year Grade 9-12 Dropout Rates, 1999-2010.

[Online: http://research.cps.k12.il.us/cps/accountweb/Reports/citywide.html ]

Clymer, J., & Wiliam, D. (2007). Improving the way we grade science. Educational Leadership, 64(4), 36-42.

delMas, R., Garfield, J., Ooms, A., & Chance, B. (2006). Assessing students' conceptual understanding after a first course in statistics. Statistics Education Research Journal, 6(2), 28-53.

[Online: http://www.stat.auckland.ac.nz/~iase/serj/SERJ6%282%29_delMas.pdf ]

Eccles, J. S., & Wigfield, A. (2002). Motivational beliefs, values, and goals. Annual Review of Psychology, 53, 109-132.

Ewell, P. T. (2002). An emerging scholarship: A brief history of assessment. In T. W. Banta (Ed.), Building a scholarship of assessment (pp. 3-25). San Francisco: Jossey-Bass Publishers.

Farrington, C. H., & Small, M. H. (2006, April). Removing structural barriers to academic achievement in high schools: An innovative model. Paper presented at the annual meeting of the American Educational Research Association, San Francisco

Jenkins, A., & Unwin, D. (n. d.). How to write learning outcomes. National Center for Geographic Information and Analysis Geographical Information Science Core Curriculum Learning Outcomes.

[Online: www.mf-foca.com/projekti/euser/mostar/how_to%20write_learning_outcomes.doc ]

Karavirta, V., Korhonen, A., & Malmi, L. (2006). On the use of resubmissions in automatic assessment systems. Computer Science Education, 16(3), 229-240.

Kohn, A. (2002). The dangerous myth of grade inflation. Chronicle of Higher Education, Nov. 8, B7.

Kulik, C. C., Kulik, J. A., & Bangert-Drowns, R. L. (1990). Effectiveness of mastery learning: A meta-analysis. Review of Educational Research, 60(2), 265-299.

Posner, M. A. (2007). Evaluating pedagogical techniques in introductory statistics: Proficiency grading and assignment resubmission. In B. Phillips and L. Weldon (Eds.), Proceedings of the IASE/ISI Satellite Conference on Assessing Student Learning in Statistics. Voorburg, The Netherlands: International Association for Statistical Education, International Statistical Institute.

[Online: http://www.stat.auckland.ac.nz/~iase/publications/sat07/Posner.pdf ]

Ramirez, C., Emmioglu, E., & Schau, C. (2010, August). Understanding students' attitudes toward statistics: New perspectives using expectancy-value theory of motivation and the Survey of Attitudes Toward Statistics. Paper presented Joint Statistical Meetings, Vancouver, BC, Canada.

Schau, C., Stevens, J., Dauphinee, T. L., & Del Vecchio, A. (1995). The development and validation of the Survey of Attitudes Toward Statistics. Educational and Psychological Measurement, 55(5), 868-875.

Schneider, D., & Dorans, N. (1999). Concordance between SAT I and ACT Scores for individual students [Electronic Version]. Research Notes, RN-07, 1-8

Wiseman, D. L., & Knight, S. L. (2003). Linking school-university collaboration and K-12 student outcomes. New York: American Association of Colleges for Teacher Education.

michael a. posner

Department of Mathematical Sciences

Villanova University

800 Lancaster Ave.

Villanova, PA 19085