SURVEYS ASSESSING STUDENTS' ATTITUDES TOWARD STATISTICS: A
SYSTEMATIC REVIEW OF VALIDITY AND RELIABiLITY
MEAGHAN M. NOLAN
University of Calgary - Canada
mmnolan@ucalgary.ca
TANYA BERAN
University of Calgary - Canada
tnaberan@ucalgary.ca
KENT G. HECKER
University of Calgary - Canada
kghecker@ucalgary.ca
ABSTRACT
Students with positive attitudes toward statistics are likely to show strong academic performance in statistics courses. Multiple surveys measuring students' attitudes toward statistics exist; however, a comparison of the validity and reliability of interpretations based on their scores is needed. A systematic review of relevant electronic databases yielded 532 citations, 78 of which were reviewed, and 35 included in a final analysis. Fifteen instruments were identified; however, evidence of validity and reliability has only accumulated for the Statistics Attitude Scale, Attitudes Toward Statistics Scale, and Survey of Attitudes Toward Statistics (two versions). In conclusion, a number of surveys exist, but there is a paucity of peer-reviewed validity and reliability evidence.
Keywords:
Statistics education research; Statistics attitudes
__________________________
Statistics Education Research Journal,
11(2), 103-123, http://www.stat.auckland.ac.nz/serj
(c)
International Association for Statistical Education (IASE/ISI), November, 2012
REFERENCES
* Denotes articles included in the systematic review of validity and
reliability evidence.
*Anastasiadou, S. D. (2011). Reliability and validity testing of a new scale for measuring attitudes toward learning statistics with technology. Acta Didactica Napocensia, 4(1), 1-10.
Auzmendi, E. (1991, April). Factors related to attitudes toward statistics: A study with a Spanish sample. Paper presented at the annual meeting of the American Educational Research Association, Chicago.
Bayot, A., Mondejar, J., Mondejar, J. A., Monsalve, F., & Vargas, M. (2005). The difficulties of learning concepts in the social sciences. In M. Misztal & M. Trawinski (Eds.), Studies in teacher education: Psychopedagogy (pp. 242-258). Krakow: Wydawnictwo Naukowe Akademii Pedagogicznej.
*Bendig, A. W., & Hughes, J. B. (1954). Student attitude and achievement in a course in introductory statistics. Journal of Educational Psychology, 45(5), 268-276.
*Berk, R. A., & Nanda, J. P. (1998). Effects of jocular instructional methods on attitudes, anxiety, and achievement in statistics courses. HUMOR: International Journal of Humor Research, 11(4), 383-410.
*Carlson, K. A., & Winquist, J. R. (2011). Evaluating an active learning approach to teaching introductory statistics: A classroom workbook approach. Journal of Statistics Education, 19(1).
[Online: http://www.amstat.org/publications/jse/v19n1/carlson.pdf ]
*Carnell, L. J. (2008). The effect of a student-designed data collection: Project on attitudes toward statistics. Journal of Statistics Education, 16(1).
[Online: http://www.amstat.org/publications/jse/v16n1/carnell.html ]
*Cashin, S. E., & Elmore, P. B. (2005). The Survey of Attitudes Toward Statistics scale: A construct validity study. Educational and Psychological Measurement, 65(3), 509-524.
*Chiesi, F., & Primi, C. (2009). Assessing statistics attitudes among college students: Psychometric properties of the Italian version of the Survey of Attitudes toward Statistics (SATS). Learning and Individual Differences, 19(2), 309-313.
[Online: http://dx.doi.org/10.1016/j.lindif.2008.10.008 ]
*Coetzee, S., & Merwe, P. v. d. (2010). Industrial psychology students' attitudes towards statistics. SA Journal of Industrial Psychology, 36, 1-8.
Cronbach, L. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16(3), 297-332.
*Dauphinee, T. L., Schau, C., & Stevens, J. J. (1997). Survey of Attitudes Toward Statistics: Factor structure and factorial invariance for women and men. Structural Equation Modeling, 4(2), 129-141.
*Dempster, M., & McCorry, N. K. (2009). The role of previous experience and attitudes toward statistics in statistics assessment outcomes among undergraduate psychology students. Journal of Statistics Education, 17(2).
[Online: http://www.amstat.org/publications/jse/v17n2/dempster.html ]
Douzenis, C. (1994, April). Graduate statistics education: A dilemma for students and faculty. Paper presented at the annual meeting of the American Educational Research Association, New Orleans.
Dutton, W. H., & Blum, M. P. (1968). The measurement of attitudes toward arithmetic with a Likert-type test. The Elementary School Journal, 68(5), 259-264.
Evans, B. (2005). Student attitudes, conceptions, and achievement in introductory undergraduate college statistics (Doctoral dissertation). Temple University. Available from Dissertation Abstracts International. (AAI3178774)
*Evans, B. (2007). Student attitudes, conceptions, and achievement in introductory undergraduate college statistics. Mathematics Educator, 17(2), 24-30.
*Feinberg, L. E., & Halperin, S. (1978). Affective and cognitive correlates of course performance in introductory statistics. Journal of Experimental Education, 46(4), 11-18.
Gal, I., & Ginsburg, L. (1994). The role of beliefs and attitudes in learning statistics: Towards an assessment framework. Journal of Statistics Education, 2(2), 1-15.
[Online: http://www.amstat.org/publications/jse/v2n2/gal.html ]
Gal, I., Ginsburg, L., & Schau, C. (1997). Monitoring attitudes and beliefs in statistics education. In I. Gal & J. B. Garfield (Eds.), The assessment challenge in statistics education (pp. 37-51). Amsterdam: IOS Press.
Garfield, J. (1995). How students learn statistics. International Statistical Review, 63(1), 25-34.
*Glencross, M. J., & Cherian, V. I. (1992). Attitudes toward applied statistics of postgraduate education students in Transkei. Psychological Reports, 70(1), 67-75.
[Online: http://dx.doi.org/10.2466/pr0.1992.70.1.67 ]
*Hilton, S. C., Schau, C., & Olsen, J. A. (2004). Survey of Attitudes Toward Statistics: Factor structure invariance by gender and by administration time. Structural Equation Modeling, 11(1), 92-109.
*Kottke, J. L. (2000). Mathematical proficiency, statistics knowledge, attitudes towards statistics, and measurement course performance. College Student Journal, 34(3), 334-347.
McCall, C. H., Belli, G., & Madjidi, F. (1990, August). The complexities of teaching graduate students in educational administration introductory statistical concepts. Paper presented at the Third International Conference on Teaching Statistics, Dunedin, New Zealand.
Messick, S. (1989). Validity. In R. L. Linn (Ed.), Validity (3rd ed., pp. 13-103). New York: Macmillan.
Messick, S. (1995). Validity of psychological assessment: Validation of inferences from persons' responses and performances as scientific inquiry into score meaning. American Psychologist, 50(9), 741-749.
*Mills, J. D. (2004). Students' attitudes toward statistics: Implications for the future. College Student Journal, 38(3), 349.
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & Group, T. P. (2009). Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. PLoS Medicine, 6(7).
[Online: http://www.plosmedicine.org/article/info%3Adoi%2F10.1371%2Fjournal.pmed.1000097 ]
*Mondejar-Jimenez, J., & Vargas-Vargas, M. (2010). Determinant factors of attitude towards quantitative subjects: Differences between sexes. Teaching and Teacher Education, 26(3), 688-693.
[Online: http://dx.doi.org/10.1016/j.tate.2009.10.004 ]
Moore, C. M. (1987). Group techniques for idea building (Vol. 9). Thousand Oaks, CA: Sage Publications.
*Nasser, F. (2004). Structural model of the effects of cognitive and affective factors on the achievement of Arabic-speaking pre-service teachers in introductory statistics. Journal of Statistics Education, 12(1).
[Online: http://www.amstat.org/publications/jse/v12n1/nasser.html ]
Onwuegbuzie, A. J., & Wilson, V. A. (2003). Statistics anxiety: Nature, etiology, antecedents, effects, and treatments¾a comprehensive review of the literature. Teaching in Higher Education, 8(2), 195-209.
*Perepiczka, M., Chandler, N., & Becerra, M. (2011). Relationship between graduate students' statistics self-efficacy, statistics anxiety, attitude toward statistics, and social support. The Professional Counselor: Research and Practice, 1(2), 99-108.
*Rhoads, T. R., & Hubele, N. F. (2000). Student attitudes toward statistics before and after a computer-integrated introductory statistics course. IEEE Transactions on Education, 43(2), 182-187.
*Roberts, D. M., & Bilderback, E. W. (1980). Reliability and validity of a statistics attitude survey. Educational and Psychological Measurement, 40(1), 235-238.
*Roberts, D. M., & Reese, C. M. (1987). A comparison of two scales measuring attitudes towards statistics. Educational and Psychological Measurement, 47(3), 759-764.
*Roberts, D. M., & Saxe, J. E. (1982). Validity of a statistics attitude survey: A follow-up study. Educational and Psychological Measurement, 42(3), 907-912.
Rogness, N. T. (1993). The development and validation of a multi-factorial instrument to measure students' attitudes toward a course in statistics. (Doctoral dissertation), University of Northern Colorado. Available from Proquest. (AAT 9413644)
*Schau, C., Stevens, J., Dauphinee, T. L., Del Vecchio, A. (1995). The development and validation of the Survey of Attitudes Toward Statistics. Educational and Psychological Measurement, 55(5), 868-875.
[Online: http://dx.doi.org/10.1177/0013164495055005022 ]
*Schutz, P. A., Drogosz, L. M., White, V. E., & Distefano, C. (1998). Prior knowledge, attitude, and strategy use in an introduction to statistics course. Learning and Individual Differences, 10(4), 291-308.
[Online: http://dx.doi.org/10.1016/S1041-6080%2899%2980124-1 ]
Sutarso, T. (1992, November). Students' attitudes toward statistics (STATS). Paper presented at the annual meeting of the Mid-South Educational Research Association, Knoxville, TN.
*Tempelaar, D. T., Gijselaers, W. H., & Schim van der Loeff, S. (2006). Puzzles in statistical reasoning. Journal of Statistics Education, 14(1).
[Online: www.amstat.org/publications/jse/v14n1/tempelaar.html ]
*Tempelaar, D. T., Gijselaers, W. H., Schim van der Loeff, S., & Nijhuis, J. F. (2007). A structural equation model analyzing the relationship of student achievement motivations and personality factors in a range of academic subject matter areas. Contemporary Educational Psychology, 32(1), 105-131.
[Online: http://dx.doi.org/10.1016/j.cedpsych.2006.10.004 ]
*Tempelaar, D. T., Schim van der Loeff, S., Gijselaers, W. H., & Nijhuis, J. F. (2011). On subject variations in achievement motivations: A study in business subjects. Research in Higher Education, 52(4), 395-419.
[Online: http://dx.doi.org/10.1007/s11162-010-9199-7 ]
*Tempelaar, D. T., Schim van der Loeff, S., & Gijselaers, W. H. (2007). A structural equation model analyzing the relationship of students' attitudes toward statistics, prior reasoning abilities and course performance. Statistics Education Research Journal, 6(2), 78-102.
[Online: http://www.stat.auckland.ac.nz/~iase/serj/SERJ6%282%29_Tempelaar.pdf ]
*VanHoof, S., Kuppens, S., Sotos, A. E. C., Verschaffel, L., & Onghena, P. (2011). Measuring statistics attitudes: Structure of the Survey of Attitudes Toward Statistics (SATS-36). Statistics Education Research Journal, 10(1), 35-51.
[Online: http://www.stat.auckland.ac.nz/~iase/serj/SERJ10%281%29_Vanhoof.pdf ]
*Vanhoof, S., Sotos, A. E. C., Onghena, P., Verschaffel, L., Van Dooren, W., & Van den Noortgate, W. (2006). Attitudes toward statistics and their relationship with short-and long-term exam results. Journal of Statistics Education, 14(3).
[Online: http://www.amstat.org/publications/jse/v14n3/vanhoof.html ]
*Waters, L., Martelli, T., Zakrajsek, T., & Popovich, P. M. (1988a). Factor analyses of two measures of attitudes toward statistics. Educational and Psychological Measurement, 48(4), 1037-1041. [Online: http://dx.doi.org/10.1177/0013164488484020 ]
*Waters, L., Martelli, T. A., Zakrajsek, T., & Popovich, P. M. (1988b). Attitudes toward statistics: An evaluation of multiple measures. Educational and Psychological Measurement, 48(2), 513-516.
[Online: http://dx.doi.org/10.1177/0013164488482026 ]
*Wiberg, M. (2009). Teaching statistics in integration with psychology. Journal of Statistics Education, 17(1).
[Online: http://www.amstat.org/publications/jse/v17n1/wiberg.html ]
*Wise, S. L. (1985). The development and validation of a scale measuring attitudes toward statistics. Educational and Psychological Measurement, 45(2), 401-405.
MEAGHAN NOLAN
Department of Veterinary Clinical and Diagnostic Sciences
Faculty of Veterinary Medicine
Health Sciences G380
University of Calgary
3330 Hospital Drive NW
Calgary, AB, Canad