REASONING ABOUT INFORMAL STATISTICAL

INFERENCE: ONE STATISTICIAN’S VIEW

 

ALLAN J. ROSSMAN

California Polytechnic State UniversitySan Luis Obispo

arossman@calpoly.edu

 

ABSTRACT

 

This paper identifies key concepts and issues associated with the reasoning of informal statistical inference. I focus on key ideas of inference that I think all students should learn, including at secondary level as well as tertiary. I argue that a fundamental component of inference is to go beyond the data at hand, and I propose that statistical inference requires basing the inference on a probability model. I present several examples using randomization tests for connecting the randomness used in collecting data to the inference to be drawn. I also mention some related points from psychology and indicate some points of contention among statisticians, which I hope will clarify rather than obscure issues.

 

Keywords: Statistical reasoning; Statistical significance; Randomization tests

 

 

__________________________

Statistics Education Research Journal, 7(2), 5-19, http://www.stat.auckland.ac.nz/serj

Ó International Association for Statistical Education (IASE/ISI), November, 2008

 

 

 

REFERENCES

 

Antonioli, C., & Reveley, M. (2005). Randomized controlled trial of animal facilitated therapy with dolphins in the treatment of depression. British Medical Journal, 331(7527), 1231-1234.

Carlton, M. (2003). Comment on “Confusion over measures of evidence (p’s) versus errors (a’s) in classical statistical testing.” The American Statistician, 57, 179-181.

Chance, B., & Rossman, A. (2006). Investigating statistical concepts, applications, and methods. Belmont, CA: Cengage.

Cobb, G. (2007). The introductory statistics course: A Ptolemaic curriculum? Technology Innovations in Statistics Education, 1(1).

[Online: http://repositories.cdlib.org/uclastat/cts/tise/]

Cobb, G., & Gelbach, S. (2005). Statistics in the courtroom. In R. Peck, et al. (Eds.), Statistics: A guide to the unknown. Belmont, CA: Thomson.

Ernst, M. (2004). Permutation methods: A basis for exact inference. Statistical Science, 19, 676-685.

Fisher, R. (1925). Statistical Methods for Research Workers. Edinburgh: Oliver & Boyd.

Fisher, R. (1935a). The logic of inductive inference. Journal of the Royal Statistical Society, 98, 39-54.

Fisher, R. (1935b). Statistical tests. Nature, 136, 474.

Franklin, C., Kader, G., Mewborn, D., Moreno, J., Peck, R., Perry, M., et al. (2005). Guidelines for assessment and instruction in statistics education (GAISE) report: A Pre-K-12 curriculum framework. Alexandria, VA: American Statistical Association.

[Online: http://www.amstat.org/education/gaise/]

Güntürkün, O. (2003). Adult persistence of head-turning asymmetry. Nature, 421, 711.

Hamlin, J. K., Wynn, K., & Bloom, P. (2007). Social evaluation by preverbal infants. Nature, 450, 557-560.

Harlow, L., Mulaik, S., & Steiger, J. (Eds.) (1997). What if there were no significance tests? Mahwah, NJ: Lawrence Erlbaum Associates.

Harradine, A. (2008, July). Birthing big ideas in the minds of babes. Paper presented at the IASE/ICMI Roundtable Conference, Monterrey, Mexico.

Hubbard, R., & Bayarri, M. (2003). Confusion over measures of evidence (p’s) versus errors (a’s) in classical statistical testing. The American Statistician, 57, 171-178.

Lehmann, E. (1994). The Fisher, Neyman-Pearson theories of testing hypotheses: One theory or two? Journal of the American Statistical Association, 88, 1242-1249.

Lehmann, E. (2008). Reminiscences of a statistician: The company I kept. New York: Springer.

Neyman, J. (1935). Discussion of “Logic of inductive inference.” Journal of the Royal Statistical Society, 98, 74-75.

Neyman, J. (1955). The problem of inductive inference. Communications in Pure and Applied Mathematics, 8, 13-46.

Nickerson, R. (2004). Cognition and chance: The psychology of probabilistic reasoning. Mahwah, NJ: Lawrence Erlbaum Associates.

Ramsey, F., & Schafer, D. (2002). The statistical sleuth: A course in methods of data analysis (2nd ed.). Belmont, CA: Duxbury Press.

Salsburg, D. (2001). The lady tasting tea: How statistics revolutionized science in the twentieth century. New York: W.H. Freeman.

Scheaffer, R., & Tabor, J. (2008). Statistics in the high school mathematics curriculum: Building sound reasoning under uncertainty. Mathematics Teacher, 102(1), 56.

Stanovich, K. (2007). How to think straight about psychology (8th ed.). Upper Saddle River, NJ: Allyn & Bacon.

Wason, P., & Johnson Laird, P. (1972). Psychology of reasoning: Structure and content. London: Batsford.

Wild, C. (2006). The concept of distribution. Statistics Education Research Journal, 5(2), 10-26. [Online: www.stat.auckland.ac.nz/~iase/serj/SERJ5(2)_Wild.pdf]

Ziliak, S., & McCloskey, D. (2008). The cult of statistical significance: How the standard error costs us jobs, justice, and lives. Ann Arbor: University of Michigan Press.

 

ALLAN J. ROSSMAN

Department of Statistics

Cal Poly

San Luis Obispo, CA 93407