One of Keith's publications is the research paper:
Taber, K. S. (2018). The Use of Cronbach’s Alpha When Developing and Reporting Research Instruments in Science Education. Research in Science Education, 48, 1273–1296. doi:10.1007/s11165-016-9602-2
Abstract:
Cronbach’s alpha is a statistic commonly quoted by authors to demonstrate that tests and scales that have been constructed or adopted for research projects are fit for purpose. Cronbach’s alpha is regularly adopted in studies in science education: it was referred to in 69 different papers published in 4 leading science education journals in a single year (2015)— usually as a measure of reliability. This article explores how this statistic is used in reporting science education research and what it represents. Authors often cite alpha values with little commentary to explain why they feel this statistic is relevant and seldom interpret the result for readers beyond citing an arbitrary threshold for an acceptable value. Those authors who do offer readers qualitative descriptors interpreting alpha values adopt a diverse and seemingly arbitrary terminology. More seriously, illustrative examples from the science education literature demonstrate that alpha may be acceptable even when there are recognised problems with the scales concerned. Alpha is also sometimes inappropriately used to claim an instrument is unidimensional. It is argued that a high value of alpha offers limited evidence of the reliability of a research instrument, and that indeed a very high value may actually be undesirable when developing a test of scientific knowledge or understanding. Guidance is offered to authors reporting, and readers evaluating, studies that present Cronbach’s alpha statistic as evidence of instrument quality.
Keywords:
- Research methods
- Test development
- Scales
- Statistics
- Assessing knowledge and understanding
- Face equivalence
Contents:
Introduction
The Use of Cronbach’s Alpha in Science Education Studies
- The Frequency of Use of Cronbach’s Alpha in Science Education
- Describing the Significance of Alpha
- Characterising Values of Cronbach’s Alpha
- Examples of Alpha Cited in Measuring Affective Constructs
- Examples of Alpha Cited in Measuring Cognitive Constructs
- Key Findings Regarding the Use of Cronbach’s Alpha in Science Education Studies
The Nature of the Alpha Statistic
- What Does Alpha Actually Measure?
- What Value of Alpha Is Desirable?
Discussion
- Alpha Used to Characterise Tests of Broad Knowledge Domains
- Misuse of Alpha to Imply Unidimensionality
Conclusion
This paper is OpenAccess:
Download here
Find out why I decided to write a paper about Cronbach's alpha.
