What are the minimal sample size requirements for Mokken scaling? An empirical example with the Warwick-Edinburgh Mental Well-being Scale

Watson, Roger; Egberink, Iris J. L.; Kirke, Lisa; Tendeiro, Jorge N.; Doyle, Frank

Abstract

Purpose
Sample size in Mokken scales is mostly studied on simulated data, reflected in the lack of consideration of sample size in most Mokken scaling studies. Recently, Straat et al. (2014) provided minimum sample size requirements for Mokken scale analysis based on simulation. Our study uses real data from the Warwick-Edinburgh Mental Well-Being Scale (N = 8463) to assess whether these hold.

Methods
We use per element accuracy to evaluate the impact of sample size, with scaling coefficients and confidence intervals around scale, item and item pair scalability coefficients.

Results
Per element accuracy, scalability coefficients, and confidence intervals around scalability coefficients are sensitive to sample size. The results from Straat et al. were not replicated; depending on the main goal of the research, sample sizes ranging from >250 to >1000 are needed.

Conclusions
Using our pragmatic approach, some practical recommendations are made regarding sample sizes for studies of Mokken scaling.

Citation

Watson, R., Egberink, I. J., Kirke, L., Tendeiro, J. N., & Doyle, F. (in press). What are the minimal sample size requirements for Mokken scaling? An empirical example with the Warwick-Edinburgh Mental Well-being Scale. Health Psychology and Behavioral Medicine, 6(1), 203-213. https://doi.org/10.1080/21642850.2018.1505520

• Journal Article Type: Article
• Acceptance Date: Jul 15, 2018
• Online Publication Date: Aug 8, 2018
• Deposit Date: Aug 8, 2018
• Publicly Available Date: Aug 9, 2018
• Journal: Health Psychology and Behavioral Medicine
• Electronic ISSN: 2164-2850
• Publisher: Taylor and Francis
• Peer Reviewed: Peer Reviewed
• Volume: 6
• Issue: 1
• Pages: 203-213
• DOI: https://doi.org/10.1080/21642850.2018.1505520
• Keywords: Mokken scaling; Item response theory; Per element accuracy; Scalability; Sample size
• Public URL: https://hull-repository.worktribe.com/output/966615
• Publisher URL: https://www.tandfonline.com/doi/full/10.1080/21642850.2018.1505520