Achilleas Kostoulas

Published

Revised

Revisiting Likert scales, levels of measurement: a nuanced understanding

This post revisits the debate about Likert scales: are they ordinal or interval data, and what does this mean for analysis? While individual items only yield ordinal data, some argue composite scales may be treated as interval. The discussion weighs these perspectives, highlights common pitfalls (like calculating means), and points readers to further resources on…

Statistical analysis of Likert scale data with charts, calculator, and magnifying glass symbolising ordinal vs interval debate in research methods

Revisiting Likert scales, levels of measurement: a nuanced understanding

I have found it moderately bemusing that my post on Likert scales has received so much attention, considering that I had only intended to mention statistics in passing, in order to make what I perceived to be a more broadly relevant remark.

Because my authorial intention was not to educate readers in statistics, the views I expressed in that post do not reflect the full extent on scholarship on Likert scaling. I also may have stated my point in more absolute terms than what I would have otherwise used.

I do stand by my basic premise: a ranking scale consisting of five verbal descriptors (e.g., strongly disagree, disagree, undecided, agree, strongly agree) can only produce ordinal data. The same applies even if we replace descriptors with numerical codes, or any other kind of shorthand. But what about composite scales, which synthesise many such items? And what about we only anchor the ranking scales on the two ends of the continuum? There are many instruments in the research methods toolkit, and they all have slightly different uses.

A more nuanced perspective on Likert scales

I am grateful to Florentina Taylor (update: link no longer active) who took the time to provide a somewhat different perspective, and has kindly permitted me to quote her in this post. Here’s what she had to say:

Hello, Achilleas!

Thank you for a useful and informative post (which I’ve just discovered) – though I disagree with your strong view of Likert scales always eliciting ordinal data.

The problem is assuming that the interval between two adjacent response options is always the same. This doesn’t make sense when labelling all the options, as this clearly makes the data ordinal (or nominal). However, if only the first and the last response options are labelled and the respondent is asked for the strength of their reported opinions/ feelings (e.g., on a scale of 1-6, where 1=very bad and 6=very good), then the intervals can be assumed to be equal.

I am not hoping to persuade you – I just think it is fair that this alternative point of view is added to this discussion.

Copy-pasting below something I wrote about this a while ago, with some references:

‘There has been some controversy regarding the nature of the data produced by self-reported scales, these being considered a grey area between ordinal and continuous variables (Field, 2009; Kinnear & Gray, 2008). Although attitudes and feelings cannot be measured with the same precision of pure scientific variables, it is generally accepted in the social sciences that self-reported data can be regarded as continuous (interval) and used in parametric statistics (Agresti & Finlay, 1997; Pallant, 2007; Sharma, 1996). […] Blunch (2008, p. 83) maintains that treating self-reported scales as interval/ continuous variables is most realistic if the scales have at least 5 possible values and the variable distribution is “nearly normal”.’


Achilleas Kostoulas


Comments

2 responses to “Revisiting Likert scales, levels of measurement: a nuanced understanding”

  1. That it is generally accepted in social sciences does not make it correct; that argument suffers from what I call the “Brooklyn Bridge” fallacy – where, just because everyone else does something, that doesn’t mean that something is correct (as in, if everyone else jumped off the Brooklyn Bridge, that doesn’t mean it’s a good idea). I would also suggest that the idea of a normal distribution on a 5-option item seems rather silly, for lack of a better term.

  2. Hi! Thanks for adding your thoughts to this discussion!

Leave a Reply

This site uses Akismet to reduce spam. Learn how your comment data is processed.

Discover more from Achilleas Kostoulas

Subscribe now to keep reading and get access to the full archive.

Continue reading