Jump to content

Jingle-jangle fallacies

From Wikipedia, the free encyclopedia

Jingle-jangle fallacies are erroneous assumptions that either two different things are the same because they bear the same name (jingle fallacy); or two identical or almost identical things are different because they are labeled differently (jangle fallacy).[1][2][3] The term was coined by Truman Lee Kelley in his 1927 book Interpretation of educational measurements..[4] In research, a jangle fallacy is the inference that two measures (e.g., tests, scales) with different names measure different constructs. By comparison, a jingle fallacy is the assumption that two measures which are called by the same name capture the same construct.[5][6][7]

Examples

[edit]

An example of the jangle fallacy can be found in tests designed to assess emotional intelligence. Some of these tests measure merely personality or regular IQ-tests.[8] An example of the jingle fallacy is that personality and values are sometimes conflated and treated as the same construct.[9] Jingle and jangle fallacies make it challenging to review literatures for meta-analysis. Machine learning tools have been created to discover relevant papers even when the same construct is named differently in different articles.[10] Some authors have stated that the personality traits Machiavellianism and psychopathy represent the issue of a jangle fallacy, as both constructs are named differently yet describe the same concept.[11] A recent paper published in 2022 stated that Machiavellianism "is theoretically distinct from psychopathy, but empirically they are nearly indistinguishable".[12]

Views on the phenomenon

[edit]

Herbert Marsh highlighted the issue of jingle-jangle fallacies through a factor analysis of two distinct motivation assessments.[13][14] His analysis revealed that while the mastery and performance subscales from both instruments aligned with shared underlying factors, the competition subscales, despite being labeled identically, actually represented different psychological constructs: one tied to performance orientation, the other to task orientation.[14] This discrepancy illustrates the importance of conducting thorough construct validity studies to evaluate the true meaning behind measurement instruments. Simply demonstrating that items from a single scale load onto one factor when assessed in isolation does not confirm their distinctiveness when compared with items from other constructs in a broader factor analysis. Moreover, assigning a label to a factor does not justify assumptions about its relationship to other constructs, regardless of how similar or different they might appear.[14] Heyman and Dweck (1992) also warned that researchers must ensure they are not inadvertently measuring the same construct under different names.[15] Pajares (2009) echoed this concern, pointing out how conceptually similar variables may be operationalized differently across studies to serve specific research aims, often leading to confusion, particularly when perceptions of competence are misrepresented as self-efficacy.[16] Likewise, Bong & Skaalvik (2003) recommended the use of confirmatory factor analysis (CFA) and structural equation modeling (SEM) to rigorously test the structural, predictive, convergent, and discriminant validity of motivational constructs, helping to avoid what they termed a "conceptual mess."[17]

See also

[edit]

References

[edit]
  1. ^ Kelley, Truman Lee (1927). Interpretation of Educational Measurements. Yonkers-on-Hudson, N.Y.: World Book Company. pp. 62–65.
  2. ^ Roeser, Robert W.; Peck, Stephen C.; Nasir, Nailah Suad (2006). "Self and Identity Processes in School Motivation, Learning, and Achievement". In Alexander, Patricia k.; Winne, Philip H. (eds.). Handbook of Educational Psychology (2nd ed.). Mahwah, N.J.: Erlbaum. pp. 392–393. ISBN 978-0-8058-4937-0.
  3. ^ Pedhazur, Elazar J.; Pedhazur Schmelkin, Liora (1991). Measurement, Design, and Analysis: An Integrated Approach. Hillsdale, N.J.: Erlbaum. p. 74. ISBN 978-0-89859-555-0.
  4. ^ Kelley, Truman Lee (1927). Interpretation of Educational Measurements. World Book Company. ISBN 978-0-598-43399-2. {{cite book}}: ISBN / Date incompatibility (help)
  5. ^ Corsini, Raymond J. (1991). The Dictionary of Psychology. New York: Routledge. pp. 513, 514. ISBN 978-1-58391-328-4.
  6. ^ Marsh, Herbert W. (2007). "Physical Self-Concept and Sport". In Jowett, Sophia; Lavallee, David (eds.). Social Psychology in Sport. Champaign, IL: Human Kinetics. p. 168. ISBN 978-0-7360-5780-6.
  7. ^ Thorndike, Edward (1904). An Introduction to the Theory of Mental and Social Measures. New York, NY: Teachers College, Columbia University. pp. 10–11.
  8. ^ Gignac, Gilles E. (2009). "Psychometrics and the Measurement of Emotional Intelligence". In Stough, Con; Saklofske, Donald H.; Parker, James D. A. (eds.). Assessing Emotional Intelligence: Theory, Research, and Applications. New York: Springer. p. 33. ISBN 978-0-387-88370-0.
  9. ^ Higgs, Malcolm; Scott, Lichtenstein (2010). "Exploring the 'Jingle Fallacy': a study of personality and values". Journal of General Management. 36 (1): 43–61. doi:10.1177/030630701003600103.
  10. ^ Larsen, Kai R.; Bong, Chih How (2016-03-03). "A Tool for Addressing Construct Identity in Literature Reviews and Meta-Analyses". MIS Quarterly. 40 (3): 529–551. doi:10.25300/MISQ/2016/40.3.01.
  11. ^ Kowalski, Christopher Marcin; Vernon, Philip A.; Schermer, Julie Aitken (2021). "The Dark Triad and facets of personality". Current Psychology. 40 (11): 5547–5558. doi:10.1007/s12144-019-00518-0.
  12. ^ Kay, Cameron S.; Arrow, Holly (2022). "Taking an elemental approach to the conceptualization and measurement of Machiavellianism, narcissism, and psychopathy". Social and Personality Psychology Compass. 16 (4). doi:10.1111/spc3.12662.
  13. ^ Marsh, Herbert W. (1994). "Sport Motivation Orientations: Beware of Jingle-Jangle Fallacies". Journal of Sport and Exercise Psychology. 16 (4): 365–380. doi:10.1123/jsep.16.4.365.
  14. ^ a b c Marsh, Herbert W., Reinhard Pekrun, Philip D. Parker, Kou Murayama, Jiesi Guo, Theresa Dicke, and A. Katrin Arens. "The murky distinction between self-concept and self-efficacy: beware of lurking jingle-jangle fallacies." Journal of educational psychology 111, no. 2 (2019): 331.
  15. ^ Heyman, Gail D.; Dweck, Carol S. (1992). "Achievement goals and intrinsic motivation: Their relation and their role in adaptive motivation". Motivation and Emotion. 16 (3): 231–247. doi:10.1007/BF00991653.
  16. ^ Pajares, Frank (2001). "Toward a Positive Psychology of Academic Motivation". The Journal of Educational Research. 95: 27–35. doi:10.1080/00220670109598780.
  17. ^ Bong, Mimi; Skaalvik, Einar M. (2003). "Academic Self-Concept and Self-Efficacy: How Different Are They Really?". Educational Psychology Review. 15 (1): 1–40. doi:10.1023/A:1021302408382.

Further reading

[edit]
  • Marsh, Herbert W. (1994). "Sport Motivation Orientations: Beware of Jingle-Jangle Fallacies". Journal of Sport & Exercise Psychology. 16 (4): 365–380. doi:10.1123/jsep.16.4.365.