Measures of a Key Thinking Skill Keep Disagreeing
Research·November 3, 2026

Researchers who study how the mind works depend on tests to measure the processes they care about. A new large-scale study suggests that several of those measures, which are meant to capture the same underlying cognitive process, do not reliably agree with one another.
The core problem is consistency. When different tests of one mental process give conflicting readings for the same people, it becomes hard to know what any single score actually reflects. That matters for basic research, and for anyone who uses these tests to draw conclusions about how people think, learn or make decisions.
What makes the study stand out is also what it leaves out. According to its summary, the work is large but reports very little beyond negative results. Journals often favor clear, positive findings, so a paper built mostly on null results is unusual. Such work still has value, because it can stop other teams from repeating the same effort and can show where a measurement's assumptions break down.
The available summary does not name the specific tests, the sample or the statistical methods, so the size of the disagreement and its causes remain open questions. Until the full paper is read closely, the safest takeaway is that a widely used way of measuring this process may be less reliable than researchers have assumed.
Reporting based on an external source.