August 15, 2019

The sad truth about happiness scales

Economists tested nine happiness studies and came to wildly different conclusions

WEST LAFAYETTE, Ind. — You might feel sad after looking closer at studies about happiness. That’s because an emotion that’s easy to experience is immensely difficult to measure, says Purdue University economist Timothy Bond.

“Happiness research usually asks subjects to rank their happiness on a scale, sometimes with as little as three points: ‘not too happy,’ ‘pretty happy’ and ‘very happy.’ But not everyone who says they’re pretty happy feels the same,” said Bond, an associate professor in the Krannert School of Management and a faculty affiliate in the Purdue University Research Center in Economics.

Bond teaching Tim Bond, an economist in the Krannert School of Management, was part of a team of economists that tested nine happiness studies. (Purdue University photo) Download image

“It’s a very broad category,” he added, “so there could be differences in intensity within the categories that you just can’t measure with these studies.”

Over the last four years, Bond and Boston University economist Kevin Lang have studied the flaws in prominent happiness research by applying well-known results from statistics and microeconomic theory. Their findings recently were published in the Journal of Political Economy.

“We take these tools and apply them to nine studies in happiness literature and show that if you change the assumptions about what’s going on inside the categories even mildly, you can completely change the conclusions of happiness research,” Bond said.

Drawing from data commonly used by social scientists, such as the General Social Survey and the World Values Survey, the researchers tested nine key results from happiness literature, such as the effect of marriage, children and disabilities on happiness, as well as cross-country comparisons. By skewing data slightly to the left or right within the reported categories, they could not draw conclusions stronger than: “Nigeria is somewhere between the happiest and least happy country in the world” or “the effect of the unemployment rate on average happiness is somewhere between very positive and very negative,” according to the study.

The problems arise, Bond said, because happiness is a subjective emotion which is experienced along a continuum.

Tim bond Tim Bond (Purdue University photo)
Download image

“Because there’s so few categories, you don’t know where people fall within them,” Bond said. “The second problem is that we don’t know if people all use the categories the same way. I might say I’m pretty happy, but if you felt the same way, you might say you’re very happy.”

Yet lawmakers increasingly have turned to happiness scales to inform policy on an array of issues, such as entitlement programs, unemployment and inflation. Over the past decade, the United Nations and several countries, including the United Kingdom, have gathered data on individual happiness in an attempt to create a more holistic measure of well-being compared to gross domestic product.

“People readily acknowledge that GDP is not a perfect way of measuring the economic health of a country,” Bond said, “but the extreme limitations you have in analyzing data suggest that replacing GDP with happiness scores would certainly be premature.”

Happiness research, however, remains influential in the eyes of stakeholders, media and the general public, with the most popular studies being focused on cross-country comparisons, Bond said. The UN recently released its 2019 World Happiness report, for example, ranking No. 1 Finland well ahead of the United States at No. 19.

Lang said several measures should be taken into account to assess a country’s well-being. The UN report analyzed GDP and life expectancy in addition to survey data from Gallup.

“Our research shows that we simply cannot use surveys to measure happiness in a way that makes them meaningful as a social or economic indicator or that can be used to guide policy,” Lang said. “We want to go beyond GDP, but we should focus on indicators such as suicide, longevity and morbidity, and environmental degradation.”

Because so many factors contribute to well-being, it will always be difficult, if it not impossible, to distill a country’s economic complexities into a single score, Bond said.

“Using these measures that take a lot of things into account is better than using just one,” he said. “The problem is people like a single summary score; it’s a really seductive thing. Usually, that’s not the best policy, but that’s where we end up.”

Writer: Joseph Paul, 765-494-9541, paul102@purdue.edu

Source: Tim Bond, 765-496-3664, bond10@purdue.edu

Note to Journalists: Reporters interested in a copy of the paper should contact Joseph Paul, Purdue News Service, 765-494-9541, paul102@purdue.edu


The Sad Truth about Happiness Scales

Timothy N. Bond, Purdue University and Institute of Labor Economics (IZA)

 Kevin Lang, Boston University, National Bureau of Economic Research, and Institute of Labor Economics (IZA)

Happiness is reported in ordered intervals (e.g., very, pretty, not too happy). We review and apply standard statistical results to determine when such data permit identification of two groups’ relative average happiness. The necessary conditions for nonparametric identification are strong and unlikely to ever be satisfied. Standard parametric approaches cannot identify this ranking unless the variances are exactly equal. If not, ordered probit findings can be reversed by lognormal transformations. For nine prominent happiness research areas, conditions for nonparametric identification are rejected and standard parametric results are reversed using plausible transformations. Tests for a common reporting function consistently reject.


Purdue University, 610 Purdue Mall, West Lafayette, IN 47907, (765) 494-4600

© 2015-22 Purdue University | An equal access/equal opportunity university | Copyright Complaints | Maintained by Office of Strategic Communications

Trouble with this page? Disability-related accessibility issue? Please contact News Service at purduenews@purdue.edu.