Recent quantitative research on determinants of health in high income countries: A scoping review

Roles Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Project administration, Software, Visualization, Writing – original draft, Writing – review & editing * E-mail: vladimira.varbanova@uantwerpen.be Affiliation Centre for Health Economics Research and Modelling Infectious Diseases, Vaccine and Infectious Disease Institute, University of Antwerp, Antwerp, Belgium

Roles Conceptualization, Data curation, Funding acquisition, Project administration, Resources, Supervision, Validation, Visualization, Writing – review & editing Affiliation Centre for Health Economics Research and Modelling Infectious Diseases, Vaccine and Infectious Disease Institute, University of Antwerp, Antwerp, Belgium ⨯

Recent quantitative research on determinants of health in high income countries: A scoping review

Figures

Abstract

Background

Identifying determinants of health and understanding their role in health production constitutes an important research theme. We aimed to document the state of recent multi-country research on this theme in the literature.

Methods

We followed the PRISMA-ScR guidelines to systematically identify, triage and review literature (January 2013—July 2019). We searched for studies that performed cross-national statistical analyses aiming to evaluate the impact of one or more aggregate level determinants on one or more general population health outcomes in high-income countries. To assess in which combinations and to what extent individual (or thematically linked) determinants had been studied together, we performed multidimensional scaling and cluster analysis.

Results

Sixty studies were selected, out of an original yield of 3686. Life-expectancy and overall mortality were the most widely used population health indicators, while determinants came from the areas of healthcare, culture, politics, socio-economics, environment, labor, fertility, demographics, life-style, and psychology. The family of regression models was the predominant statistical approach. Results from our multidimensional scaling showed that a relatively tight core of determinants have received much attention, as main covariates of interest or controls, whereas the majority of other determinants were studied in very limited contexts. We consider findings from these studies regarding the importance of any given health determinant inconclusive at present. Across a multitude of model specifications, different country samples, and varying time periods, effects fluctuated between statistically significant and not significant, and between beneficial and detrimental to health.

Conclusions

We conclude that efforts to understand the underlying mechanisms of population health are far from settled, and the present state of research on the topic leaves much to be desired. It is essential that future research considers multiple factors simultaneously and takes advantage of more sophisticated methodology with regards to quantifying health as well as analyzing determinants’ influence.

Citation: Varbanova V, Beutels P (2020) Recent quantitative research on determinants of health in high income countries: A scoping review. PLoS ONE 15(9): e0239031. https://doi.org/10.1371/journal.pone.0239031

Editor: Amir Radfar, University of Central Florida, UNITED STATES

Received: November 14, 2019; Accepted: August 28, 2020; Published: September 17, 2020

Copyright: © 2020 Varbanova, Beutels. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.

Data Availability: All relevant data are within the manuscript and its Supporting Information files.

Funding: This study (and VV) is funded by the Research Foundation Flanders (https://www.fwo.be/en/), FWO project number G0D5917N, award obtained by PB. The funder had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

Competing interests: The authors have declared that no competing interests exist.

Introduction

Identifying the key drivers of population health is a core subject in public health and health economics research. Between-country comparative research on the topic is challenging. In order to be relevant for policy, it requires disentangling different interrelated drivers of “good health”, each having different degrees of importance in different contexts.

“Good health”–physical and psychological, subjective and objective–can be defined and measured using a variety of approaches, depending on which aspect of health is the focus. A major distinction can be made between health measurements at the individual level or some aggregate level, such as a neighborhood, a region or a country. In view of this, a great diversity of specific research topics exists on the drivers of what constitutes individual or aggregate “good health”, including those focusing on health inequalities, the gender gap in longevity, and regional mortality and longevity differences.

The current scoping review focuses on determinants of population health. Stated as such, this topic is quite broad. Indeed, we are interested in the very general question of what methods have been used to make the most of increasingly available region or country-specific databases to understand the drivers of population health through inter-country comparisons. Existing reviews indicate that researchers thus far tend to adopt a narrower focus. Usually, attention is given to only one health outcome at a time, with further geographical and/or population [1, 2] restrictions. In some cases, the impact of one or more interventions is at the core of the review [3–7], while in others it is the relationship between health and just one particular predictor, e.g., income inequality, access to healthcare, government mechanisms [8–13]. Some relatively recent reviews on the subject of social determinants of health [4–6, 14–17] have considered a number of indicators potentially influencing health as opposed to a single one. One review defines “social determinants” as “the social, economic, and political conditions that influence the health of individuals and populations” [17] while another refers even more broadly to “the factors apart from medical care” [15].

In the present work, we aimed to be more inclusive, setting no limitations on the nature of possible health correlates, as well as making use of a multitude of commonly accepted measures of general population health. The goal of this scoping review was to document the state of the art in the recent published literature on determinants of population health, with a particular focus on the types of determinants selected and the methodology used. In doing so, we also report the main characteristics of the results these studies found. The materials collected in this review are intended to inform our (and potentially other researchers’) future analyses on this topic. Since the production of health is subject to the law of diminishing marginal returns, we focused our review on those studies that included countries where a high standard of wealth has been achieved for some time, i.e., high-income countries belonging to the Organisation for Economic Co-operation and Development (OECD) or Europe. Adding similar reviews for other country income groups is of limited interest to the research we plan to do in this area.

Methods

In view of its focus on data and methods, rather than results, a formal protocol was not registered prior to undertaking this review, but the procedure followed the guidelines of the PRISMA statement for scoping reviews [18].

Search

We focused on multi-country studies investigating the potential associations between any aggregate level (region/city/country) determinant and general measures of population health (e.g., life expectancy, mortality rate).

Within the query itself, we listed well-established population health indicators as well as the six world regions, as defined by the World Health Organization (WHO). We searched only in the publications’ titles in order to keep the number of hits manageable, and the ratio of broadly relevant abstracts over all abstracts in the order of magnitude of 10% (based on a series of time-focused trial runs). The search strategy was developed iteratively between the two authors and is presented in S1 Appendix. The search was performed by VV in PubMed and Web of Science on the 16 th of July, 2019, without any language restrictions, and with a start date set to the 1 st of January, 2013, as we were interested in the latest developments in this area of research.

Eligibility criteria

Records obtained via the search methods described above were screened independently by the two authors. Consistency between inclusion/exclusion decisions was approximately 90% and the 43 instances where uncertainty existed were judged through discussion. Articles were included subject to meeting the following requirements: (a) the paper was a full published report of an original empirical study investigating the impact of at least one aggregate level (city/region/country) factor on at least one health indicator (or self-reported health) of the general population (the only admissible “sub-populations” were those based on gender and/or age); (b) the study employed statistical techniques (calculating correlations, at the very least) and was not purely descriptive or theoretical in nature; (c) the analysis involved at least two countries or at least two regions or cities (or another aggregate level) in at least two different countries; (d) the health outcome was not differentiated according to some socio-economic factor and thus studied in terms of inequality (with the exception of gender and age differentiations); (e) mortality, in case it was one of the health indicators under investigation, was strictly “total” or “all-cause” (no cause-specific or determinant-attributable mortality).

Data extraction

The following pieces of information were extracted in an Excel table from the full text of each eligible study (primarily by VV, consulting with PB in case of doubt): health outcome(s), determinants, statistical methodology, level of analysis, results, type of data, data sources, time period, countries. The evidence is synthesized according to these extracted data (often directly reflected in the section headings), using a narrative form accompanied by a “summary-of-findings” table and a graph.

Results

Search and selection

The initial yield contained 4583 records, reduced to 3686 after removal of duplicates (Fig 1). Based on title and abstract screening, 3271 records were excluded because they focused on specific medical condition(s) or specific populations (based on morbidity or some other factor), dealt with intervention effectiveness, with theoretical or non-health related issues, or with animals or plants. Of the remaining 415 papers, roughly half were disqualified upon full-text consideration, mostly due to using an outcome not of interest to us (e.g., health inequality), measuring and analyzing determinants and outcomes exclusively at the individual level, performing analyses one country at a time, employing indices that are a mixture of both health indicators and health determinants, or not utilizing potential health determinants at all. After this second stage of the screening process, 202 papers were deemed eligible for inclusion. This group was further dichotomized according to level of economic development of the countries or regions under study, using membership of the OECD or Europe as a reference “cut-off” point. Sixty papers were judged to include high-income countries, and the remaining 142 included either low- or middle-income countries or a mix of both these levels of development. The rest of this report outlines findings in relation to high-income countries only, reflecting our own primary research interests. Nonetheless, we chose to report our search yield for the other income groups for two reasons. First, to gauge the relative interest in applied published research for these different income levels; and second, to enable other researchers with a focus on determinants of health in other countries to use the extraction we made here.

PowerPoint slide larger image original image Fig 1. PRISMA flow-diagram.

Health outcomes

The most frequent population health indicator, life expectancy (LE), was present in 24 of the 60 studies. Apart from “life expectancy at birth” (representing the average life-span a newborn is expected to have if current mortality rates remain constant), also called “period LE” by some [19, 20], we encountered as well LE at 40 years of age [21], at 60 [22], and at 65 [21, 23, 24]. In two papers, the age-specificity of life expectancy (be it at birth or another age) was not stated [25, 26].

Some studies considered male and female LE separately [21, 24, 25, 27–33]. This consideration was also often observed with the second most commonly used health index [28–30, 34–38]–termed “total”, or “overall”, or “all-cause”, mortality rate (MR)–included in 22 of the 60 studies. In addition to gender, this index was also sometimes broken down according to age group [30, 39, 40], as well as gender-age group [38].

While the majority of studies under review here focused on a single health indicator, 23 out of the 60 studies made use of multiple outcomes, although these outcomes were always considered one at a time, and sometimes not all of them fell within the scope of our review. An easily discernable group of indices that typically went together [25, 37, 41] was that of neonatal (deaths occurring within 28 days postpartum), perinatal (fetal or early neonatal / first-7-days deaths), and post-neonatal (deaths between the 29 th day and completion of one year of life) mortality. More often than not, these indices were also accompanied by “stand-alone” indicators, such as infant mortality (deaths within the first year of life; our third most common index found in 16 of the 60 studies), maternal mortality (deaths during pregnancy or within 42 days of termination of pregnancy), and child mortality rates. Child mortality has conventionally been defined as mortality within the first 5 years of life, thus often also called “under-5 mortality”. Nonetheless, Pritchard & Wallace used the term “child mortality” to denote deaths of children younger than 14 years [42].

As previously stated, inclusion criteria did allow for self-reported health status to be used as a general measure of population health. Within our final selection of studies, seven utilized some form of subjective health as an outcome variable [25, 43–48]. Additionally, the Health Human Development Index [49], healthy life expectancy [50], old-age survival [51], potential years of life lost [52], and disability-adjusted life expectancy [25] were also used.

We note that while in most cases the indicators mentioned above (and/or the covariates considered, see below) were taken in their absolute or logarithmic form, as a—typically annual—number, sometimes they were used in the form of differences, change rates, averages over a given time period, or even z-scores of rankings [19, 22, 40, 42, 44, 53–57].

Regions, countries, and populations

Despite our decision to confine this review to high-income countries, some variation in the countries and regions studied was still present. Selection seemed to be most often conditioned on the European Union, or the European continent more generally, and the Organisation of Economic Co-operation and Development (OECD), though, typically, not all member nations–based on the instances where these were also explicitly listed—were included in a given study. Some of the stated reasons for omitting certain nations included data unavailability [30, 45, 54] or inconsistency [20, 58], Gross Domestic Product (GDP) too low [40], differences in economic development and political stability with the rest of the sampled countries [59], and national population too small [24, 40]. On the other hand, the rationales for selecting a group of countries included having similar above-average infant mortality [60], similar healthcare systems [23], and being randomly drawn from a social spending category [61]. Some researchers were interested explicitly in a specific geographical region, such as Eastern Europe [50], Central and Eastern Europe [48, 60], the Visegrad (V4) group [62], or the Asia/Pacific area [32]. In certain instances, national regions or cities, rather than countries, constituted the units of investigation instead [31, 51, 56, 62–66]. In two particular cases, a mix of countries and cities was used [35, 57]. In another two [28, 29], due to the long time periods under study, some of the included countries no longer exist. Finally, besides “European” and “OECD”, the terms “developed”, “Western”, and “industrialized” were also used to describe the group of selected nations [30, 42, 52, 53, 67].

As stated above, it was the health status of the general population that we were interested in, and during screening we made a concerted effort to exclude research using data based on a more narrowly defined group of individuals. All studies included in this review adhere to this general rule, albeit with two caveats. First, as cities (even neighborhoods) were the unit of analysis in three of the studies that made the selection [56, 64, 65], the populations under investigation there can be more accurately described as general urban, instead of just general. Second, oftentimes health indicators were stratified based on gender and/or age, therefore we also admitted one study that, due to its specific research question, focused on men and women of early retirement age [35] and another that considered adult males only [68].

Data types and sources

A great diversity of sources was utilized for data collection purposes. The accessible reference databases of the OECD (https://www.oecd.org/), WHO (https://www.who.int/), World Bank (https://www.worldbank.org/), United Nations (https://www.un.org/en/), and Eurostat (https://ec.europa.eu/eurostat) were among the top choices. The other international databases included Human Mortality [30, 39, 50], Transparency International [40, 48, 50], Quality of Government [28, 69], World Income Inequality [30], International Labor Organization [41], International Monetary Fund [70]. A number of national databases were referred to as well, for example the US Bureau of Statistics [42, 53], Korean Statistical Information Services [67], Statistics Canada [67], Australian Bureau of Statistics [67], and Health New Zealand Tobacco control and Health New Zealand Food and Nutrition [19]. Well-known surveys, such as the World Values Survey [25, 55], the European Social Survey [25, 39, 44], the Eurobarometer [46, 56], the European Value Survey [25], and the European Statistics of Income and Living Condition Survey [43, 47, 70] were used as data sources, too. Finally, in some cases [25, 28, 29, 35, 36, 41, 69], built-for-purpose datasets from previous studies were re-used.

In most of the studies, the level of the data (and analysis) was national. The exceptions were six papers that dealt with Nomenclature of Territorial Units of Statistics (NUTS2) regions [31, 62, 63, 66], otherwise defined areas [51] or cities [56], and seven others that were multilevel designs and utilized both country- and region-level data [57], individual- and city- or country-level [35], individual- and country-level [44, 45, 48], individual- and neighborhood-level [64], and city-region- (NUTS3) and country-level data [65]. Parallel to that, the data type was predominantly longitudinal, with only a few studies using purely cross-sectional data [25, 33, 43, 45–48, 50, 62, 67, 68, 71, 72], albeit in four of those [43, 48, 68, 72] two separate points in time were taken (thus resulting in a kind of “double cross-section”), while in another the averages across survey waves were used [56].

In studies using longitudinal data, the length of the covered time periods varied greatly. Although this was almost always less than 40 years, in one study it covered the entire 20 th century [29]. Longitudinal data, typically in the form of annual records, was sometimes transformed before usage. For example, some researchers considered data points at 5- [34, 36, 49] or 10-year [27, 29, 35] intervals instead of the traditional 1, or took averages over 3-year periods [42, 53, 73]. In one study concerned with the effect of the Great Recession all data were in a “recession minus expansion change in trends”-form [57]. Furthermore, there were a few instances where two different time periods were compared to each other [42, 53] or when data was divided into 2 to 4 (possibly overlapping) periods which were then analyzed separately [24, 26, 28, 29, 31, 65]. Lastly, owing to data availability issues, discrepancies between the time points or periods of data on the different variables were occasionally observed [22, 35, 42, 53–55, 63].

Health determinants

Together with other essential details, Table 1 lists the health correlates considered in the selected studies. Several general categories for these correlates can be discerned, including health care, political stability, socio-economics, demographics, psychology, environment, fertility, life-style, culture, labor. All of these, directly or implicitly, have been recognized as holding importance for population health by existing theoretical models of (social) determinants of health [74–77].

PowerPoint slide larger image original image Table 1. List of studies included in the review.

It is worth noting that in a few studies there was just a single aggregate-level covariate investigated in relation to a health outcome of interest to us. In one instance, this was life satisfaction [44], in another–welfare system typology [45], but also gender inequality [33], austerity level [70, 78], and deprivation [51]. Most often though, attention went exclusively to GDP [27, 29, 46, 57, 65, 71]. It was often the case that research had a more particular focus. Among others, minimum wages [79], hospital payment schemes [23], cigarette prices [63], social expenditure [20], residents’ dissatisfaction [56], income inequality [30, 69], and work leave [41, 58] took center stage. Whenever variables outside of these specific areas were also included, they were usually identified as confounders or controls, moderators or mediators.

We visualized the combinations in which the different determinants have been studied in Fig 2, which was obtained via multidimensional scaling and a subsequent cluster analysis (details outlined in S2 Appendix). It depicts the spatial positioning of each determinant relative to all others, based on the number of times the effects of each pair of determinants have been studied simultaneously. When interpreting Fig 2, one should keep in mind that determinants marked with an asterisk represent, in fact, collectives of variables.

PowerPoint slide larger image original image Fig 2. “Map” of determinants connectedness.

Groups of determinants are marked by asterisks (see S1 Table in S1 Appendix). Diminishing color intensity reflects a decrease in the total number of “connections” for a given determinant. Noteworthy pairwise “connections” are emphasized via lines (solid-dashed-dotted indicates decreasing frequency). Grey contour lines encircle groups of variables that were identified via cluster analysis. Abbreviations: age = population age distribution, associations = membership in associations, AT-index = atherogenic-thrombogenic index, BR = birth rate, CAPB = Cyclically Adjusted Primary Balance, civilian-labor = civilian labor force, C-section = Cesarean delivery rate, credit-info = depth of credit information, dissatisf = residents’ dissatisfaction, distrib.orient = distributional orientation, EDU = education, eHealth = eHealth index at GP-level, exch.rate = exchange rate, fat = fat consumption, GDP = gross domestic product, GFCF = Gross Fixed Capital Formation/Creation, GH-gas = greenhouse gas, GII = gender inequality index, gov = governance index, gov.revenue = government revenues, HC-coverage = healthcare coverage, HE = health(care) expenditure, HHconsump = household consumption, hosp.beds = hospital beds, hosp.payment = hospital payment scheme, hosp.stay = length of hospital stay, IDI = ICT development index, inc.ineq = income inequality, industry-labor = industrial labor force, infant-sex = infant sex ratio, labor-product = labor production, LBW = low birth weight, leave = work leave, life-satisf = life satisfaction, M-age = maternal age, marginal-tax = marginal tax rate, MDs = physicians, mult.preg = multiple pregnancy, NHS = Nation Health System, NO = nitrous oxide emissions, PM10 = particulate matter (PM10) emissions, pop = population size, pop.density = population density, pre-term = pre-term birth rate, prison = prison population, researchE = research&development expenditure, school.ref = compulsory schooling reform, smoke-free = smoke-free places, SO = sulfur oxide emissions, soc.E = social expenditure, soc.workers = social workers, sugar = sugar consumption, terror = terrorism, union = union density, UR = unemployment rate, urban = urbanization, veg-fr = vegetable-and-fruit consumption, welfare = welfare regime, Wwater = wastewater treatment.

Distances between determinants in Fig 2 are indicative of determinants’ “connectedness” with each other. While the statistical procedure called for higher dimensionality of the model, for demonstration purposes we show here a two-dimensional solution. This simplification unfortunately comes with a caveat. To use the factor smoking as an example, it would appear it stands at a much greater distance from GDP than it does from alcohol. In reality however, smoking was considered together with alcohol consumption [21, 25, 26, 52, 68] in just as many studies as it was with GDP [21, 25, 26, 52, 59], five. To aid with respect to this apparent shortcoming, we have emphasized the strongest pairwise links. Solid lines connect GDP with health expenditure (HE), unemployment rate (UR), and education (EDU), indicating that the effect of GDP on health, taking into account the effects of the other three determinants as well, was evaluated in between 12 to 16 studies of the 60 included in this review. Tracing the dashed lines, we can also tell that GDP appeared jointly with income inequality, and HE together with either EDU or UR, in anywhere between 8 to 10 of our selected studies. Finally, some weaker but still worth-mentioning “connections” between variables are displayed as well via the dotted lines.

The fact that all notable pairwise “connections” are concentrated within a relatively small region of the plot may be interpreted as low overall “connectedness” among the health indicators studied. GDP is the most widely investigated determinant in relation to general population health. Its total number of “connections” is disproportionately high (159) compared to its runner-up–HE (with 113 “connections”), and then subsequently EDU (with 90) and UR (with 86). In fact, all of these determinants could be thought of as outliers, given that none of the remaining factors have a total count of pairings above 52. This decrease in individual determinants’ overall “connectedness” can be tracked on the graph via the change of color intensity as we move outwards from the symbolic center of GDP and its closest “co-determinants”, to finally reach the other extreme of the ten indicators (welfare regime, household consumption, compulsory school reform, life satisfaction, government revenues, literacy, research expenditure, multiple pregnancy, Cyclically Adjusted Primary Balance, and residents’ dissatisfaction; in white) the effects on health of which were only studied in isolation.

Lastly, we point to the few small but stable clusters of covariates encircled by the grey bubbles on Fig 2. These groups of determinants were identified as “close” by both statistical procedures used for the production of the graph (see details in S2 Appendix).

Statistical methodology

There was great variation in the level of statistical detail reported. Some authors provided too vague a description of their analytical approach, necessitating some inference in this section.

The issue of missing data is a challenging reality in this field of research, but few of the studies under review (12/60) explain how they dealt with it. Among the ones that do, three general approaches to handling missingness can be identified, listed in increasing level of sophistication: case-wise deletion, i.e., removal of countries from the sample [20, 45, 48, 58, 59], (linear) interpolation [28, 30, 34, 58, 59, 63], and multiple imputation [26, 41, 52].

Correlations, Pearson, Spearman, or unspecified, were the only technique applied with respect to the health outcomes of interest in eight analyses [33, 42–44, 46, 53, 57, 61]. Among the more advanced statistical methods, the family of regression models proved to be, by and large, predominant. Before examining this closer, we note the techniques that were, in a way, “unique” within this selection of studies: meta-analyses were performed (random and fixed effects, respectively) on the reduced form and 2-sample two stage least squares (2SLS) estimations done within countries [39]; difference-in-difference (DiD) analysis was applied in one case [23]; dynamic time-series methods, among which co-integration, impulse-response function (IRF), and panel vector autoregressive (VAR) modeling, were utilized in one study [80]; longitudinal generalized estimating equation (GEE) models were developed on two occasions [70, 78]; hierarchical Bayesian spatial models [51] and special autoregressive regression [62] were also implemented.

Purely cross-sectional data analyses were performed in eight studies [25, 45, 47, 50, 55, 56, 67, 71]. These consisted of linear regression (assumed ordinary least squares (OLS)), generalized least squares (GLS) regression, and multilevel analyses. However, six other studies that used longitudinal data in fact had a cross-sectional design, through which they applied regression at multiple time-points separately [27, 29, 36, 48, 68, 72].

Apart from these “multi-point cross-sectional studies”, some other simplistic approaches to longitudinal data analysis were found, involving calculating and regressing 3-year averages of both the response and the predictor variables [54], taking the average of a few data-points (i.e., survey waves) [56] or using difference scores over 10-year [19, 29] or unspecified time intervals [40, 55].

Moving further in the direction of more sensible longitudinal data usage, we turn to the methods widely known among (health) economists as “panel data analysis” or “panel regression”. Most often seen were models with fixed effects for country/region and sometimes also time-point (occasionally including a country-specific trend as well), with robust standard errors for the parameter estimates to take into account correlations among clustered observations [20, 21, 24, 28, 30, 32, 34, 37, 38, 41, 52, 59, 60, 63, 66, 69, 73, 79, 81, 82]. The Hausman test [83] was sometimes mentioned as the tool used to decide between fixed and random effects [26, 49, 63, 66, 73, 82]. A few studies considered the latter more appropriate for their particular analyses, with some further specifying that (feasible) GLS estimation was employed [26, 34, 49, 58, 60, 73]. Apart from these two types of models, the first differences method was encountered once as well [31]. Across all, the error terms were sometimes assumed to come from a first-order autoregressive process (AR(1)), i.e., they were allowed to be serially correlated [20, 30, 38, 58–60, 73], and lags of (typically) predictor variables were included in the model specification, too [20, 21, 37, 38, 48, 69, 81]. Lastly, a somewhat different approach to longitudinal data analysis was undertaken in four studies [22, 35, 48, 65] in which multilevel–linear or Poisson–models were developed.

Regardless of the exact techniques used, most studies included in this review presented multiple model applications within their main analysis. None attempted to formally compare models in order to identify the “best”, even if goodness-of-fit statistics were occasionally reported. As indicated above, many studies investigated women’s and men’s health separately [19, 21, 22, 27–29, 31, 33, 35, 36, 38, 39, 45, 50, 51, 64, 65, 69, 82], and covariates were often tested one at a time, including other covariates only incrementally [20, 25, 28, 36, 40, 50, 55, 67, 73]. Furthermore, there were a few instances where analyses within countries were performed as well [32, 39, 51] or where the full time period of interest was divided into a few sub-periods [24, 26, 28, 31]. There were also cases where different statistical techniques were applied in parallel [29, 55, 60, 66, 69, 73, 82], sometimes as a form of sensitivity analysis [24, 26, 30, 58, 73]. However, the most common approach to sensitivity analysis was to re-run models with somewhat different samples [39, 50, 59, 67, 69, 80, 82]. Other strategies included different categorization of variables or adding (more/other) controls [21, 23, 25, 28, 37, 50, 63, 69], using an alternative main covariate measure [59, 82], including lags for predictors or outcomes [28, 30, 58, 63, 65, 79], using weights [24, 67] or alternative data sources [37, 69], or using non-imputed data [41].

Findings

As the methods and not the findings are the main focus of the current review, and because generic checklists cannot discern the underlying quality in this application field (see also below), we opted to pool all reported findings together, regardless of individual study characteristics or particular outcome(s) used, and speak generally of positive and negative effects on health. For this summary we have adopted the 0.05-significance level and only considered results from multivariate analyses. Strictly birth-related factors are omitted since these potentially only relate to the group of infant mortality indicators and not to any of the other general population health measures.

Starting with the determinants most often studied, higher GDP levels [21, 26, 27, 29, 30, 32, 43, 48, 52, 58, 60, 66, 67, 73, 79, 81, 82], higher health [21, 37, 47, 49, 52, 58, 59, 68, 72, 82] and social [20, 21, 26, 38, 79] expenditures, higher education [26, 39, 52, 62, 72, 73], lower unemployment [60, 61, 66], and lower income inequality [30, 42, 53, 55, 73] were found to be significantly associated with better population health on a number of occasions. In addition to that, there was also some evidence that democracy [36] and freedom [50], higher work compensation [43, 79], distributional orientation [54], cigarette prices [63], gross national income [22, 72], labor productivity [26], exchange rates [32], marginal tax rates [79], vaccination rates [52], total fertility [59, 66], fruit and vegetable [68], fat [52] and sugar consumption [52], as well as bigger depth of credit information [22] and percentage of civilian labor force [79], longer work leaves [41, 58], more physicians [37, 52, 72], nurses [72], and hospital beds [79, 82], and also membership in associations, perceived corruption and societal trust [48] were beneficial to health. Higher nitrous oxide (NO) levels [52], longer average hospital stay [48], deprivation [51], dissatisfaction with healthcare and the social environment [56], corruption [40, 50], smoking [19, 26, 52, 68], alcohol consumption [26, 52, 68] and illegal drug use [68], poverty [64], higher percentage of industrial workers [26], Gross Fixed Capital creation [66] and older population [38, 66, 79], gender inequality [22], and fertility [26, 66] were detrimental.

It is important to point out that the above-mentioned effects could not be considered stable either across or within studies. Very often, statistical significance of a given covariate fluctuated between the different model specifications tried out within the same study [20, 49, 59, 66, 68, 69, 73, 80, 82], testifying to the importance of control variables and multivariate research (i.e., analyzing multiple independent variables simultaneously) in general. Furthermore, conflicting results were observed even with regards to the “core” determinants given special attention, so to speak, throughout this text. Thus, some studies reported negative effects of health expenditure [32, 82], social expenditure [58], GDP [49, 66], and education [82], and positive effects of income inequality [82] and unemployment [24, 31, 32, 52, 66, 68]. Interestingly, one study [34] differentiated between temporary and long-term effects of GDP and unemployment, alluding to possibly much greater complexity of the association with health. It is also worth noting that some gender differences were found, with determinants being more influential for males than for females, or only having statistically significant effects for male health [19, 21, 28, 34, 36, 37, 39, 64, 65, 69].

Discussion

The purpose of this scoping review was to examine recent quantitative work on the topic of multi-country analyses of determinants of population health in high-income countries.

Measuring population health via relatively simple mortality-based indicators still seems to be the state of the art. What is more, these indicators are routinely considered one at a time, instead of, for example, employing existing statistical procedures to devise a more general, composite, index of population health, or using some of the established indices, such as disability-adjusted life expectancy (DALE) or quality-adjusted life expectancy (QALE). Although strong arguments for their wider use were already voiced decades ago [84], such summary measures surface only rarely in this research field.

On a related note, the greater data availability and accessibility that we enjoy today does not automatically equate to data quality. Nonetheless, this is routinely assumed in aggregate level studies. We almost never encountered a discussion on the topic. The non-mundane issue of data missingness, too, goes largely underappreciated. With all recent methodological advancements in this area [85–88], there is no excuse for ignorance; and still, too few of the reviewed studies tackled the matter in any adequate fashion.

Much optimism can be gained considering the abundance of different determinants that have attracted researchers’ attention in relation to population health. We took on a visual approach with regards to these determinants and presented a graph that links spatial distances between determinants with frequencies of being studies together. To facilitate interpretation, we grouped some variables, which resulted in some loss of finer detail. Nevertheless, the graph is helpful in exemplifying how many effects continue to be studied in a very limited context, if any. Since in reality no factor acts in isolation, this oversimplification practice threatens to render the whole exercise meaningless from the outset. The importance of multivariate analysis cannot be stressed enough. While there is no “best method” to be recommended and appropriate techniques vary according to the specifics of the research question and the characteristics of the data at hand [89–93], in the future, in addition to abandoning simplistic univariate approaches, we hope to see a shift from the currently dominating fixed effects to the more flexible random/mixed effects models [94], as well as wider application of more sophisticated methods, such as principle component regression, partial least squares, covariance structure models (e.g., structural equations), canonical correlations, time-series, and generalized estimating equations.

Finally, there are some limitations of the current scoping review. We searched the two main databases for published research in medical and non-medical sciences (PubMed and Web of Science) since 2013, thus potentially excluding publications and reports that are not indexed in these databases, as well as older indexed publications. These choices were guided by our interest in the most recent (i.e., the current state-of-the-art) and arguably the highest-quality research (i.e., peer-reviewed articles, primarily in indexed non-predatory journals). Furthermore, despite holding a critical stance with regards to some aspects of how determinants-of-health research is currently conducted, we opted out of formally assessing the quality of the individual studies included. The reason for that is two-fold. On the one hand, we are unaware of the existence of a formal and standard tool for quality assessment of ecological designs. And on the other, we consider trying to score the quality of these diverse studies (in terms of regional setting, specific topic, outcome indices, and methodology) undesirable and misleading, particularly since we would sometimes have been rating the quality of only a (small) part of the original studies—the part that was relevant to our review’s goal.

Our aim was to investigate the current state of research on the very broad and general topic of population health, specifically, the way it has been examined in a multi-country context. We learned that data treatment and analytical approach were, in the majority of these recent studies, ill-equipped or insufficiently transparent to provide clarity regarding the underlying mechanisms of population health in high-income countries. Whether due to methodological shortcomings or the inherent complexity of the topic, research so far fails to provide any definitive answers. It is our sincere belief that with the application of more advanced analytical techniques this continuous quest could come to fruition sooner.

Supporting information

S1 Checklist. Preferred reporting items for systematic reviews and meta-analyses extension for scoping reviews (PRISMA-ScR) checklist.

S1 Appendix.

S2 Appendix.

References

  1. 1. Hollowell J, Oakley L, Kurinczuk JJ, Brocklehurst P, Gray R. The effectiveness of antenatal care programmes to reduce infant mortality and preterm birth in socially disadvantaged and vulnerable women in high-income countries: a systematic review. Bmc Pregnancy Childb. 2011;11.
  2. 2. Viner RM, Ozer EM, Denny S, Marmot M, Resnick M, Fatusi A, et al. Adolescent Health 2 Adolescence and the social determinants of health. Lancet. 2012;379(9826):1641–52. pmid:22538179
  3. 3. Mulreany JP, Calikoglu S, Ruiz S, Sapsin JW. Water privatization and public health in Latin America. Rev Panam Salud Publ. 2006;19(1):23–32.
  4. 4. Williams DR, Costa MV, Odunlami AO, Mohammed SA. Moving Upstream: How Interventions That Address the Social Determinants of Health Can Improve Health and Reduce Disparities. J Public Health Man. 2008:S8–S17.
  5. 5. Bambra C, Gibson M, Sowden A, Wright K, Whitehead M, Petticrew M. Tackling the wider social determinants of health and health inequalities: evidence from systematic reviews. J Epidemiol Community Health. 2010;64(4):284–91. pmid:19692738
  6. 6. Newman L, Baum F, Javanparast S, O'Rourke K, Carlon L. Addressing social determinants of health inequities through settings: a rapid review. Health Promot Int. 2015;30:126–43. pmid:25252597
  7. 7. Pega F, Liu SY, Walter S, Pabayo R, Saith R, Lhachimi SK. Unconditional cash transfers for reducing poverty and vulnerabilities: effect on use of health services and health outcomes in low- and middle-income countries. Cochrane Db Syst Rev. 2017(11).
  8. 8. Lynch J, Smith GD, Harper S, Hillemeier M, Ross N, Kaplan GA, et al. Is income inequality a determinant of population health? Part 1. A systematic review. Milbank Q. 2004;82(1):5–99. pmid:15016244
  9. 9. Houweling TA, Kunst AE. Socio-economic inequalities in childhood mortality in low- and middle-income countries: a review of the international evidence. Br Med Bull. 2010;93:7–26. pmid:20007188
  10. 10. Rutherford ME, Mulholland K, Hill PC. How access to health care relates to under-five mortality in sub-Saharan Africa: systematic review. Trop Med Int Health. 2010;15(5):508–19. pmid:20345556
  11. 11. Ciccone DK, Vian T, Maurer L, Bradley EH. Linking governance mechanisms to health outcomes: A review of the literature in low- and middle-income countries. Soc Sci Med. 2014;117:86–95. pmid:25054281
  12. 12. Kelly C, Hulme C, Farragher T, Clarke G. Are differences in travel time or distance to healthcare for adults in global north countries associated with an impact on health outcomes? A systematic review. Bmj Open. 2016;6(11).
  13. 13. Parmar D, Stavropoulou C, Ioannidis JPA. Health outcomes during the 2008 financial crisis in Europe: systematic literature review. Bmj-Brit Med J. 2016;354.
  14. 14. Braveman P, Egerter S, Williams DR. The Social Determinants of Health: Coming of Age. Annual Review of Public Health, Vol 32. 2011;32:381–98. pmid:21091195
  15. 15. Braveman P, Gottlieb L. The Social Determinants of Health: It's Time to Consider the Causes of the Causes. Public Health Rep. 2014;129:19–31.
  16. 16. Eshetu E, Woldesenbet S. Are there particular social determinants of health for the world's poorest countries? Afr Health Sci. 2011;11(1):108–15. pmid:21572866
  17. 17. Lucyk K, McLaren L. Taking stock of the social determinants of health: A scoping review. Plos One. 2017;12(5).
  18. 18. Tricco AC, Lillie E, Zarin W, O'Brien KK, Colquhoun H, Levac D, et al. PRISMA Extension for Scoping Reviews (PRISMA-ScR): Checklist and Explanation. Ann Intern Med. 2018;169(7):467–+. pmid:30178033
  19. 19. Laugesen M, Grace RC. Reduced tobacco consumption, improved diet and life expectancy for 1988–1998: analysis of New Zealand and OECD data. New Zeal Med J. 2017;130(1456):46–51. pmid:28571048
  20. 20. Reynolds MM, Avendano M. Social Policy Expenditures and Life Expectancy in High-Income Countries. Am J Prev Med. 2018;54(1):72–9. pmid:29254555
  21. 21. Barthold D, Nandi A, Rodriguez JMM, Heymann J. Analyzing Whether Countries Are Equally Efficient at Improving Longevity for Men and Women. Am J Public Health. 2014;104(11):2163–9. pmid:24328639
  22. 22. Kim JI, Kim G. Socio-ecological perspective of older age life expectancy: income, gender inequality, and financial crisis in Europe. Globalization Health. 2017;13.
  23. 23. Wubulihasimu P, Brouwer W, van Baal P. The Impact of Hospital Payment Schemes on Healthcare and Mortality: Evidence from Hospital Payment Reforms in OECD Countries. Health Econ. 2016;25(8):1005–19. pmid:26080792
  24. 24. Granados JAT, Ionides EL. Population health and the economy: Mortality and the Great Recession in Europe. Health Econ. 2017;26(12):E219–E35. pmid:28345272
  25. 25. Mackenbach JP. Cultural values and population health: a quantitative analysis of variations in cultural values, health behaviours and health outcomes among 42 European countries. Health Place. 2014;28:116–32. pmid:24835023
  26. 26. Zare H, Gaskin DJ, Anderson G. Variations in life expectancy in Organization for Economic Co-operation and Development countries-1985-2010. Scand J Public Healt. 2015;43(8):786–95.
  27. 27. Mackenbach JP. Convergence and divergence of life expectancy in Europe: a centennial view. Eur J Epidemiol. 2013;28(3):229–40. pmid:23184355
  28. 28. Mackenbach JP, Hu YN, Looman CWN. Democratization and life expectancy in Europe, 1960–2008. Soc Sci Med. 2013;93:166–75. pmid:23791138
  29. 29. Mackenbach JP, Looman CWN. Life expectancy and national income in Europe, 1900–2008: an update of Preston's analysis. Int J Epidemiol. 2013;42(4):1100–10. pmid:23920140
  30. 30. Torre R, Myrskyla M. Income inequality and population health: An analysis of panel data for 21 developed countries, 1975–2006. Pop Stud-J Demog. 2014;68(1):1–13.
  31. 31. Bartoll X, Mari-Dell'Olmo M. Patterns of life expectancy before and during economic recession, 2003–12: a European regions panel approach. Eur J Public Health. 2016;26(5):783–8. pmid:27371666
  32. 32. Blazquez-Fernandez C, Cantarero-Prieto D, Pascual-Saez M. Health expenditure and socio-economic determinants of life expectancy in the OECD Asia/Pacific area countries. Appl Econ Lett. 2017;24(3):167–9.
  33. 33. Kolip P, Lange C. Gender inequality and the gender gap in life expectancy in the European Union. Eur J Public Health. 2018;28(5):869–72. pmid:29767703
  34. 34. Bender KA, Economou A, Theodossiou I. The temporary and permanent effects of unemployment on mortality in Europe. Int Labour Rev. 2013;152(2):275–86.
  35. 35. Harding S, Lenguerrand E, Costa G, d'Errico A, Martikainen P, Tarkiainen L, et al. Trends in mortality by labour market position around retirement ages in three European countries with different welfare regimes. Int J Public Health. 2013;58(1):99–108. pmid:22543726
  36. 36. Mackenbach JP, Looman CWN. Changing patterns of mortality in 25 European countries and their economic and political correlates, 1955–1989. Int J Public Health. 2013;58(6):811–23. pmid:24061593
  37. 37. Budhdeo S, Watkins J, Atun R, Williams C, Zeltner T, Maruthappu M. Changes in government spending on healthcare and population mortality in the European union, 1995–2010: a cross-sectional ecological study. J Roy Soc Med. 2015;108(12):490–8. pmid:26510733
  38. 38. Ferreira ER, Monteiro JD, Manso JRP. Are economic crises age and gender neutral? Evidence from European Union mortality data. Econ Anal Policy. 2018;60:69–77.
  39. 39. Gathmann C, Jurges H, Reinhold S. Compulsory schooling reforms, education and mortality in twentieth century Europe. Soc Sci Med. 2015;127:74–82. pmid:24560098
  40. 40. Bremberg SG. Mortality rates in OECD countries converged during the period 1990–2010. Scand J Public Healt. 2017;45(4):436–43.
  41. 41. Shim J. Family leave policy and child mortality: Evidence from 19 OECD countries from 1969 to 2010. Int J Soc Welf. 2016;25(3):215–21.
  42. 42. Pritchard C, Wallace MS. Comparing UK and Other Western Countries' Health Expenditure, Relative Poverty and Child Mortality: Are British Children Doubly Disadvantaged? Child Soc. 2015;29(5):462–72.
  43. 43. Megyesiova S, Lieskovska V. The Relationship between the Health Status and Economic Situation in the Eu Member States. Int Multiddiscip Sci. 2014:1097–104.
  44. 44. Koots-Ausmees L, Realo A. The Association Between Life Satisfaction and Self-Reported Health Status in Europe. Eur J Personality. 2015;29(6):647–57.
  45. 45. Aguilar-Palacio I, Gil-Lacruz AI, Sanchez-Recio R, Rabanaque MJ. Self-rated health in Europe and its determinants: Does generation matter? Int J Public Health. 2018;63(2):223–32. pmid:29383383
  46. 46. Liobikiene G, Bernatoniene J. The determinants of access to information on the Internet and knowledge of health related topics in European countries. Health Policy. 2018;122(12):1348–55. pmid:30337158
  47. 47. Tavares AI. eHealth, ICT and its relationship with self-reported health outcomes in the EU countries. Int J Med Inform. 2018;112:104–13. pmid:29500007
  48. 48. Borisova LV. Objective and Subjective Determinants of Self-Rated Health in Central and Eastern Europe: A Multilevel Approach. Cent Eur J Publ Heal. 2019;27(2):145–52.
  49. 49. Lopez-Casasnovas G, Soley-Bori M. The Socioeconomic Determinants of Health: Economic Growth and Health in the OECD Countries during the Last Three Decades. Int J Env Res Pub He. 2014;11(1):815–29.
  50. 50. Minagawa Y. Inequalities in Healthy Life Expectancy in Eastern Europe. Popul Dev Rev. 2013;39(4):649–71.
  51. 51. Ribeiro AI, Krainski ET, Carvalho MS, Launoy G, Pornet C, de Pina MD. Does community deprivation determine longevity after the age of 75? A cross-national analysis. Int J Public Health. 2018;63(4):469–79. pmid:29480326
  52. 52. Park MB, Nam EW. National Level Social Determinants of Health and Outcomes: Longitudinal Analysis of 27 Industrialized Countries. Sage Open. 2019;9(2).
  53. 53. Pritchard C, Williams RJ, Wallace MS. Child mortality, health expenditure and poverty in the western nations 1979–2010: Are English-speaking countries' children disadvantaged? Childhood. 2015;22(1):138–44.
  54. 54. Safaei J. Distributional Orientation and Health Outcomes in OECD Countries. Int J Health Serv. 2015;45(4):601–21. pmid:26159174
  55. 55. Bremberg SG. The rate of country-level improvements of the infant mortality rate is mainly determined by previous history. Eur J Public Health. 2016;26(4):597–601. pmid:27132275
  56. 56. Ribeiro AI, Fraga S, Barros H. Residents' Dissatisfaction and All-Cause Mortality. Evidence from 74 European Cities. Front Psychol. 2018;8.
  57. 57. Ballester J, Robine JM, Herrmann FR, Rodo X. Effect of the Great Recession on regional mortality trends in Europe. Nat Commun. 2019;10.
  58. 58. Patton D, Costich JF, Lidstromer N. Paid Parental Leave Policies and Infant Mortality Rates in OECD Countries: Policy Implications for the United States. World Med Health Pol. 2017;9(1):6–23.
  59. 59. Reynolds MM. Health Care Public Sector Share and the US Life Expectancy Lag: A Country-level Longitudinal Study. Int J Health Serv. 2018;48(2):328–48. pmid:29350076
  60. 60. Asandului M, Pintilescu C, Jemna D, Viorica D. Infant Mortality and the Socioeconomic Conditions in the Cee Countries after 1990. Transform Bus Econ. 2014;13(3c):555–65.
  61. 61. Baumbach A, Gulis G. Impact of financial crisis on selected health outcomes in Europe. Eur J Public Health. 2014;24(3):399–403. pmid:24709510
  62. 62. Bosakova L, Rosicova K, Bobakova DF, Rosic M, Dzurova D, Pikhart H, et al. Mortality in the Visegrad countries from the perspective of socioeconomic inequalities. Int J Public Health. 2019;64(3):365–76. pmid:30535783
  63. 63. Filippidis FT, Laverty AA, Hone T, Been JV, Millett C. Association of Cigarette Price Differentials With Infant Mortality in 23 European Union Countries. Jama Pediatr. 2017;171(11):1100–6. pmid:28975220
  64. 64. Marinacci C, Demaria M, Melis G, Borrell C, Corman D, Dell'Olmo MM, et al. The Role of Contextual Socioeconomic Circumstances and Neighborhood Poverty Segregation on Mortality in 4 European Cities. Int J Health Serv. 2017;47(4):636–54. pmid:28969505
  65. 65. Richardson EA, Moon G, Pearce J, Shortt NK, Mitchell R. Multi-scalar influences on mortality change over time in 274 European cities. Soc Sci Med. 2017;179:45–51. pmid:28254658
  66. 66. Khouri S, Cehlar M, Horansky K, Sandorova K. Expected Life Expectancy and Its Determinants in Selected European Countries. Transform Bus Econ. 2017;16(2b):638–55.
  67. 67. Xie RH, Gaudet L, Krewski D, Graham ID, Walker MC, Wen SW. Higher Cesarean Delivery Rates are Associated with Higher Infant Mortality Rates in Industrialized Countries. Birth-Iss Perinat C. 2015;42(1):62–9.
  68. 68. Korotayev A, Khaltourina D, Meshcherina K, Zamiatnina E. Distilled Spirits Overconsumption as the Most Important Factor of Excessive Adult Male Mortality in Europe. Alcohol Alcoholism. 2018;53(6):742–52. pmid:30113627
  69. 69. Hu YN, van Lenthe FJ, Mackenbach JP. Income inequality, life expectancy and cause-specific mortality in 43 European countries, 1987–2008: a fixed effects study. Eur J Epidemiol. 2015;30(8):615–25. pmid:26177800
  70. 70. Rajmil L, Taylor-Robinson D, Gunnlaugsson G, Hjern A, Spencer N. Trends in social determinants of child health and perinatal outcomes in European countries 2005–2015 by level of austerity imposed by governments: a repeat cross-sectional analysis of routinely available data. Bmj Open. 2018;8(10).
  71. 71. Iacob OC, Volintiru AM, Cristea A, Turcu E. Sustainable Position of European Countries Based on Life Expectancy at Birth and the Risk of Poverty. Sci Pap-Ser Manag Ec. 2015;15(4):117–24.
  72. 72. Karyani AK, Kazemi Z, Shaahmadi F, Arefi Z, Meshkani Z. The Main Determinants of Under 5 Mortality Rate (U5MR) in OECD Countries: A Cross-Sectional Study. Int J Pediatr-Massha. 2015;3(1):421–7.
  73. 73. Tavares AI. Infant mortality in Europe, socio-economic determinants based on aggregate data. Appl Econ Lett. 2017;24(21):1588–96.
  74. 74. Evans RG, Stoddart GL. Producing Health, Consuming Health-Care. Soc Sci Med. 1990;31(12):1347–63. pmid:2126895
  75. 75. Dahlgren G, Whitehead M. Policies and Strategies to Promote Equity in Health. Stockholm, Sweden: Institute for Future Studies; 1991.
  76. 76. Brunner E, Marmot M. Social Organization, Stress, and Health. In: Marmot M, Wilkinson RG, editors. Social Determinants of Health. Oxford, England: Oxford University Press; 1999.
  77. 77. Najman JM. A General Model of the Social Origins of Health and Well-being. In: Eckersley R, Dixon J, Douglas B, editors. The Social Origins of Health and Well-being. Cambridge, England: Cambridge University Press; 2001.
  78. 78. Rajmil L, de Sanmamed MJF. Austerity Policies and Mortality Rates in European Countries, 2011–2015. Am J Public Health. 2019;109(5):768–70. pmid:30897000
  79. 79. Lenhart O. The impact of minimum wages on population health: evidence from 24 OECD countries. Eur J Health Econ. 2017;18(8):1031–9. pmid:27844176
  80. 80. Linden M, Ray D. Life expectancy effects of public and private health expenditures in OECD countries 1970–2012: Panel time series approach. Econ Anal Policy. 2017;56:101–13.
  81. 81. Erdogan E, Ener M, Arica F. The Strategic Role of Infant Mortality in the Process of Economic Growth: An Application for High Income OECD Countries. Procd Soc Behv. 2013;99:19–25.
  82. 82. Blazquez-Fernandez C, Cantarero-Prieto D, Pascual-Saez M. Does Rising Income Inequality Reduce Life Expectancy? New Evidence for 26 European Countries (1995–2014). Global Econ Rev. 2018;47(4):464–79.
  83. 83. Hausman JA. Specification tests in econometrics. Econometrica. 1978;46(6):1251–71.
  84. 84. Kindig DA. Purchasing population health: Aligning financial incentives to improve health outcomes. Health Serv Res. 1998;33(2):223–42.
  85. 85. Carpenter JR, Kenward MG. Multiple Imputation and its Application. New York: John Wiley & Sons; 2013.
  86. 86. Molenberghs G, Fitzmaurice G, Kenward MG, Verbeke G, Tsiatis AA. Handbook of Missing Data Methodology. Boca Raton: Chapman & Hall/CRC; 2014.
  87. 87. van Buuren S. Flexible Imputation of Missing Data. 2nd ed. Boca Raton: Chapman & Hall/CRC; 2018.
  88. 88. Enders CK. Applied Missing Data Analysis. New York: Guilford; 2010.
  89. 89. Shayle R. Searle GC, Charles E. McCulloch. Variance Components: John Wiley & Sons, Inc.; 1992.
  90. 90. Agresti A. Foundations of Linear and Generalized Linear Models. Hoboken, New Jersey: John Wiley & Sons Inc.; 2015.
  91. 91. Leyland A. H. (Editor) HGE. Multilevel Modelling of Health Statistics: John Wiley & Sons Inc; 2001.
  92. 92. Garrett Fitzmaurice MD, Geert Verbeke, Geert Molenberghs. Longitudinal Data Analysis. New York: Chapman and Hall/CRC; 2008.
  93. 93. Wolfgang Karl Härdle LS. Applied Multivariate Statistical Analysis. Berlin, Heidelberg: Springer; 2015.
  94. 94. Bell A, Jones K. Explaining Fixed Effects: Random Effects Modeling of Time-Series Cross-Sectional and Panel Data. Polit Sci Res Meth. 2015;3(1):133–53.
Advertisement

Subject Areas

For more information about PLOS Subject Areas, click here.

We want your feedback. Do these Subject Areas make sense for this article? Click the target next to the incorrect Subject Area and let us know. Thanks for your help!

Is the Subject Area "Socioeconomic aspects of health" applicable to this article? Yes No Thanks for your feedback.

Is the Subject Area "Europe" applicable to this article? Yes No Thanks for your feedback. Is the Subject Area "Health economics" applicable to this article? Yes No Thanks for your feedback. Is the Subject Area "Fertility rates" applicable to this article? Yes No Thanks for your feedback.

Is the Subject Area "Behavioral and social aspects of health" applicable to this article? Yes No Thanks for your feedback.

Is the Subject Area "European Union" applicable to this article? Yes No Thanks for your feedback.

Is the Subject Area "Health informatics" applicable to this article? Yes No Thanks for your feedback.

Is the Subject Area "Life expectancy" applicable to this article? Yes No Thanks for your feedback.

PLOS is a nonprofit 501(c)(3) corporation, #C2354500, based in San Francisco, California, US