A Good Practices Report of the ISPOR Machine Learning Task Force
Lawrenceville, NJ, USA—July 5, 2022—Value in Health, the official journal of ISPOR—the professional society for health economics and outcomes research, announced today the publication of new guidance for health economics and outcomes research (HEOR) and decision makers in the use of an important class of artificial intelligence techniques. The report, “Machine Learning Methods in Health Economics and Outcomes Research - The PALISADE Checklist: A Good Practices Report of the ISPOR Machine Learning Task Force,” is published in the July 2022 issue of Value in Health.
“Machine learning is a potentially valuable addition to the HEOR toolkit,” said the task force co-chairs and lead authors William Crown, PhD, and William V. Padula, PhD. “It can facilitate the search for complex relationships in high-dimensional datasets, such as those generated by electronic health records or mobile health devices. These relationships can be used to improve detection and classification of disease, to identify cohorts of patients sharing characteristics that might not be obvious when considering only a small set of variables using traditional methods, and to forecast trajectories of health outcomes under alternative personalized treatment options. In this report, the task force focused on the potential applications of machine learning in HEOR.”
The authors identified 5 methodological areas where machine learning could enhance HEOR: (1) cohort selection (ie, identifying samples with greater specificity with respect to inclusion criteria); (2) identification of independent predictors and covariates of health outcomes; (3) predictive analytics of health outcomes, including those that are high cost and/or life threatening; (4) causal inference through methods, such as targeted maximum likelihood estimation or double/debiased estimation—helping to produce reliable evidence about real-world treatment effectiveness more quickly; and (5) application of machine learning to the development of economic models to reduce structural, parameter, and sampling uncertainty in cost-effectiveness analysis.
To examine whether machine learning offers a useful and transparent solution to healthcare analytics, the task force also developed the PALISADE Checklist. This checklist offers a series of considerations that researchers can use to explore whether machine learning adds value to traditional approaches to research. It can be a guide for balancing the many potential applications of machine learning with the need for transparency in methods development and findings.
“Our report presents all these considerations in an order reflecting a standard approach to performing HEOR: identifying a study population; classifying exposures that can alter outcomes; predicting the association between exposures and outcomes; assessing causal effects of interventions; and understanding whether or not interventions or healthcare policy decisions add value,” said Crown and Padula. “The intent is to introduce these concepts at a high level and refer readers to sources where they can learn more about theory and techniques that can support and advance the HEOR field. More collaboration between communities of HEOR scientists and computer scientists with machine learning expertise is encouraged to more rapidly enable learning from each other.”
Background on the ISPOR Machine Learning Methods in HEOR Task Force
As demand for studies on the application of machine learning in healthcare has grown, so has the number of researchers who are conducting these studies and those using the findings from these studies. Researchers who conduct HEOR using machine learning methods come from diverse backgrounds and may lack basic training in the theory and methods for computer and data science. In addition, many of these researchers may not be aware of the range of machine learning methods available and the contexts in which they should be used most appropriately, recognizing both their strengths and limitations.
The Task Force’s overall objective is to establish guidance for emerging good practices in the application of machine learning methodology to traditional ISPOR methods, including economic evaluation, decision sciences and outcomes research in order to improve the value of healthcare delivery.
###
ABOUT ISPOR
ISPOR, the professional society for health economics and outcomes research (HEOR), is an international, multistakeholder, nonprofit dedicated to advancing HEOR excellence to improve decision making for health globally. The Society is the leading source for scientific conferences, peer-reviewed and MEDLINE®-indexed publications, good practices guidance, education, collaboration, and tools/resources in the field.
Website | LinkedIn | Twitter (@ispororg) | YouTube | Facebook | Instagram
ABOUT VALUE IN HEALTH
Value in Health (ISSN 1098-3015) is an international, indexed journal that publishes original research and health policy articles that advance the field of health economics and outcomes research to help healthcare leaders make evidence-based decisions. The journal’s 2020 impact factor score is 5.725 and its 5-year impact factor score is 6.932. Value in Health is ranked 4th of 98 journals in health policy and services, 9th of 108 journals in healthcare sciences and services, and 24th of 376 journals in economics. Value in Health is a monthly publication that circulates to more than 10,000 readers around the world.
Website | Twitter (@isporjournals)
ABOUT ISPOR GOOD PRACTICES REPORTS
ISPOR has earned an international reputation for research excellence based, in part, on its Good Practices Reports. These highly cited reports are expert consensus recommendations on good practice standards for outcomes research (clinical, economic, and patient-reported outcomes) and on the use of this research in healthcare decision making. ISPOR Task Forces comprise subject matter experts representing different stakeholders from diverse work environments (ie, regulators, payers, manufacturers, technology assessors, etc from research, government, academic, and industry sectors around the world). All ISPOR Good Practices Reports are published in the Society’s scientific journal, Value in Health, and are made freely available as part of the Society’s mission. The Society’s Good Practices Reports have been recognized with an ASAE “Power of A” award that acknowledges innovative, effective, and broad-reaching programs that have a positive impact on the world.