Utilizing Generative AI Technology for Comprehensive HTA Report Analysis

Author(s)

Ayer T1, Ermis T2, Yildirim IF2, Balta D3, Samur S4, Chhatwal J5
1Value Analytics Labs and Georgia Tech, Atlanta, MA, USA, 2Value Analytics Labs, Boston, MA, USA, 3Value Analytics Labs, Wilmington, MA, USA, 4Value Analytics Labs, Chantilly, VA, USA, 5Harvard Medical School and Value Analytics Labs, Wilmington, MA, USA

OBJECTIVES: Scrutinizing Health Technology Assessment (HTA) reports is a resource-intensive but critical task for a successful market access strategy. Our objective was to showcase Generative-AI's capabilities in navigating and summarizing HTA reports.

METHODS: A generative-AI technology tailored for the life sciences industry, ValueGen.AI, was developed to analyze HTA reports, synthesize evidence and respond to ad-hoc user queries. For this study, we considered hepatocellular carcinoma and included all relevant NICE reports from the UK (NICE_TA849 on Cabozantinib, NICE_TA666 on Atezolizumab plus Bevacizumab, and NICE_TA555 on Regorafenib) over the past 3 years. Data extraction and synthesis were conducted using GPT-4o and LangChain library in Python. For demonstration, the Generative-AI was tasked to: 1) provide a safety and tolerability profile summary, 2) identify primary and secondary endpoints 3) analyze key critiques raised in the reports.

RESULTS: The AI effectively navigated and summarized information from HTA reports. In terms of safety, Cabozantinib was associated with manageable adverse events like diarrhea, palmar-plantar erythrodysesthesia, and hypertension, with perceived higher toxicity than Regorafenib. Atezolizumab plus Bevacizumab was associated with common adverse events including diarrhea, fatigue, hypertension, and elevated liver enzymes. Regorafenib was associated with serious adverse events such as physical health deterioration, ascites, and hepatic failure. Primary and secondary endpoints varied: Cabozantinib focused on overall survival (OS) with PFS and ORR as secondary, while Atezolizumab plus Bevacizumab and Regorafenib emphasized OS and PFS with additional endpoints like ORR, TTP, DCR, and quality of life. Key critiques included concerns over trial population comparability, higher toxicity for Cabozantinib, uncertainties in NMA results and generalizability for Atezolizumab plus Bevacizumab, and efficacy uncertainties and potential biases in utility values for Regorafenib. All Generative-AI responses were validated by human-in-the-loop.

CONCLUSIONS: Generative-AI technology can provide valuable insights and comprehensive analysis of HTA reports and makes navigating the complex landscape of global health technology assessments easy.

Conference/Value in Health Info

2024-11, ISPOR Europe 2024, Barcelona, Spain

Value in Health, Volume 27, Issue 12, S2 (December 2024)

Code

HTA240

Topic

Clinical Outcomes, Economic Evaluation, Health Technology Assessment, Methodological & Statistical Research

Topic Subcategory

Artificial Intelligence, Machine Learning, Predictive Analytics, Clinical Outcomes Assessment, Cost-comparison, Effectiveness, Utility, Benefit Analysis, Decision & Deliberative Processes

Disease

No Additional Disease & Conditions/Specialized Treatment Areas, Oncology

Your browser is out-of-date

ISPOR recommends that you update your browser for more security, speed and the best experience on ispor.org. Update my browser now

×