Abstract

Objectives

Digital health technologies (DHTs) can optimise healthcare costs and improve quality and efficiency of care. However, the fast-paced rate of innovation and varying evidence standards can make it difficult for decision-makers to assess these technologies in an efficient and evidence-based manner. We sought to develop a comprehensive framework to assess the value of novel patient-facing DHTs used to manage chronic diseases by eliciting stakeholder value preferences.

Methods

Literature review and primary data collection from a three-round web-Delphi exercise was utilized. 79 participants from 5 stakeholder groups (patients, physicians, industry, decision makers, and influencers) and 3 countries (United States of America, United Kingdom, and Germany) took part. Likert scale data were statistically analyzed to determine intergroup differences in both country and stakeholder groups, stability of results, and overall consensus.

Results

The resulting co-created framework comprised 33 stable indicators with consensus from quantitative value judgments across domains: health inequalities, data rights and governance, technical and security, economic characteristics, clinical characteristics, and user preferences. Lack of stakeholder consensus was observed on the importance of value-based care models, optimizing resources for sustainable systems, and stakeholder involvement in DHT design, development, and implementation; however, this was because of high rates of neutrality and not negative judgments. Supply-side actors and academic experts were the most unstable stakeholder groups.

Conclusion

Stakeholder value judgments revealed a need for a coordinated regulatory and health technology assessment policy response that updates laws to meet technological innovations, offers a pragmatic approach to evidence standards to assess DHTs, and involves stakeholders to understand and meet their needs.