Mind the (inter-rater) gap. An investigation of self-reported versus proxy-reported assessments in the derivation of childhood utility values for economic evaluation: A systematic review

Jyoti Khadka, Joseph Kwon, Stavros Petrou, Emily Lancsar, Julie Ratcliffe

Research output: Contribution to journalReview article

Abstract

Purpose: Evidence surrounding utilities for health states, derived either directly from the application of preference-based valuation methods or indirectly from the application of preference-based quality of life instruments, is increasingly being utilised to inform the cost-effectiveness of child health interventions. Proxy (parent or health professional) assessments are common in this area. This study sought to investigate the degree of convergence in childhood utilities generated directly or indirectly within dyad child and proxy assessments. Methods: A systematic literature review was conducted following PRISMA guidelines. A comprehensive literature search strategy conducted across six search engines (PubMed, Embase, Web of Science, PsychoINFO, EconLit, CINAHL and Cochrane Library). Original peer-reviewed articles that reported utilities derived directly or indirectly using simultaneous dyad child and proxy assessments were extracted. Mean and median utilities, correlation coefficients and levels of agreement were extracted, catalogued and assessed. Results: A total of 35 studies that reported utilities for two or more respondent types were identified. Of these, 29 studies reported dyad childhood self-report and proxy utilities whilst six studies reported levels of agreement and/or correlations only without documenting overall utilities. Proxy assessment was most often conducted by parents with the HUI3 representing the most commonly applied instrument across a range of health conditions. The utilities derived from child and parent proxy assessment were bidirectional with parental proxies tending to underestimate and health professional proxies tending to overestimate relative to child self-reports. Inter-rater agreement between child self-reports and parent-proxy reports were poorer for more subjective attributes (cognition, emotion and pain), relative to physical attributes (mobility, self-care, speech, vision) of health-related quality of life. Conclusions: Childhood utilities derived from children or proxies are not interchangeable. The choice of self or proxy assessor may have potentially significant implications for economic evaluations of child health interventions.

LanguageEnglish
Article number112543
JournalSocial Science and Medicine
Volume240
DOIs
Publication statusPublished - 1 Nov 2019

Keywords

  • Childhood
  • Direct valuation methods
  • Health economics
  • Multi-attribute instrument
  • Proxy-reports
  • Quality of life
  • Self-reports

ASJC Scopus subject areas

  • Health(social science)
  • History and Philosophy of Science

Cite this

@article{31e33e56f6d04718a21ce7b06d7fc007,
title = "Mind the (inter-rater) gap. An investigation of self-reported versus proxy-reported assessments in the derivation of childhood utility values for economic evaluation: A systematic review",
abstract = "Purpose: Evidence surrounding utilities for health states, derived either directly from the application of preference-based valuation methods or indirectly from the application of preference-based quality of life instruments, is increasingly being utilised to inform the cost-effectiveness of child health interventions. Proxy (parent or health professional) assessments are common in this area. This study sought to investigate the degree of convergence in childhood utilities generated directly or indirectly within dyad child and proxy assessments. Methods: A systematic literature review was conducted following PRISMA guidelines. A comprehensive literature search strategy conducted across six search engines (PubMed, Embase, Web of Science, PsychoINFO, EconLit, CINAHL and Cochrane Library). Original peer-reviewed articles that reported utilities derived directly or indirectly using simultaneous dyad child and proxy assessments were extracted. Mean and median utilities, correlation coefficients and levels of agreement were extracted, catalogued and assessed. Results: A total of 35 studies that reported utilities for two or more respondent types were identified. Of these, 29 studies reported dyad childhood self-report and proxy utilities whilst six studies reported levels of agreement and/or correlations only without documenting overall utilities. Proxy assessment was most often conducted by parents with the HUI3 representing the most commonly applied instrument across a range of health conditions. The utilities derived from child and parent proxy assessment were bidirectional with parental proxies tending to underestimate and health professional proxies tending to overestimate relative to child self-reports. Inter-rater agreement between child self-reports and parent-proxy reports were poorer for more subjective attributes (cognition, emotion and pain), relative to physical attributes (mobility, self-care, speech, vision) of health-related quality of life. Conclusions: Childhood utilities derived from children or proxies are not interchangeable. The choice of self or proxy assessor may have potentially significant implications for economic evaluations of child health interventions.",
keywords = "Childhood, Direct valuation methods, Health economics, Multi-attribute instrument, Proxy-reports, Quality of life, Self-reports",
author = "Jyoti Khadka and Joseph Kwon and Stavros Petrou and Emily Lancsar and Julie Ratcliffe",
year = "2019",
month = "11",
day = "1",
doi = "10.1016/j.socscimed.2019.112543",
language = "English",
volume = "240",
journal = "Social Science and Medicine",
issn = "0277-9536",
publisher = "Elsevier Limited",

}

Mind the (inter-rater) gap. An investigation of self-reported versus proxy-reported assessments in the derivation of childhood utility values for economic evaluation : A systematic review. / Khadka, Jyoti; Kwon, Joseph; Petrou, Stavros; Lancsar, Emily; Ratcliffe, Julie.

In: Social Science and Medicine, Vol. 240, 112543, 01.11.2019.

Research output: Contribution to journalReview article

TY - JOUR

T1 - Mind the (inter-rater) gap. An investigation of self-reported versus proxy-reported assessments in the derivation of childhood utility values for economic evaluation

T2 - Social Science and Medicine

AU - Khadka, Jyoti

AU - Kwon, Joseph

AU - Petrou, Stavros

AU - Lancsar, Emily

AU - Ratcliffe, Julie

PY - 2019/11/1

Y1 - 2019/11/1

N2 - Purpose: Evidence surrounding utilities for health states, derived either directly from the application of preference-based valuation methods or indirectly from the application of preference-based quality of life instruments, is increasingly being utilised to inform the cost-effectiveness of child health interventions. Proxy (parent or health professional) assessments are common in this area. This study sought to investigate the degree of convergence in childhood utilities generated directly or indirectly within dyad child and proxy assessments. Methods: A systematic literature review was conducted following PRISMA guidelines. A comprehensive literature search strategy conducted across six search engines (PubMed, Embase, Web of Science, PsychoINFO, EconLit, CINAHL and Cochrane Library). Original peer-reviewed articles that reported utilities derived directly or indirectly using simultaneous dyad child and proxy assessments were extracted. Mean and median utilities, correlation coefficients and levels of agreement were extracted, catalogued and assessed. Results: A total of 35 studies that reported utilities for two or more respondent types were identified. Of these, 29 studies reported dyad childhood self-report and proxy utilities whilst six studies reported levels of agreement and/or correlations only without documenting overall utilities. Proxy assessment was most often conducted by parents with the HUI3 representing the most commonly applied instrument across a range of health conditions. The utilities derived from child and parent proxy assessment were bidirectional with parental proxies tending to underestimate and health professional proxies tending to overestimate relative to child self-reports. Inter-rater agreement between child self-reports and parent-proxy reports were poorer for more subjective attributes (cognition, emotion and pain), relative to physical attributes (mobility, self-care, speech, vision) of health-related quality of life. Conclusions: Childhood utilities derived from children or proxies are not interchangeable. The choice of self or proxy assessor may have potentially significant implications for economic evaluations of child health interventions.

AB - Purpose: Evidence surrounding utilities for health states, derived either directly from the application of preference-based valuation methods or indirectly from the application of preference-based quality of life instruments, is increasingly being utilised to inform the cost-effectiveness of child health interventions. Proxy (parent or health professional) assessments are common in this area. This study sought to investigate the degree of convergence in childhood utilities generated directly or indirectly within dyad child and proxy assessments. Methods: A systematic literature review was conducted following PRISMA guidelines. A comprehensive literature search strategy conducted across six search engines (PubMed, Embase, Web of Science, PsychoINFO, EconLit, CINAHL and Cochrane Library). Original peer-reviewed articles that reported utilities derived directly or indirectly using simultaneous dyad child and proxy assessments were extracted. Mean and median utilities, correlation coefficients and levels of agreement were extracted, catalogued and assessed. Results: A total of 35 studies that reported utilities for two or more respondent types were identified. Of these, 29 studies reported dyad childhood self-report and proxy utilities whilst six studies reported levels of agreement and/or correlations only without documenting overall utilities. Proxy assessment was most often conducted by parents with the HUI3 representing the most commonly applied instrument across a range of health conditions. The utilities derived from child and parent proxy assessment were bidirectional with parental proxies tending to underestimate and health professional proxies tending to overestimate relative to child self-reports. Inter-rater agreement between child self-reports and parent-proxy reports were poorer for more subjective attributes (cognition, emotion and pain), relative to physical attributes (mobility, self-care, speech, vision) of health-related quality of life. Conclusions: Childhood utilities derived from children or proxies are not interchangeable. The choice of self or proxy assessor may have potentially significant implications for economic evaluations of child health interventions.

KW - Childhood

KW - Direct valuation methods

KW - Health economics

KW - Multi-attribute instrument

KW - Proxy-reports

KW - Quality of life

KW - Self-reports

UR - http://www.scopus.com/inward/record.url?scp=85072768925&partnerID=8YFLogxK

U2 - 10.1016/j.socscimed.2019.112543

DO - 10.1016/j.socscimed.2019.112543

M3 - Review article

VL - 240

JO - Social Science and Medicine

JF - Social Science and Medicine

SN - 0277-9536

M1 - 112543

ER -