- Open Access
A systematic review of patient-reported outcome measures in paediatric endocrinology
BMC Endocrine Disorders volume 22, Article number: 177 (2022)
Patient reported outcome measures (PROMs) are useful tools in paediatric endocrinology to gauge health status in children, especially since they are often unable to clearly communicate it themselves. We aimed to systematically search and appraise all available PROMs relevant to paediatric endocrinology and provide a curated resource for health professionals to utilise.
We identified PROMs in paediatric endocrinology by systematically searching the Cochrane Library, MEDLINE, World Health Organisation International Clinical Trials Registry Platform, and the Cumulative Index to Nursing and Allied Health Literature on May 20, 2022. Additional studies were located through hand searching and content area expert contributions. We assessed the quality of each PROM using the COSMIN risk of bias checklist.
We identified 5003 papers in the initial search. After applying exclusion criteria we included seven PROMs in the review. Six PROMs were specific to Type I Diabetes and one to Hypothyroidism. We gave all studies an overall COSMIN score of ‘inadequate’ due to poorly detailed PROM development.
The scope and quality of PROMs in paediatric endocrinology is limited. Further research and development of PROM tools are required in paediatric endocrinology to allow for improved patient care.
Patient reported outcomes (PROs) describe the impact of illness and treatments from the patient’s perspective . They can assess a range of outcomes such as health related quality of life, disease symptoms, behaviours and perceptions of treatment . Patient Reported Outcome Measures (PROMs), are the standardised measures of PROs, and are increasingly being used to assess a patient’s health. They promote patient-centred care, engage patients in their healthcare and help clinicians identify and treat illnesses [3, 4]. In gathering patients’ perspectives in a structured format, clinicians can determine the effect of treatments and services on patients. This helps provide optimal interventions, increases compliance and improves patient quality of life .
There are some barriers to the effective uptake of PROMs in clinical practice, including the poor methodological quality of some PROMs, lack of standardisation between tools, and difficulty with selection of PROMs for use . There are also barriers to the implementation of PROMs, including a lack of research on evidence-based PROM implementation strategies and applying techniques from implementation science to PROM implementation . Specifically, within paediatric endocrinology, children may struggle to express their health concerns . It is also common but not optimal for parents and carers to act on behalf of paediatric patients . Whilst the literature around patient-parent concordance is scarce, there is evidence of increased compliance with treatment when patients and parents agree .
Online databases of PROMs such as the Patient Reported Outcome Measures Information System (PROMIS) have been developed for generalised illnesses, which has proven beneficial to researchers and clinicians in primary care [10, 11]. However, this database doesn’t capture PROMs for specific subsets of the population, such as children with endocrine conditions. Rather, the PROMs relate to the physical health of broader populations and include domains such as pain, mobility and fatigue.
We aimed to assess PROMs applicable and specific to paediatric endocrinology and to provide a curated resource for health professionals to utilise. This allows clinicians in paediatric endocrinology to identify, evaluate and apply the best PROMS for treatment, management and patient care.
This study was reported according to the PRISMA 2020 guidelines .
The protocol for this study was registered with PROSPERO and available from: https://www.crd.york.ac.uk/prospero/display_record.php?ID=CRD42021251386
We designed our search strategy to be sensitive by developing a disease filter using the Medical Subject Headings (MeSH) ‘endocrinology’ and ‘endocrine system diseases’. We then combined this with pre-existing and validated search filters for paediatric populations and PROMS [13, 14]. We excluded studies relating to adults or animals from the search. We searched the Cochrane Library, MEDLINE, World Health Organisation International Clinical Trials Registry Platform (WHO ICTRP), and the Cumulative Index to Nursing and Allied Health Literature (CINAHL) databases on May 20, 2022. The complete search strategy can be found in Additional file 1. We located additional studies through hand searching reference lists of relevant studies and content area expert contributions.
We screened studies for eligibility using Covidence software (Covidence systematic review software, Veritas Health Innovation, Melbourne, Australia. Available at www.covidence.org) and excluded duplicate articles. Each study was independently reviewed by two authors from a panel of four (EZ, JT, AC, MG) for eligibility according to our inclusion and exclusion criteria. We resolved any discrepancies about the eligibility of studies by discussion among a panel of four authors (EZ, JT, AC, MG). We recorded the rationale for excluding articles at each stage.
We included studies where (i) PROMs were developed as either the primary or secondary outcome measured, and where (ii) the study population was paediatric patients (under 18 years of age) with an endocrine disorder including, but not limited to, type I and II diabetes mellitus, growth hormone disorders, thyroid disorders, differences of sexual development and adrenal disorders. We excluded studies, which were (i) not available in English, (ii) did not utilise PROMs, (iii) did not pertain to a paediatric study population or included adults in the study population, or (iv) if the PROM was not specifically related to an endocrine disorder.
Once the final studies were selected, two authors from a panel of four (EZ, JT, AC, MG) independently extracted data and performed quality assessments for each study. The data extracted from included studies were: name of PROM tool, endocrine conditions studied, date and location(s) the study was conducted, the number of participants, age and gender of participants, and where participants were recruited from. Data regarding the PROM tools were also extracted and included: suitable population, number of items, mode of completion and reporting, method of development, languages available and reliability in terms of Cronbach’s alpha.
Risk of Bias assessment
We identified the development articles for the included PROMs through reference lists of articles included in our full text review. Development articles were then screened for risk of bias using the COnsensus based Standards for the selection of health Measurement INstruments (COSMIN) Risk of Bias checklist . Two authors from a panel of four (EZ, JT, AC, MG) used this checklist independently to evaluate PROM development, content validity, structural validity, internal consistency, cross-cultural validity, reliability, measurement error, criterion validity, construct validity, and responsiveness for each included article. We resolved any discrepancies about the risk of bias through discussion among a panel of four authors. COSMIN uses a “worst score counts” system in which items are given a score of very good, adequate, doubtful or inadequate and the lowest score for any standard is used . We then gave each article an overall risk of bias score.
Our search returned 5003 unique publications, of which 4454 were excluded based on title and abstract screening. A further 185 publications were excluded based on full text review, according to the eligibility criteria. We excluded most of these 185 publications because they did not contain PROMs specifically designed for paediatric endocrinology (n = 85). From the full text review, we identified seven studies that met our inclusion criteria, as shown in Fig. 1. These PROM tools were developed for two endocrine conditions; Type I Diabetes Mellitus (TIDM) [16,17,18,19,20,21] and hypothyroidism .
The included studies were conducted between 1998 and 2015 and were mostly conducted in the United States and Europe. The characteristics of the included studies are shown in Table 1. While some studies developed original PROMs [16, 19, 20], three studies modified pre-existing adult PROMs [17, 18, 22]. One PROM combined items from pre-existing paediatric PROMs as well as incorporating original items .
We outline the results of the COSMIN Risk of Bias assessment in Table 2 as assessed from the PROM development articles [16,17,18,19,20,21,22]. We gave all studies an overall COSMIN score of ‘inadequate’. Measurement error, criterion validity and responsiveness were not reported in any of the studies. Structural validity, internal consistency, and hypothesis testing were considered ‘very good’ for most of the studies, while the other domains were doubtful or inadequate. Reliability was only reported in one study . None of the studies used trained interviewers, or it was doubtful that they did, when presenting questions to subjects. Only three studies explicitly asked patients about at least two of the following factors: relevance, comprehensiveness, and comprehensibility of the PROMs [16, 19, 20]. Only three studies included professional input regarding relevance and comprehensiveness [17, 18, 21]. Moreover, none of the studies clearly described asking both patients and professionals about these domains. Although all papers were deemed inadequate overall, the papers with the best methodological quality, according to the COSMIN checklist, were the short form of the Diabetes Quality of Life for Youth scale  and Problem Areas In Diabetes Scale for children . Each of these papers received a score of ‘very good’ in the assessable domains of structural validity, internal consistency, cross-cultural validity, and hypothesis testing for construct validity. The hypothyroidism symptom score was adapted from an adult version of the tool with details on PROM development, which may not accurately reflect the needs of this population . Given the risk of bias of the included studies and the fact that no PROM was validated more than once, the overall certainty of evidence was judged as low.
We describe the characteristics of the included PROMs in Table 3. Both patient and parent reported outcomes were measured in four instances [16, 17, 19, 20], whilst three studies used only patient reported outcomes [18, 21, 22]. Four PROMs asked patients about quality of life only [17, 19,20,21], one asked about symptoms only , and two asked about both [16, 18]. PedsQL had the youngest child self-reported PROM, with children from the age of 5 years included, however the ⍺-coefficient for internal consistency was only considered reliable in one of five subscales . Six PROMS were flexible in their delivery, providing participants the option to complete the assessments at home [16,17,18,19,20,21]. Five PROMs were also available in a language other than English [16, 18,19,20,21]. The Diabetes Quality of Life for Youth short form was available in fourteen languages . The domains that were well addressed during PROM development included structural validity and internal consistency, with all studies receiving a score of very good in these domains, except for one study in which we could not assess these domains , and one that received an inadequate for structural validity . Four studies [17, 19,20,21] calculated Cronbach’s alpha to be 0.7 or higher, as shown in Table 3, demonstrating satisfactory internal consistency, or interrelatedness between items measured. The other studies [16, 18, 22] either did not calculate it, or had scores below 0.7 in some subscales.
Our systematic review identified seven published PROMs in paediatric endocrinology. As such, the current literature only includes a subset of conditions dealt with by paediatric endocrinologists, i.e. TIDM and hypothyroidism. While the overall methodological quality of the studies was variable, many domains were inadequate and some PROM measures were only adapted from an adult population [17, 18, 22]. PROMs identified varied in their assessment of quality of life, disease related symptoms or both. Although assessment of quality of life may reflect a patient’s disease status and presence of symptoms, it may be more beneficial for PROMs directed at children to have a larger focus on assessing symptoms.
There are few PROMs available in paediatric endocrinology. Other paediatric disciplines face similar challenges. For example, a 2018 systematic review in otolaryngology identified eight PROMs, with only three specific to paediatrics . A 2021 review of PROMs relevant to paediatric orthopaedics found seven PROMs . In comparison, reviews of PROMs designed for adult use in gastroenterology and psychiatry identified 126 and 103 PROMs respectively [25, 26]. A scoping review in 2021 by Churruca et al., found 315 generic and condition specific PROMs across 17 disease groups, with 13 in adult endocrinology . The scarcity of PROMs is not an issue isolated to paediatric endocrinology, but clearly fewer studies relevant to children are published.
The ‘inadequate’ quality rating for all PROMs overall was mainly because of shortfalls related to the domain of PROM development. We largely attribute this to the fact that the COSMIN Risk of Bias checklist was published in 2018, which is after most of these PROMs were developed . These studies do not necessarily report on aspects of the development process as outlined by COSMIN. Similar to our findings, reviews of PROMs in other paediatric fields have recognised that the level of detail provided in PROM development is often insufficient [24, 28,29,30]. Since we cannot be confident whether these tools can be accurately and reliably used to gauge a child’s health status, it is difficult to recommend any existing PROM for use. The relatively old age of the PROMs reviewed, apart from three [17, 21, 22], indicates a need for PROMs in Paediatric endocrinology to be updated to align with the most recent guidelines for PROM development. Clinicians and researchers should take this into consideration when applying these PROMs to their own practice.
To our knowledge, we are the first group to perform a systematic review of PROMs in paediatric endocrinology. A previous study evaluated health related quality of life questionnaires for adolescents with diabetes and assessed their psychometric properties . This study included both generic and diabetes measures and did not use the COSMIN criteria to evaluate the tools they identified. Our collation of published PROMs relevant to paediatric endocrinology provides details on the key characteristics, strengths and weaknesses of each instrument. Our systematic search and standardised approach to evaluating the quality of each tool enables a comparison between instruments and should assist clinicians when deciding which PROM to use. However, our study was limited by the inherent subjectivity of the COSMIN tool. Another limitation of using the COSMIN tool is that older PROMs were not developed with the COSMIN criteria in mind, which may cause poorer reporting on aspects of the development process. While COSMIN recommends using the GRADE tool to analyse the certainty of evidence, this was not relevant to our study as no PROM was validated more than once and all the studies were deemed to be at risk of bias.
Given the methodological quality of existing PROMs, we should make efforts to develop and validate high-quality PROMs, considering the relevant aspects of the COSMIN risk of bias checklist. Currently, most PROMs are designed for TIDM. There remains a wide scope for researchers to develop PROMs for additional paediatric endocrinological conditions.
In summary, the value of PROMs in paediatric endocrinology has been under recognised. This review provides a useful resource for health care professionals, but more PROMs need to be developed before we can use them across the spectrum of paediatric endocrinology care.
Availability of data and materials
All data generated or analysed during this study are included in this published article [and its supplementary information files].
Patient Reported Outcomes
Patient Reported Outcome Measures
Patient Reported Outcome Measures Information System
COnsensus-based Standards for the selection of health Measurement INstruments
Medical Subject Headings
Cumulative Index to Nursing and Allied Health Literature
World Health Organisation - International Clinical Trials Registry Platform
Pediatric Quality of Life Inventory
Type I Diabetes Mellitus
Weldring T, Smith SMS. Patient-Reported Outcomes (PROs) and Patient-Reported Outcome Measures (PROMs). Health Serv Insights. 2013;6:HSI.S11093.
Warsame R, D’Souza A. Patient Reported Outcomes Have Arrived: A Practical Overview for Clinicians in Using Patient Reported Outcomes in Oncology. Mayo Clin Proc. 2019;94(11):2291–301.
Alrubaiy L, Hutchings HA, Williams JG. Assessing patient reported outcome measures: A practical guide for gastroenterologists. United Eur Gastroenterol J. 2014 Dec;2(6):463–70.
Dawson J, Doll H, Fitzpatrick R, Jenkinson C, Carr AJ. The routine use of patient reported outcome measures in healthcare settings. BMJ. 2010:340 [cited 2021 Jan 21]. Available from: https://www.bmj.com/content/340/bmj.c186.
McGee RG. How to Include Patient-Reported Outcome Measures in Clinical Trials. Curr Osteoporos Rep. 2020;18(5):480–5.
Stover AM, Haverman L, van Oers HA, Greenhalgh J, Potter CM, Ahmed S, et al. Using an implementation science approach to implement and evaluate patient-reported outcome measures (PROM) initiatives in routine care settings. Qual Life Res. 2021;30(11):3015–33.
Morrow AM, Hayen A, Quine S, Scheinberg A, Craig JC. A comparison of doctors’, parents’ and children’s reports of health states and health-related quality of life in children with chronic conditions. Child Care Health Dev. 2012;38(2):186–95.
Ford HER, Marshall A, Bridgewater JA, Janowitz T, Coxon FY, Wadsley J, et al. Docetaxel versus active symptom control for refractory oesophagogastric adenocarcinoma (COUGAR-02): an open-label, phase 3 randomised controlled trial. Lancet Oncol. 2014;15(1):78–86.
Tebbi CK, Richards ME, Cummings KM, Zevon MA, Mallon JC. The Role of Parent-Adolescent Concordance in Compliance with Cancer Chemotherapy. Adolescence. 1988;23(91):599–611.
Cella D, Riley W, Stone A, Rothrock N, Reeve B, Yount S, et al. The Patient-Reported Outcomes Measurement Information System (PROMIS) developed and tested its first wave of adult self-reported health outcome item banks: 2005–2008. J Clin Epidemiol. 2010;63(11):1179–94.
Gerhardt WE, Mara CA, Kudel I, Morgan EM, Schoettker PJ, Napora J, et al. Systemwide Implementation of Patient-Reported Outcomes in Routine Clinical Care at a Children’s Hospital. Jt Comm J Qual Patient Saf. 2018;44(8):441–53.
Page MJ, McKenzie JE, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, et al. The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. PLOS Med. 2021;18(3):e1003583.
Terwee CB, Jansma EP, Riphagen II, de Vet HCW. Development of a methodological PubMed search filter for finding studies on measurement properties of measurement instruments. Qual Life Res. 2009;18(8):1115–23.
Boluyt N, Tjosvold L, Lefebvre C, Klassen TP, Offringa M. Usefulness of Systematic Review Search Strategies in Finding Child Health Systematic Reviews in MEDLINE. Arch Pediatr Adolesc Med. 2008;162(2):111.
Mokkink LB, de Vet HCW, Prinsen CAC, Patrick DL, Alonso J, Bouter LM, et al. COSMIN Risk of Bias checklist for systematic reviews of Patient-Reported Outcome Measures. Qual Life Res. 2018;27(5):1171–9.
Varni JW, Burwinkle TM, Jacobs JR, Gottschalk M, Kaufman F, Jones KL. The PedsQLTM in Type 1 and Type 2 Diabetes: Reliability and validity of the Pediatric Quality of Life InventoryTM Generic Core Scales and Type 1 Diabetes Module. Diabetes Care. 2003;26(3):631–7.
Evans MA, Weil LEG, Shapiro JB, Anderson LM, Vesco AT, Rychlik K, et al. Psychometric Properties of the Parent and Child Problem Areas in Diabetes Measures. J Pediatr Psychol. 2019;44(6):703–13.
Hvidøre Study Group on Childhood Diabetes, Skinner TC, Hoey H, McGee HM, Skovlund SE. A short form of the Diabetes Quality of Life for Youth questionnaire: exploratory and confirmatory analysis in a sample of 2,077 young people with type 1 diabetes mellitus. Diabetologia. 2006;49(4):621–8.
Baars RM, Atherton CI, Koopman HM, Bullinger M, Power M, The DISABKIDS group*. The European DISABKIDS project: development of seven condition-specific modules to measure health related quality of life in children and adolescents. Health Qual Life Outcomes. 2005;3(1):70.
Simeoni MC, Schmidt S, Muehlan H, Debensason D, Bullinger M, DISABKIDS Group. Field testing of a European quality of life instrument for children and adolescents with chronic conditions: the 37-item DISABKIDS Chronic Generic Module. Qual Life Res. 2007;16(5):881–93.
de Wit M, Winterdijk P, Aanstoot HJ, Anderson B, Danne T, Deeb L, et al. Assessing diabetes-related quality of life of youth with type 1 diabetes in routine clinical care: the MIND Youth Questionnaire (MY-Q). Pediatr Diabetes. 2012;13(8):638–46.
Çatlı G, Anık A, Ünver Tuhan H, Böber E, Abacı A. The Effect of L-Thyroxine Treatment on Hypothyroid Symptom Scores and Lipid Profile in Children with Subclinical Hypothyroidism. J Clin Res Pediatr Endocrinol. 2014;6(4):238–44.
Jaeschke R, Singer J, Guyatt GH. Measurement of health status. Ascertaining the minimal clinically important difference. Control Clin Trials. 1989;10(4):407–15.
Le CY, Truong LK, Holt CJ, Filbay SR, Dennett L, Johnson JA, et al. Searching for the Holy Grail: A Systematic Review of Health-Related Quality of Life Measures for Active Youth. J Orthop Sports Phys Ther. 2021;51(10):478–91.
Khanna P, Agarwal N, Khanna D, Hays RD, Chang L, Bolus R, et al. Development of an online library of patient-reported outcome measures in gastroenterology: the GI-PRO database. Am J Gastroenterol. 2014;109(2):234–48.
Roe D, Mazor Y, Gelkopf M. Patient-reported outcome measurements (PROMs) and provider assessment in mental health: a systematic review of the context of implementation. Int J Qual Health Care. 2021;33(1):mzz084.
Churruca K, Pomare C, Ellis LA, Long JC, Henderson SB, Murphy LED, et al. Patient-reported outcome measures (PROMs): A review of generic and condition-specific measures and a discussion of trends and issues. Health Expect. 2021;24(4):1015–24.
Wong K, Piraquive J, Troiano CA, Sulibhavi A, Grundfast KM, Levi JR. Are validated patient-reported outcomes used on children in pediatric otolaryngology? A systematic review. Int J Pediatr Otorhinolaryngol. 2018;105:63–71.
Sadeghi S, Fayed N, Ronen GM. Patient-reported outcome measures in pediatric epilepsy: A content analysis using World Health Organization definitions. Epilepsia. 2014;55(9):1431–7.
Gabes M, Tischer C, Apfelbacher C, quality of life working group of the Harmonising Outcome Measures for Eczema (HOME) initiative. Measurement properties of quality-of-life outcome measures for children and adults with eczema: An updated systematic review. Pediatr Allergy Immunol Off Publ Eur Soc Pediatr Allergy Immunol. 2020;31(1):66–77.
de Wit M, Delemarre-van de Waal HA, Pouwer F, Gemke RJBJ, Snoek FJ. Monitoring health related quality of life in adolescents with diabetes: a review of measures. Arch Dis Child. 2007;92(5):434.
Ethics approval and consent to participate
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
McGee, R.G., Zhang, E.Y.B., Tan, J.J.G. et al. A systematic review of patient-reported outcome measures in paediatric endocrinology. BMC Endocr Disord 22, 177 (2022). https://doi.org/10.1186/s12902-022-01099-z
- Patient reported outcome measures
- Type 1 diabetes mellitus