Abstract
Objectives
Pilot trials are smaller randomized controlled trials conducted to inform the design and assess the feasibility of a large-scale trials. The objectives of this systematic review were to describe pilot trials in pediatric critical care, their conclusions about the clinical implications of the results, and the need for future research and to determine the frequency of large follow-up trials.Data sources
The Evidence in Pediatric Intensive Care database (http://epicc.mcmaster.ca), a comprehensive repository of published pediatric critical care randomized controlled trials and the World Health Organization's Clinical Trials Registry Platform.Study selection
Randomized controlled trials described in the publication as "pilot," "feasibility," "proof-of-concept," "exploratory," "phase 2," "vanguard," or "preliminary."Data extraction
Pairs of reviewers screened studies for eligibility and abstracted data independently.Data synthesis
We found 32 pilot trials (12.2% of all pediatric critical care randomized controlled trials) published before July 2014, varying in size from 6 to 165 children. Pilot trials were significantly smaller than those not described as pilots, but other key characteristics were not significantly different. The authors of 16 publications (48.4%) included explicit and specific conclusions about the design or feasibility of larger trials based on the results of the pilot trial. In 20 publications (64.5%), the authors made conclusions about clinical efficacy based on results of the pilot trial. Four of the 32 pilot trials (12.9%) led to larger trials, two of which have been published.Conclusions
Published pilot trials in pediatric critical care often focus on clinical outcomes. They uncommonly report explicit feasibility outcomes, criteria for success, or rationale for the pilot sample size. These pilot trials infrequently lead to larger trials. Understanding and addressing the reasons for this are key to the success of pediatric critical care research.References
Articles referenced by this article (15)
The design and interpretation of pilot trials in clinical research in critical care.
Crit Care Med, (1 Suppl):S69-74 2009
MED: 19104228
Design and analysis of pilot studies: recommendations for good practice.
J Eval Clin Pract, (2):307-312 2004
MED: 15189396
Developing and evaluating complex interventions: the new Medical Research Council guidance.
BMJ, a1655 2008
MED: 18824488
Randomized controlled trials in pediatric critical care: a scoping review.
Crit Care, (5):R256 2013
MED: 24168782
What is a pilot or feasibility study? A review of current practice and editorial policy.
BMC Med Res Methodol, 67 2010
MED: 20637084
Questions asked and answered in pilot and feasibility randomized controlled trials.
BMC Med Res Methodol, 117 2011
MED: 21846349
Phase II clinical trial of moderate hypothermia after severe traumatic brain injury in children.
Neurosurgery, (4):740-54; discussion 740-54 2005
MED: 15792513
Therapeutic hypothermia after pediatric cardiac arrest trials: the vanguard phase experience and implications for other trials.
Pediatr Crit Care Med, (1):19-26 2013
MED: 23295834
Porcine-derived surfactant treatment of severe bronchiolitis.
Acta Anaesthesiol Scand, (7):805-810 1998
MED: 9698957
Show 5 more references (10 of 15)
Citations & impact
Impact metrics
Article citations
The reporting of progression criteria in protocols of pilot trials designed to assess the feasibility of main trials is insufficient: a meta-epidemiological study.
Pilot Feasibility Stud, 5:120, 03 Nov 2019
Cited by: 30 articles | PMID: 31700654 | PMCID: PMC6827233
Identification and evaluation of risk of generalizability biases in pilot versus efficacy/effectiveness trials: a systematic review and meta-analysis.
Int J Behav Nutr Phys Act, 17(1):19, 11 Feb 2020
Cited by: 47 articles | PMID: 32046735 | PMCID: PMC7014944
Review Free full text in Europe PMC
A cross-sectional study of the reporting quality of pilot or feasibility trials in high-impact anesthesia journals.
Can J Anaesth, 65(11):1180-1195, 09 Aug 2018
Cited by: 7 articles | PMID: 30094613
Contributions of a survey and retrospective cohort study to the planning of a randomised controlled trial of corticosteroids in the treatment of paediatric septic shock.
Trials, 19(1):283, 21 May 2018
Cited by: 1 article | PMID: 29784051 | PMCID: PMC5963179
Pediatric intensive care stress ulcer prevention (PIC-UP): a protocol for a pilot randomized trial.
Pilot Feasibility Stud, 3:26, 19 May 2017
Cited by: 3 articles | PMID: 28533916 | PMCID: PMC5438532
Go to all (8) article citations
Similar Articles
To arrive at the top five similar articles we use a word-weighted algorithm to compare words from the Title and Abstract of each citation.
The Impact of Clinical Trials Conducted by Research Networks in Pediatric Critical Care.
Pediatr Crit Care Med, 17(9):837-844, 01 Sep 2016
Cited by: 14 articles | PMID: 27351267
Review
Randomized controlled trials in pediatric critical care: a scoping review.
Crit Care, 17(5):R256, 29 Oct 2013
Cited by: 53 articles | PMID: 24168782 | PMCID: PMC4057256
Review Free full text in Europe PMC
Primary Outcome Measures in Pediatric Septic Shock Trials: A Systematic Review.
Pediatr Crit Care Med, 18(3):e146-e154, 01 Mar 2017
Cited by: 14 articles | PMID: 28099233 | PMCID: PMC5336483
Review Free full text in Europe PMC
The design and interpretation of pilot trials in clinical research in critical care.
Crit Care Med, 37(1 suppl):S69-74, 01 Jan 2009
Cited by: 110 articles | PMID: 19104228
Review
Funding
Funders who supported this work.
Canadian Institutes of Health Research (1)
Grant ID: FRN: 119800