pilot study
Meaning of pilot study: A small rehearsal run to find out whether the real study could be done at all, not whether the treatment works.
Definition of pilot study
A pilot study is a small preliminary version of a planned larger study, run to test whether the design works in practice. It checks whether participants can be recruited and retained, whether the procedures and measurements run smoothly, and how long each step takes. Its purpose is feasibility rather than an answer, and it is deliberately too small to show whether a treatment helps.
What is it actually testing?
The machinery of the study rather than the question the study asks. Typical targets are whether enough eligible people agree to take part, how many drop out, whether the questionnaires are understood, whether a scan can be scheduled inside the window the protocol demands, and whether staff can deliver the intervention as written. The answers decide whether the full study is worth funding, and they frequently lead to the design being rewritten before any real result is sought.
Why can it not report whether the treatment works?
Because it holds too few participants for the comparison to mean anything. With a handful in each group, a treatment that does nothing can easily look impressive and a treatment that helps can easily look useless. Presenting an apparent difference from a pilot as though it were a finding is a recognized way of misleading, and promising trends of that kind have repeatedly led to larger studies that found nothing. What a pilot is meant to produce is the estimates needed to plan the real study, above all how many participants it will require.
How does it differ from the studies it resembles?
| Study type | Main question |
|---|---|
| Pilot study | Can this study be run as designed? |
| Feasibility study | Much the same ground, and often used interchangeably |
| Phase 1 trial | Is the treatment safe, and at what dose? |
| Phase 2 trial | Is there enough sign of activity to continue? |
| Phase 3 trial | Is it better than conventional treatment? |
The distinction causing most confusion is with a phase 1 trial. That is a real study of a treatment, carrying its own safety question and its own participants at risk, while a pilot rehearses a design and may involve no new treatment at all. Pilots are used far outside drug research, in surveys, in service redesign and in studies of how care is delivered.
Also known as
Used in a sentence
A pilot study was completed before the multicenter trial opened to recruitment.
Good to know
A pilot study is not built to detect a treatment effect, so any difference between its groups reflects small numbers as readily as any real effect, and a result described as promising from a pilot carries no weight as evidence of benefit.