Observational study

Source: Wikipedia, the free encyclopedia.
(Redirected from
Observational studies
)
Anthropological survey paper from 1961 by Juhan Aul (et) from University of Tartu who measured about 50 000 people

In fields such as

control group is outside the control of the investigator.[1][2] This is in contrast with experiments, such as randomized controlled trials, where each subject is randomly assigned
to a treated group or a control group. Observational studies, for lacking an assignment mechanism, naturally present difficulties for inferential analysis.

Motivation

The independent variable may be beyond the control of the investigator for a variety of reasons:

Types

  • Case-control study
    : study originally developed in epidemiology, in which two existing groups differing in outcome are identified and compared on the basis of some supposed causal attribute.
  • Cross-sectional study: involves data collection from a population, or a representative subset, at one specific point in time.
  • Longitudinal study: correlational research study that involves repeated observations of the same variables over long periods of time. Cohort study and Panel study are particular forms of longitudinal study.

Degree of usefulness and reliability

"Although observational studies cannot be used to make definitive statements of fact about the "safety, efficacy, or effectiveness" of a practice, they can:[4]

  1. provide information on 'real world' use and practice;
  2. detect signals about the benefits and risks of...[the] use [of practices] in the general population;
  3. help formulate hypotheses to be tested in subsequent experiments;
  4. provide part of the community-level data needed to design more informative pragmatic clinical trials; and
  5. inform clinical practice."[4]

Bias and compensating methods

In all of those cases, if a randomized experiment cannot be carried out, the alternative line of investigation suffers from the problem that the decision of which subjects receive the treatment is not entirely random and thus is a potential source of bias. A major challenge in conducting observational studies is to draw inferences that are acceptably free from influences by overt biases, as well as to assess the influence of potential hidden biases. The following are a non-exhaustive set of problems especially common in observational studies.

Matching techniques bias

In lieu of experimental control,

healthcare and the social sciences, investigators may use matching to compare units that nonrandomly received the treatment and control. One common approach is to use propensity score matching in order to reduce confounding,[5] although this has recently come under criticism for exacerbating the very problems it seeks to solve.[6]

Multiple comparison bias

Multiple comparison bias can occur when several hypotheses are tested at the same time. As the number of recorded factors increases, the likelihood increases that at least one of the recorded factors will be highly correlated with the data output simply by chance.[7]

Omitted variable bias

An observer of an uncontrolled experiment (or process) records potential factors and the data output: the goal is to determine the effects of the factors. Sometimes the recorded factors may not be directly causing the differences in the output. There may be more important factors which were not recorded but are, in fact, causal. Also, recorded or unrecorded factors may be correlated which may yield incorrect conclusions.[8]

Selection bias

Another difficulty with observational studies is that researchers may themselves be biased in their observational skills. This would allow for researchers to (either consciously or unconsciously) seek out the information they're looking for while conducting their research. For example, researchers may exaggerate the effect of one variable, or downplay the effect of another: researchers may even select in subjects that fit their conclusions. This selection bias can happen at any stage of the research process. This introduces bias into the data where certain variables are systematically incorrectly measured.[9]

Quality

A 2014 (updated in 2024)

Cochrane review concluded that observational studies produce results similar to those conducted as randomized controlled trials.[10] The review reported little evidence for significant effect differences between observational studies and randomized controlled trials, regardless of design.[10] Differences need to be evaluated by looking at population, comparator, heterogeneity, and outcomes.[10]

See also

References

  1. ^ "Observational study". Archived from the original on 2016-04-27. Retrieved 2008-06-25.
  2. .
  3. .
  4. ^ a b "Although observational studies cannot provide definitive evidence of safety, efficacy, or effectiveness, they can: 1) provide information on "real world" use and practice; 2) detect signals about the benefits and risks of complementary therapies use in the general population; 3) help formulate hypotheses to be tested in subsequent experiments; 4) provide part of the community-level data needed to design more informative pragmatic clinical trials; and 5) inform clinical practice." "Observational Studies and Secondary Data Analyses To Assess Outcomes in Complementary and Integrative Health Care." Archived 2019-09-29 at the Wayback Machine Richard Nahin, Ph.D., M.P.H., Senior Advisor for Scientific Coordination and Outreach, National Center for Complementary and Integrative Health, June 25, 2012
  5. ^ Rosenbaum, Paul R. 2009. Design of Observational Studies. New York: Springer.
  6. (from the author's homepage
  7. .
  8. ^ "Introductory Econometrics Chapter 18: Omitted Variable Bias". www3.wabash.edu. Retrieved 2022-07-16.
  9. PMID 19946431
    .
  10. ^ .

Further reading