Search for a command to run...
Relevant literature was identified from: The Cochrane Library, MEDLINE, EMBASE, DARE, and the Science Citation Index. References of relevant papers already identified experts. Electronic searches were very difficult to design and yielded few papers for the first strategy and when identifying study designs. CHOICE OF INTERVENTIONS TO REVIEW FOR STRATEGIES 1 AND 2: For strategy 1, any intervention was eligible. For strategy 2, interventions for which the population, intervention and outcome investigated were anticipated to be homogeneous across studies were selected for review: Mammographic screening (MSBC) of women to reduce mortality from breast cancer. Folic acid supplementation (FAS) to prevent neural tube defects in women trying to conceive. DATA EXTRACTION AND QUALITY ASSESSMENT: Data were extracted by the first author and checked by the second author. Disagreements were negotiated with reference to the paper concerned. For strategy 1, study quality was scored using a checklist to assess whether the RCT and QEO study estimates were derived from the same populations, whether the assessment of outcomes was 'blinded', and the extent to which the QEO study estimate took account of possible confounding. For strategy 2, a more detailed instrument was used to assess study quality on four dimensions: the quality of reporting, the generalisability of the results, and the extent to which estimates of effectiveness may have been subject to bias or confounding. All quality assessments were carried out by three people. DATA SYNTHESIS AND ANALYSIS: For strategy 1, pairs of comparisons between RCT and QEO study estimates were classified as high or low quality. Seven indices of the size of discrepancies between estimates of effect size and outcome frequency were calculated, where possible, for each comparison. Distributions of the size and direction of discrepancies were compared for high- and low-quality comparisons. FOR STRATEGY 2, THREE ANALYSES WERE CARRIED OUT: Attributes of the instrument were described by k statistics, percentage agreement, and Cronbach's a values. Regression analyses were used to investigate -variations in study quality. (ABSTRACT TRUNCATED)