Of apples and oranges, file drawers and garbage: Why validity issues in meta-analysis will not go away☆
References (143)
Meta-analysis in clinical trials reporting: Has a tool become a weapon? Editorial
American Journal of Cardiology
(1992)- et al.
A method for assessing the quality of a randomized control trial
Controlled Clinical Trials
(1981) Meta-analysis: Statistical alchemy for the 21st century
Journal of Clinical Epidemiology
(1995)- et al.
Selecting the language of the publications included in a meta-analysis: Is there a tower of Babel?
Journal of Clinical Epidemiology
(1995) The role of meta-analysis in the evaluation of psychotherapy
Clinical Psychology Review
(1985)Editorial: Meta-analysis and clinical psychology
Clinical Psychology Review
(1985)The “File Drawer Problem” and tolerance for null results
Psychological Bulletin
(1979)Publication bias and meta-analysis
Evaluation in Education
(1980)- et al.
Meta-analysis of psychotherapy outcome studies
American Psychologist
(1977) - et al.
Implementation problems in meta-analysis
Review of Educational Research
(1988)
A consolidation and appraisal of science meta-analyses
Journal of Research in Science Teaching
(1983)
Review of developments in meta-analytic method
Psychological Bulletin
(1986)
An empirical comparison of meta-analytic and traditional reviews
Personality and Social Psychology Bulletin
(1991)
Publication bias
The evaluation of therapeutic outcomes
A systematic approach to conducting a non-statistical meta-analysis of research literature
Academic Medicine
(1995)
Relative contributions of specific and nonspecific treatment effects: Meta-analysis of placebo-controlled behavior therapy research
Psychological Bulletin
(1988)
Behavior therapy versus placebo: Commentary on Bowers and Clum's meta-analysis
Psychological Bulletin
(1990)
Predicting metabolic control in diabetes: A pilot study using meta-analysis to estimate a linear model
Nursing Research
(1994)
Vote-counting procedures
The usefulness of the “fail-safe” statistic in meta-analysis
Educational and Psychological Measurement
(1990)
Meta-analysis of clinical trials as a scientific discipline. II: Replicate variability and comparison of studies that agree and disagree
Statistics in Medicine
(1987)
Meta-analysis of pragmatic and theoretical research: A critique
Journal of Psychology
(1987)
Behavior therapy better than placebo treatment: Fact or artifact?
Psychological Bulletin
(1990)
The earth is round (p<.05)
American Psychologist
(1994)
Should unpublished data be included in meta-analyses? Current convictions and controversies
Journal of the American Medical Association
(1993)
Quasi-experimentation: Design and analysis issues for field settings
(1979)
Reviewing the literature: A comparison of traditional methods with meta-analysis
Journal of Personality
(1980)
Race comparisons on need for achievement: A meta-analytic alternative to Graham's narrative review
Review of Educational Research
(1995)
On the role of meta-analysis in personality and social psychology
Personality and Social Psychology Bulletin
(1991)
An assessment from the policy perspective
Misuse of statistical tests in three decades of psychotherapy research
Journal of Consulting and Clinical Psychology
(1994)
An approach for assessing publication bias prior to performing a meta-analysis
Statistical Science
(1992)
On cohesiveness: Reply to Keyton and other critics of the construct
Small Group Research
(1992)
Using research syntheses to plan future research
The number-crunchers drugmakers fear and love
Business Week
(1994)
The effects of psychotherapy: An evaluation
Journal of Consulting Psychology
(1952)
An exercise in mega-silliness
American Psychologist
(1978)
Meta-analysis: An abuse of research integration
Journal of Special Education
(1984)
Meta-analysis squared-Does it make sense?
American Psychologist
(1995)
Is EPA blowing its own smoke? How much science is behind its tobacco finding?
Investor's Business Daily
(1993)
Meta-analysis and psychotherapy: Introduction to special section
Journal of Consulting and Clinical Psychology
(1983)
Quality of study rating form: An instrument for synthesizing evaluation studies
Journal of Social Work Education
(1989)
Primary, secondary, and meta-analysis of research
Educational Research
(1976)
In defense of generalization
Behavioral and Brain Sciences
(1978)
The next-to-last word on meta-analysis
Contemporary Psychology
(1995)
Meta-analysis in social research
(1981)
Meta-analysis of problem-solving studies: A critical response
Journal for Research in Mathematics Education
(1992)
Cited by (248)
Does green procurement pay off? Assessing the practice–performance link employing meta-analysis
2024, Journal of Cleaner ProductionWhen visual cues influence taste/flavour perception: A systematic review
2023, Food Quality and PreferenceMeta-analysis of shared micromobility ridership determinants
2023, Transportation Research Part D: Transport and EnvironmentInvalid estimates and biased means. A replication of a recent meta-analysis investigating the effect of teacher professional development on pupil outcomes
2023, Social Sciences and Humanities OpenWhat translates big data into business value? A meta-analysis of the impacts of business analytics on firm performance
2022, Information and ManagementCitation Excerpt :We intentionally employed a broad view of the independent and dependent variables of interest while bearing in mind the commonly known “apples and oranges” problem. In this context, it must be kept in mind that we have integrated and synthesized individual studies with varied research objectives, research designs, research variables, and measures, which could raise concerns about the comparability and integrability of these results [19,127]. The question of which studies can be considered appropriate to be integrated into a meta-analysis is controversial.
The potential of international large-scale assessments for meta-analyses in education
2024, Large-Scale Assessments in Education
- ☆
This article is based on a paper presented at the meeting of the Canadian Psychological Association, June 1995, Charlottetown, PEI, Canada.
Copyright © 1997 Published by Elsevier Ltd.