Model for meta-analysis of research in education, with a demonstration in mathematics education : effects of hand-held calculators

During the past quarter century, there has occurred the "knowledge explosion," in which the findings of empirical research have increased exponentiality. A demand has thus been created for the combining of results from kindred studies. The method of meta-analysis seems best suited for the work of research integration. However, the process is new, its nature unique. Its theory has developed piecemeal from a number of researchers, whose descriptions of methodology have appeared in diverse locations. There has existed no reference source which unifies all elements of the method. There have appeared no set of procedures for actually doing a meta-analysis and no evaluative guidelines for self-critical appraisal of the effort being accomplished.

The present study was designed to bridge these voids. A model for meta-analysis of research in education was constructed, and explicit guidelines were derived for reporting and evaluating reports of meta-analysis. These tasks proceeded essentially through the syn thesis of methodological literature, with particular attention to the works of Glass, who invented the method, and of Hedges, who provided statistical foundation for the process. Verbal text and procedural flow charts specify the model and describe an orderly process of meta-analysis from inception through conclusion.

To challenge the model, its procedures were applied to the syn thesis of research on the effects of hand-held calculators in mathematics education. Grades K-12. Seventy-nine research reports yielded 529 effect magnitudes related to student achievement and attitude. Findings Indicated that, except In Grade 4, a use of calculators in concert with traditional mathematics Instruction will Improve the average student's basic skills with paper and pencil, both in working exercises and in problem solving. Sustained calculator usage In Grade 4 appears to damage students' basic skills. Across all grade and ability levels, students using calculators will possess a better attitude toward mathematics and an especially better self-concept in mathematics than non calculator students

The model's procedures were clearly effective in the calculator study. It was considered that the model Is a tool of significant value in the synthesis of studies, which. In light of the Knowledge Explosion, seems an area of major growth in future research.