What is the SRM Evaluation Group?
The SRM Evaluation Group is a part of the Social Research Methodology Division (SRM) of the University of California, Los Angeles Graduate School of Education and Information Studies. Housed within the SRM Division of the Department of Education, the group enjoys the unique benefits of working within an academic program whose primary focus is "the study of the methods of inquiry suitable for examining educational processes and practices." This focus affords the group a diversity of methodological expertise and interest. The cadre of SRM graduate students who staff the group all have specialized training in social science research methods and research design as well as a common interest in program evaluation. The group contributes to the advancement of program evaluation as a field in three specific ways: academic study, evaluation practice, and research.
Academic Study
The foundation of the SRM group's academic activities is evaluation theory. Through the lens of evaluation theory, members of the group engage in both formal and informal academic activities. The role of stakeholder involvement, use and influence, establishing causal links, and organizational capacity-building are examples of the kinds of theoretical issues and concerns at the forefront of the group's academic study.
As part of the course requirements of the SRM Division, members complete a sequence of graduate coursework. These courses include, but are not limited to, basic research design, quantitative methods, qualitative methods, measurement theory, survey research methods, and philosophical concerns in social science inquiry. In addition, students participate in specialized seminars related to evaluation theory and evaluation procedures (practice). (See: The American Journal of Evaluation, Vol. 23, #2, Spring 2002, Alkin and Christie.) Informal academic activities consist of a bi-weekly seminar discussion group on evaluation issues (see: The American Journal of Evaluation, Vol. 24, #2, Summer 2003, Christie and Rose, for a description) and regular staff meetings. In a bi-weekly seminar discussion, members read and discuss current articles and chapters related to program evaluation. Various theoretical perspectives are discussed and these discussions provide an opportunity to synthesize and apply academic coursework to new material. Evaluation group members participate in this discussion group throughout their entire UCLA tenure.
Evaluation Practice
The SRM Evaluation Group engages in a variety of evaluation projects. Clients range from small, one-site non-profits to large urban school districts. We recognize that the life stage of the program determines which type of evaluation would be most useful to the program. Typically, the group works with programs early in the development of the program and, therefore, the team's approach tends to emphasize formative evaluation work, that is, providing feedback that can be used for improving programs. Additionally, there is a concern for describing program status, as well as monitoring programs' development and progress.
A common element in most of the evaluations is working with programs to develop a "logic model" or "theory of action." Not only do these theoretical models provide clarity regarding program processes, but also serve as a frame to help guide data collection and analysis.
A wide variety of quantitative and qualitative research methods are employed, as needed. Depending upon the evaluation questions, data are collected using interviews, case studies, surveys, or document analysis. In cases where program effect needs to be estimated, the group will employ quasi-experimental research techniques.
The studies developed by the SRM Evaluation Group are synthesized into "Occasional Reports" and many are available on this website to people who can use the information provided.
Research
The focus on theoretical and practical issues in program evaluation provides much fuel for the research fire. The evaluation discussion sessions provide opportunities for in-depth exploration of theoretical issues framed within theory-practice concerns and serve as a stimulus for conceptual papers on evaluation. The conduct of program evaluations, not only serves to build specific expertise, but also provides ideas about evaluation and sometimes provides a context for conducting research on evaluation.
Evaluation Group members (past and present) have also published important papers in some of the most prestigious journals of the field. Also, every year about five group members present papers at the annual meeting of the American Evaluation Association.