ࡱ>  "bjbj )djjl$4$4$48\4L4Sc"h5h5(555k6.66 ]]]]-4]`b$ud flb6k6k666bZ55 cZZZ6L55]Z6]ZZ\\5\5 p0$4Fv\\$#c0Sc\g{X,g\"ZCurriculum Vitae August 1, 2004 William R. Shadish Professor and Founding Faculty University of California, Merced Mailing Address: Physical Address PO Box 2039 4225 N Hospital Road Bldg 1200 Merced CA 95344 Atwater CA 95301 Education: 1978-1981 Northwestern University, Department of Psychology, Postdoctoral Fellow in Methodology and Evaluation Research 1973-1978 Purdue University Major Field: Clinical Psychology (Licensed Psychologist, State of Tennessee, 1982-present). Minors: Statistics, Measurement Degrees: M.S. 1975, Ph.D. 1978 1973 California State University, Hayward Major Field: Psychology (Undergraduate) 1967-1972 Santa Clara University Major Field: Sociology Degree: B.A. 1972 Professional Positions: Professor and Founding Faculty, University of California, Merced (2003-present) Dunavant University Professor, The University of Memphis (1999-2003). Professor, Department of Psychology, The University of Memphis (1990-present), Associate Professor (1986-1990; tenured 1986), Assistant Professor (1981-1986). Director, Research Design and Statistics Program, Department of Psychology, The University of Memphis (1987-present). Director, Center for Applied Psychological Research, Department of Psychology, The University of Memphis (1990-1997). Visiting Scholar, Institute for Policy Research, Northwestern University, Spring Quarter 1997. Visiting Research Associate, Vanderbilt Institute for Public Policy Studies, Vanderbilt University (1985-1990). Post-Doctoral Research Fellow, Center for Health Services and Policy Research, Northwestern University (1978-1981). Instructor (Part-time), Department of Psychology, Northwestern University (1979-1981). Intern, Memphis Clinical Psychology Internship Consortium (1977-8). Core Staff Therapist, Purdue University Psychological Services Center (1975-1977). Staff Assistant, State of California Legislature, Joint Committee on the Master Plan for Higher Education (Chair: John Vasconcellos, 1972). Research Interests: Experimental and Quasi-Experimental Design Program Evaluation Meta-Analysis Honors and Awards (External): Outstanding Research Publication Award, American Association for Marriage and Family Therapy, 1994. Paul F. Lazarsfeld Award for Evaluation Theory, American Evaluation Association, 1994. Outstanding Research Publication Award, American Association for Marriage and Family Therapy, 1996. James McKeen Cattell Fund Sabbatical Award, 1996-97. President-Elect, American Evaluation Association (1996), President (1997), Past-President (1998). Board Service Awards, American Evaluation Association, 1993, 1994, 1998. Robert Ingle Service Award, American Evaluation Association, 2000. Catherine Rivers Johnson Award (in recognition of service helping children), Memphis Beat the Odds Foundation, 2000. Donald T. Campbell Award for Innovations in Methodology, Policy Studies Organization, 2002. Honors and Awards (Internal): Board of Visitors Eminent Faculty Award, The University of Memphis, 1995. Distinguished Research Award, The University of Memphis, 1988. Meritorious Faculty Award, College of Arts and Sciences, The University of Memphis, 1991. SPUR Award (Superior Performance in University Research), The University of Memphis, 1987, 1988, 1990, 1993, 1994. Grant History: Principal Investigator, "The Effects of Marital/Family Therapies: A Meta-Analysis". National Institute of Mental Health, $108,996 total costs (1986-1988). Principal Investigator, "Exploring Multivariate Models in a Meta-Analysis". Russell Sage Foundation, $35,000 total costs (1989-1990). Principal Investigator, "Differences in Results from Random and Nonrandom Experiments". W.T. Grant Foundation, $10,000 total costs (1994-1995). Principal Investigator, "Comparing Results from Randomized versus Quasi-Experiments with Social Interventions". The Rockefeller Foundation, $5,000 total costs (1994). Principal Investigator, Revitalizing Quasi-Experimentation. James McKeel Cattell Foundation Sabbatical Award, $24,000 total costs (1996-97). Co-Principal Investigator, "Evaluation of Mental Health Long-Term Care Facilities". State of Illinois Grant, $114,000 direct costs (1978-1982). Richard R. Bootzin, Principal Investigator. Co-Principal Investigator, "Weight Gain and Smoking Relapse: A Biobehavioral Approach". National Institutes of Health, $893,017 direct costs (1988-1992). Robert C. Klesges, Principal Investigator. Co-Principal Investigator, "Pharmacologic Intervention for Postcessation Weight Gain". National Institutes of Health, $2,523,223 total costs (1991-1996). Robert C. Klesges, Principal Investigator. Co-Principal Investigator, "Sex, Smoking Rate, and Postcessation Weight Gain". National Institutes of Health, $962,087 total costs (1992-1996). Robert C. Klesges, Principal Investigator. Co-Principal Investigator, "Predictors of Smoking Onset in Black vs. White Girls". National Institutes of Health, $1,246,461 total costs (1993-1997). Robert C. Klesges, Principal Investigator. Co-Principal Investigator, "A Population-Wide Smoking Cessation/Prevention Program". National Institutes of Health, $1,948,989 total costs (1995-1997). Robert C. Klesges, Principal Investigator. Co-Principal Investigator, A Biobehavioral Approach to Insomnia Treatment, $700,847 total costs (1995-1999). Kenneth Lichstein, Principal Investigator. Co-Principal Investigator, Biobehavioral Determinants of Obesity in Black Women, National Institutes of Health, $2,374,533 total costs (1995-1997). Robert C. Klesges, Principal Investigator. Co-Principal Investigator, NRT and Behavioral Therapy in Primary Health Care Settings, National Institutes of Health, $2,310,117 total costs (1996-1997), Robert C. Klesges, Principal Investigator. Co-Principal Investigator, Bone Density Loss in Athletes, National Institutes of Health, $50,000 total costs (1997). Robert C. Klesges, Principal Investigator. Co-Principal Investigator, Meta-analysis of post-smoking cessation weight gain. National Institutes of Health, $682,807 total costs (1996-2000). Leslie Robinson, Principal Investigator. Editorial Work: Editor-in-Chief, New Directions for Program Evaluation (1992-1995). Guest Editor: Evaluation and Program Planning (1995, Volume 18, Number 1), Special Section: The Quantitative-Qualitative Debates: DeKuhnifying the Conceptual Context. Current Editorial Boards: American Journal of Community Psychology (1987-present), American Journal of Evaluation (1999-present), Journal of Clinical Psychology (1999-present), Methodology: European Journal of Research Methods in the Social and Behavioral Sciences (2004-present); Metodologia de las Ciencias del Comportamiento (2001-present), Psychological Bulletin (2002-present), Psychological Methods (1995-present). Past Editorial Boards: Behavior Therapy (1987-1988), Evaluation Studies Review Annual (1986), Journal of Applied Behavioral Science (1981-2002), New Directions for Program Evaluation (1989-1992). Reviews and Consultantships: Grant and Contract Reviews: Harvard University Medical School; National Institutes of Health (National Cancer Institute; National Heart, Lung, and Blood Institute); National Institute of Mental Health; National Science Foundation; William T. Grant Foundation. Consultantships: American Association of Medical Colleges; American Medical Association; Centers for Disease Control; Chinese University of Hong Kong; the Consultative Group on International Agricultural Research (the Netherlands); the Ministry of Youth, Family, Women, and Health (Germany); National Institute on Drug Abuse; National Institute of Mental Health; Stanford University; University of Frieburg (Germany); University of Murcia (Spain); University of Seville (Spain); U.S. Department of Education; U.S. Department of Veterans Affairs, Central Office. Organizational Memberships: American Evaluation Association, Charter Member American Psychological Association, Fellow (Divisions 5, 27) American Psychological Society, Charter Fellow American Statistical Association, Member Society for Clinical Trials, Member Society of Multivariate Experimental Psychology, Member PUBLICATIONS Authored and Edited Volumes: Shadish, W.R. & Reichardt, C.S. (Eds.). (1987). Evaluation Studies Review Annual, Volume 12. Newbury Park, California: Sage Publications. (691 pages). Shadish, W.R., Lurigio, A.J., & Lewis, D.A. (Eds.). (1989). After deinstitutionalization [Special Issue]. Journal of Social Issues, 45(3). (186 pages) Gholson, B.G., Shadish, W.R., Neimeyer, R.A., & Houts, A.C. (Eds.). (1989). Psychology of Science: Contributions to Metascience. Cambridge, England: Cambridge University Press. (463 pages). Shadish, W.R., Cook, T.D., & Leviton, L.C. (1991). Foundations of Program Evaluation: Theories of Practice. Newbury Park, California: Sage Publications. (529 pages). Shadish, W.R., & Fuller, S. (Eds.). (1994). The Social Psychology of Science. New York: Guilford Publications. (432 pages). Shadish, W.R., Newman, D.L., Scheirer, M.A., & Wye, C. (Eds.). (1995). Guiding Principles for Evaluators. San Francisco: Jossey-Bass. (115 pages) Chelimsky, E., & Shadish, W.R. (Eds.). (1997). Evaluation for the 21st Century: A Handbook. Thousand Oaks, California: Sage Publications. (542 pages) Shadish, W.R., Robinson, L., & Lu, C. (1999). ES: A Computer Program and Manual for Effect Size Calculation. St. Paul, Minnesota: Assessment Systems Corporation. (57 pages). Shadish, W.R., Cook, T.D., & Campbell, D.T. (2002). Experimental and Quasi-Experimental Designs for Generalized Causal Inference. Boston: Houghton-Mifflin. (623 pages). Shadish, W.R &, Cook, T.D. (in preparation). Experimental and Quasi-Experimental Designs for Field Research. Hillsdale Refereed Journal Articles: Shadish, W.R. & Zarle, T. (1979). The validation of an encounter group outcome measure. Small Group Behavior, 10, 101-112. Shadish, W.R. (1980). Non-verbal interventions in clinical groups. Journal of Consulting and Clinical Psychology, 48, 164-168. Shadish, W.R. (1981). A critical examination concerning the nature of group theory. Journal of Applied Behavioral Science, 17, 98-112. Shadish, W.R., Hickman, D., & Arrick, M.C. (1981). Psychological problems of spinal cord injury patients: Emotional distress as a function of time and locus of control. Journal of Consulting and Clinical Psychology, 49, 297. Shadish, W.R., Straw, R.B., McSweeny, A.J., Koller, D.L., & Bootzin, R.R. (1981). Nursing home care for mental patients: Descriptive data and some propositions. American Journal of Community Psychology, 9, 617-633. Shadish, W.R. & Bootzin, R.R. (1981). Nursing homes and chronic mental patients. Schizophrenia Bulletin, 7, 488-498. Shadish, W.R. & Bootzin, R.R. (1981). Long-term community care: Mental health policy in the face of reality. Schizophrenia Bulletin, 7, 580-585. Shadish, W.R., Bootzin, R.R., Koller, D.L., & Brownell, L. (1981). Psychometric instability of measures in novel settings: Use of psychiatric rating scales in nursing homes. Journal of Behavioral Assessment, 3, 221-232. Shadish, W.R. (1982). A review and critique of controlled studies of the effectiveness of preventive child health care. Health Policy Quarterly, 2, 24-52. Reprinted in R.J. Light (Ed.). (1983). Evaluation Studies Review Annual, (Volume 8, pp. 507-535). Newbury Park, California: Sage Publications. Reprinted in expanded monograph form as: Shadish, W. (1982, April). Effectiveness of Preventive Child Health Care. Baltimore, Maryland: U.S. Department of Health and Human Services, Health Care Financing Administration, Office of Research, Demonstrations, and Statistics. Shadish, W.R., Thomas, S., & Bootzin, R.R. (1982). Criteria for success in deinstitutionalization: Perceptions of nursing homes by different interest groups. American Journal of Community Psychology, 10, 553-566. Filstead, W.J., Shadish, W.R., Crandell, J.S., Altman, D.B., Gottlieb, D.L., & Visotsky, J.L. (1982). Developing a multidimensional clinical rating scale: Evaluating mental health services. Evaluation Review, 6, 559-576. Yogev, S. & Shadish, W.R. (1982). A method for monitoring the impact of sex-role stereotypes on the therapeutic behavior of beginning psychotherapists. American Journal of Orthopsychiatry, 52, 545-548. Shadish, W.R. (1983). Costs and effects in mental health policy (Comment). American Psychologist, 38, 349-350. Shadish, W.R. (1984). Intimate behavior and the assessment of benefits in clinical groups. Small Group Behavior, 15, 204-221. Shadish, W.R. (1984). Policy research: Lessons from the implementation of deinstitutionalization. American Psychologist, 39, 725-738. Reprinted in D.S. Cordray & M.W. Lipsey (Eds.), (1986), Evaluation Studies Review Annual (Vol. 11) (pp. 505-518). Newbury Park, California: Sage Publications. Shadish, W.R. & Bootzin, R.R. (1984). The social integration of psychiatric patients in nursing homes. American Journal of Psychiatry, 141, 1203-1207. Shadish, W.R. & Reis, J. (1984). A review of studies of the effectiveness of programs to improve pregnancy outcome. Evaluation Review, 8, 747-776. Shadish, W.R., Silber, B.G., & Bootzin, R.R. (1984). Mental patients in nursing homes: Their characteristics and treatment. International Journal of Partial Hospitalization, 2, 153-163. Shadish, W.R. & Bootzin, R.R. (1984). Nursing homes: The new total institution in mental-health policy. International Journal of Partial Hospitalization, 2, 251-262. Shadish, W.R. (1984). Comments on "Spiderman and the Burma Raiders: Collateral Organization Theory in Action". Journal of Applied Behavioral Science, 20, 17-18. Shadish, W.R. (1985). Transitory emotional states and encounter group training. Small Group Behavior, 16, 477-486. Shadish, W.R., Silber, B.G., Orwin, R.G., & Bootzin, R.R. (1985). The subjective well-being of mental patients in nursing homes. Evaluation and Program Planning, 8, 239-250. Shadish, W.R. (1986). Planned critical multiplism: Some elaborations. Behavioral Assessment, 8, 75-103. Shadish, W.R. (1986). The validity of a measure of intimate behavior. Small Group Behavior, 17, 113-120. Houts, A.C., Cook, T.D., & Shadish, W.R. (1986). The person-situation debate: A critical multiplist perspective. Journal of Personality, 54, 52-105. Neimeyer, R.A. & Shadish, W.R. (1987). Optimizing scientific validity: Toward an interdisciplinary science studies. Knowledge: Creation, Diffusion, Utilization, 8, 463-485. Montgomery, L.M., Shadish, W.R., Orwin, R.G., & Bootzin, R.R. (1987). Psychometric structure of psychiatric rating scales. Journal of Abnormal Psychology, 96, 167-170. Shadish, W.R. & Epstein, R. (1987). Patterns of program evaluation practice among members of Evaluation Research Society and Evaluation Network. Evaluation Review, 11, 555-590. Barrom, C.P., Shadish, W.R. & Montgomery, L.M. (1988). PhDs, PsyDs, and real-world constraints on scholarly activity: Another look at the Boulder model. Professional Psychology: Research and Practice, 19, 93-101. Golding, J.M., Lang, K., Eymard, L.A., & Shadish, W.R. (1988). The buck stops here: A survey of the financial status of PhD graduate students in psychology in the United States, 1966-1987 (Comment). American Psychologist, 43, 1089-1091. Rosenthal, T.L., Montgomery, L.M., Shadish, W.R., & Lichstein, K.L. (1989). Leisure interest patterns and subjective stress in college students. Behavior Research and Therapy, 27, 59-64. Shadish, W.R. (1989). Private-sector care for chronically mentally ill individuals: The more things change, the more they stay the same. American Psychologist, 44, 1142-1147. Shadish, W.R., Doherty, M., & Montgomery, L.M. (1989). How many studies are in the file drawer? An estimate from the family/marital psychotherapy literature. Clinical Psychology Review, 9, 589-603. Shadish, W.R., Lurigio, A.J., & Lewis, D.A. (1989). After deinstitutionalization: The present and future of mental health long-term care policy. Journal of Social Issues, 45, 1-15. Bootzin, R.R., Shadish, W.R., & McSweeny, A.J. (1989). Longitudinal outcomes of nursing home care for severely mentally ill patients. Journal of Social Issues, 45, 31-48. Lewis, D.A., Shadish, W.R., & Lurigio, A.J. (1989). Policies of inclusion and the mentally ill: Long-term care in a new environment. Journal of Social Issues, 45, 173-186. Shadish, W.R. (1989). Science evaluation: A glossary of possible contents. Social Epistemology, 3, 189-204. Rosenthal, T.L., Montgomery, L.M., Shadish, W.R., Edwards, N.B., Hutcherson, H.W., Follette, W.C., & Lichstein, K.L. (1989). Two new, brief, practical stressor tasks for research purposes. Behavior Therapy, 20, 545-562. Rosenthal, T.L., Miller, S.T., Rosenthal, R.H., Shadish, W.R., Fogleman, B.S., & Dismuke, S.E. (1991). Assessing emotional distress at the internist's office. Behaviour Research and Therapy, 29, 249-252. Shadish, W.R., & Sweeney, R. (1991). Mediators and moderators in meta-analysis: There's a reason we don't let dodo birds tell us which psychotherapies should have prizes. Journal of Consulting and Clinical Psychology, 59, 883-893. Shadish, W.R., Cook, T.D., & Leviton, L.C. (1992). A response to Nick L. Smith and Eileen Schroeder: Thinking about theory in program evaluationA five-component approach. Evaluation and Program Planning, 15, 329-338. Shadish, W.R., Montgomery, L.M., Wilson, P., Wilson, M.R., Bright, I., & Okwumabua, T. (1993). Effects of family and marital psychotherapies: A meta-analysis. Journal of Consulting and Clinical Psychology, 61, 992-1002. Winner of 1994 Outstanding Research Publication Award, American Association for Marriage and Family Therapy. Shadish, W.R. (1994). Need-based evaluation theory: What do you need to know to do good evaluation? Evaluation Practice, 15, 347-358. Haddock, C.K., Shadish, W.R., Klesges, R.C., & Stein, R.J. (1994). Treatments for childhood and adolescent obesity: A meta-analysis. Annals of Behavioral Medicine, 16, 235-244. Shadish, W.R. (1994). APA ethics and student authorships on Masters' theses. American Psychologist, 49, 1096. Shadish, W.R. (1995). The quantitative-qualitative debates: "DeKuhnifying" the conceptual context. Evaluation and Program Planning, 18, 47-49. Shadish, W.R. (1995). Philosophy of science and the quantitative-qualitative debates: Thirteen common errors. Evaluation and Program Planning, 18, 63-75. Shadish, W.R., Tolliver, D., Gray, M., & Sen Gupta, S.K. (1995). Author judgments about works they cite: Three studies from psychology journals. Social Studies of Science, 25, 477-498. Shadish, W.R., Ragsdale, K., Glaser, R.R., & Montgomery, L.M. (1995). The efficacy and effectiveness of marital and family therapy: A perspective from meta-analysis. Journal of Marital and Family Therapy, 21, 345-360. Winner of 1996 Outstanding Research Publication Award, American Association for Marriage and Family Therapy. Translated into German and reprinted as: (1997). Effektivitat und effizienz von paar- und familientherapie: Eine metaanalytische perspektive. Familiendynamik, 22, 5-33. Shadish, W.R. (1995). The logic of generalization: Five principles common to experiments and ethnographies. American Journal of Community Psychology, 23, 419-428. Shadish, W.R. (1996). Meta-analysis and the exploration of causal mediating processes: A primer of examples, methods, and issues. Psychological Methods, 1, 47-65. Heinsman, D.T., & Shadish, W.R. (1996). Assignment methods in experimentation: When do nonrandomized experiments approximate answers from randomized experiments? Psychological Methods, 1, 154-169. Shadish, W.R., & Ragsdale, K. (1996). Random versus nonrandom assignment in controlled experiments: Do you get the same answer? Journal of Consulting and Clinical Psychology, 64, 1290-1305. Ray, J.W., & Shadish, W.R. (1996). How interchangeable are different estimators of effect size? Journal of Consulting and Clinical Psychology, 64, 1316-1325. (see also Correction to Ray and Shadish (1996), Journal of Consulting and Clinical Psychology, 66, 532, 1998). Cook, T.D., Church, M.B., Ajanaku, S., Shadish, W.R., Kim, J-R., & Cohen, R. (1996). The development of occupational aspirations and expectations among underclass and mainstream boys. Child Development, 67, 3368-3385. Reprinted in M.E. Hertzig & E.A. Farber (Eds), (1998), Annual progress in child psychiatry and child development (pp. 417-436). Bristol, Pennsylvania: Brunner/Mazel. Klesges, R.C., Winders, S.E., Meyers, A.W., Eck, L.H., Ward, K.D., Hulquist, C.M., Ray, J.W., & Shadish, W.R. (1997). How much weight gain occurs following smoking cessation? A comparison of weight gain using both continuous and point prevalence abstinence. Journal of Consulting and Clinical Psychology, 65, 286-291. Shadish, W.R., Matt, G., Novaro, A., Siegle, G., Crits-Christoph, P., Hazelrigg, M., Jorm, A., Lyons, L.S., Nietzel, M.T., Prout, H.T., Robinson, L., Smith, M.L., Svartberg, M., & Weiss, B. (1997). Evidence that therapy works in clinically representative conditions. Journal of Consulting and Clinical Psychology, 65, 355-365. Stanton, M.D., & Shadish, W.R. (1997). Outcome, attrition and family-couples treatment for drug abuse: A meta-analysis and review of the controlled, comparative studies. Psychological Bulletin, 122, 170-191. Shadish, W.R., Hu, X., Glaser, R.R., Kownacki, R.J., & Wong, T. (1998). A method for exploring the effects of attrition in randomized experiments with dichotomous outcomes. Psychological Methods, 3, 3-22. Shadish, W.R. (1998). Evaluation theory is who we are. American Journal of Evaluation, 19, 1-19. Haddock, C.K., Rindskopf, D., & Shadish, W.R. (1998). Using odds ratios as effect sizes for meta-analysis of dichotomous data: A primer on methods and issues. Psychological Methods, 3, 339-353. Stein, R.J., Bracken, B.A., Haddock, C.K., & Shadish, W.R. (1998). Preliminary development of the Children's Physical Self-Concept Scale. Developmental and Behavioral Pediatrics, 19, 1-18. Shadish, W.R., & Cook, T.D. (1998). Donald Campbell and evaluation theory. American Journal of Evaluation, 19, 417-422. Kownacki, R.J., & Shadish, W.R. (1999). Does Alcoholics Anonymous work? The results from a meta-analysis of controlled experiments. Substance Use and Misuse, 34, 1897-1916. Shadish, W.R., & Cook, T.D. (1999). Design rules: More steps towards a complete theory of quasi-experimentation. Statistical Science, 14, 294-300. Shadish, W.R., Matt, G.E., Navarro, A.M., & Phillips, G. (2000). The effects of psychological therapies under clinically representative conditions: A meta-analysis, Psychological Bulletin, 126, 512-529. Chacon Moscoso, S. & Shadish, W.R. (2001). Observational studies and quasi-experimental designs: Similarities, differences and generalizations. Metodologia de las Ciencias del Comportamiento Journal, 3, 283-290. Shadish, W.R. (2002). Revisiting field experimentation: Field notes for the future. Psychological Methods, 7, 3-18. Shadish, W.R., & Clark, M.H. (2002). An introduction to propensity scores. Metodologia de las Ciencias del Comportamiento Journal, 4, 291-300. Shadish, W.R. (2003). The oral history of evaluation Part I. Reflections on the chance to work with great people: An interview with William Shadish. American Journal of Evaluation, 24, 261-272. Luellen, J.K., Shadish, W.R., & Clark, M.H. (in press). Propensity scores: An introduction and experimental test. Evaluation Review. Shadish, W.R., & Baldwin, S.A. (in press). The effects of behavioral marital therapy: A meta-analysis of randomized controlled trials. Journal of Consulting and Clinical Psychology. Blitstein, J.L., Murray, D.M., Hannan, P.J., & Shadish, W.R. (in preparation). Increasing the degrees of freedom available to the test of the intervention effect in group randomized trials through the use of external estimates of intraclass correlation: The DF* approach. Shadish, W.R., Chacon-Moscoso, S., & Sanchez-Meca, J. (in preparation). Campbell Collaboration and evidence-based decision making: Enhancing systematic reviews of program evaluation results in Europe. Evaluation. Floyd, R., Clark, M.H., & Shadish, W.R. (in preparation). The exchangeability of IQ scores: Revisiting Spearmans indifference of the indicator. Baldwin, S.A., Murray, D.M., & Shadish, W.R. (in preparation). Empirically Supported Treatments or Type I Errors?: A Revaluation of Group-Administered Treatments on the Empirically Supported Treatments List. Shadish, W.R., & Clark, M.H. (in preparation). A randomized experiment comparing randomized to nonrandomized experiments. Clark, M.H., & Shadish, W.R. (in preparation). Using the rank correlation method to correlate variables with mixed-distributions in computer simulations. Phillips, G.A., Shadish, W.R., Murray, D.M., Lytle, L., & Kubic, M. (in preparation). The Center for Epidemiologic Studies Depression Scale with a Young Adolescent Population: A Confirmatory Factor Analysis and Implementation of a General Hierarchical Model. Shadish, W.R., & Marcus, S.M. (in preparation). Meta-analytic response surface modeling. Book Chapters: Cook, T.D. & Shadish, W.R. (1982). Metaevaluation: An assessment of the Congressionally mandated evaluation system for community mental health centers. In G. Stahler & W.R. Tash (Eds.), Innovative Approaches to Mental Health Evaluation (pp. 221-253). New York: Academic Press. Shadish, W.R. & Cook, T.D. (1983). Evaluation of social programs. In B.B. Wolman (Ed.), International Encyclopedia of Psychiatry, Psychology, Psychoanalysis, and Neurology: First Progress Volume (pp. 413-416). New York: Aesculapius Press. Boruch, R.F. & Shadish, W.R. (1983). Design issues in community intervention research. In E. Seidman (Ed.), Handbook of Social Interventions (pp. 73-98). Newbury Park, California: Sage Publications. Cook, T.D., Leviton, L.C., & Shadish, W.R. (1985). Program evaluation. In G. Lindzey & E. Aronson (Eds.), Handbook of Social Psychology (3rd Ed., pp. 699-777). New York: Random House. Cook, T.D. & Shadish, W.R. (1986). Program evaluation: The worldly science. Annual Review of Psychology, 37, 193-232. Reprinted in W.R. Shadish and C.S. Reichardt (Eds.), (1987), Evaluation Studies Review Annual (Volume 12) (pp. 31-70). Newbury Park, California: Sage Publications. Shadish, W.R. (1986). Sources of evaluation practice: Needs, purposes, questions, and technology. In L. Bickman & D.L. Weatherford (Eds.), Evaluating Early Intervention Programs for Severely Handicapped Children and Their Families (pp. 149-183). Austin, Texas: Pro-Ed. Reprinted in W.R. Shadish & C.S. Reichardt (1987) (Eds.), Evaluation Studies Review Annual (Volume 12) (pp. 520-554). Newbury Park, California: Sage Publications. Shadish, W.R., Cook, T.D., & Houts, A.C. (1986). Quasi-experimentation in a critical multiplist mode. In W.M.K. Trochim (Ed.), Advances in Quasi-Experimental Design and Analysis (pp. 29-46). San Francisco: Jossey-Bass. Bootzin, R.R. & Shadish, W.R. (1986). Assessment and treatment in nursing homes: Implications for research. In M.S. Harper & B. Lebowitz (Eds.), Mental Illness in Nursing Homes: Agenda for Research (pp. 95-109) (DHHS Publication No. (ADM) 86-1459). Washington, D.C.: U.S. Government Printing Office. Shadish, W.R. (1987). Program micro- and macrotheories: A guide for social change. In L. Bickman (Ed.), Using Program Theory in Evaluation (pp. 93-109). San Francisco: Jossey-Bass. Shadish, W.R. & Reichardt, C.S. (1987). The intellectual foundations of social program evaluation: The development of evaluation theory. In W.R. Shadish & C.S. Reichardt (Eds.), Evaluation Studies Review Annual (Volume 12) (pp. 13-30). Newbury Park, California: Sage Publications. Shadish, W.R., Gholson, B., Houts, A.C., & Neimeyer, R.A. (1989). The psychology of science: An introduction. In B. Gholson, W.R. Shadish, R.A. Neimeyer, & A.C. Houts (Eds.), Psychology of Science: Contributions to Metascience (pp. 1-16). Cambridge, England: Cambridge University Press. Shadish, W.R. (1989). The perception and evaluation of quality in science. In B. Gholson, W.R. Shadish, R.A. Neimeyer, & A.C. Houts (Eds.), Psychology of Science: Contributions to Metascience (pp. 383-426). Cambridge, England: Cambridge University Press. Neimeyer, R.A., Shadish, W.R., Freedman, E., Gholson, B., & Houts, A.C. (1989). A preliminary agenda for the psychology of science. In B. Gholson, W.R. Shadish, R.A. Neimeyer, & A.C. Houts (Eds.), Psychology of Science: Contributions to Metascience (pp. 429-448). Cambridge, England: Cambridge University Press. Shadish, W.R. & Neimeyer, R.A. (1989). Contributions of psychology to an integrative science studies: The shape of things to come. In S. Fuller, M. De Mey, T. Shinn & S. Woolgar (Eds.), The Cognitive Turn: Sociological and Psychological Perspectives on Science (pp. 13-38). Dordrecht, Holland: D. Reidel Publishing Co. Shadish, W.R. (1989). Critical multiplism: A research strategy and its attendant tactics. In L. Sechrest, H. Freeman, & A. Mulley (Eds.), Health Services Research Methodology: A Focus on AIDS (pp. 5-28) (DHHS Publication No. (PHS) 89-3439). Rockville, Maryland: National Center for Health Services Research and Health Care Technology Assessment, Public Health Service, U.S. Department of Health and Human Services. Reprinted in substantially revised form in L.B. Sechrest & A.J. Figueredo (Eds.) (1994), New Directions for Program Evaluation (pp. 13-57). San Francisco: Jossey-Bass. Shadish, W.R. (1990). Amerikanische erfahrungen mit der evaluation von sozial- und gesundheitsprogrammen. In U. Koch und W. W. Wittman (Hrsg.), Evaluations-forschung: Bewertungsgrundlage von Sozial- und Gesundheitsprogrammen (159-181). Berlin, Germany: Springer-Verlag. [Translation: Shadish, W.R. (1990). American experiences evaluating social and health programs. In U. Koch and W. Wittman (Eds.), Evaluation: Basis for Assessing Social and Health Care Programs. Berlin, Germany: Springer-Verlag.] Shadish, W.R. (1990). Defining excellence criteria in community research. In P. Tolan, C. Keys, F. Chertok, & L. Jason (Eds.), Researching Community Psychology: Issues of Theory and Methods (pp. 9-20). Washington DC: American Psychological Association. Shadish, W.R. (1990). What can we learn about problems in community research by comparing it to program evaluation? In P. Tolan, C. Keys, F. Chertok, & L. Jason (Eds.), Researching Community Psychology: Issues of Theory and Methods (pp. 214-223). Washington DC: American Psychological Association. Berman, J.S., Neimeyer, R.A., Houts, A.C., Shadish, W.R., Meyers, A.W., & Whelan, J.P. (1991). The Psychotherapy Research Program at Memphis State University. In L.E. Beutler & M. Crago (Eds.), Psychotherapy research: An international review of programmatic studies (pp. 285-289). Washington, D.C.: American Psychological Association. Williams, J.M., & Shadish, W.R. (1991). Practical psychological assessment in nursing homes by nursing personnel. In M.S. Harper (Ed.), Management and Care of the Elderly: Psychological Perspectives (pp. 310-319). Newbury Park, CA: Sage Publications. Shadish, W.R. (1992). Do family and marital psychotherapies change what people do? A meta-analysis of behavioral outcomes. In T.D. Cook, H.M. Cooper, D.S. Cordray, H. Hartmann, L.V. Hedges, R.J. Light, T.A. Louis, & F. Mosteller (Eds.), Meta-Analysis for Explanation: A Casebook (pp. 129-208). New York: Russell Sage Foundation. Shadish, W.R. (1992). Theory-driven metaevaluation. In H-T. Chen & P.H. Rossi (Eds.), Using theory to improve programs and policy evaluations (pp. 29-45). New York: Greenwood Press. Shadish, W.R., Fuller, S., Gorman, M.E., Amabile, T.M., Kruglanski, A.W., Rosenthal, R., & Rosenwein, R.E. (1994). Social psychology of science: A conceptual and research program. In W.R. Shadish & S. Fuller (Eds.), The Social Psychology of Science (pp. 3-123). New York: Guilford Publications. Shadish, W.R., & Fuller, S. (1994). Editor's epilogue: Some reflections. In W.R. Shadish & S. Fuller (Eds.), The Social Psychology of Science (pp. 390-400). New York: Guilford Publications. Shadish, W.R., & Haddock, C.K. (1994). Combining estimates of effect size. In H.M. Cooper & L.V. Hedges (Eds.), The Handbook of Research Synthesis (pp. 261-281). New York: Russell Sage Foundation. Cook, T.D., & Shadish, W.R. (1994). Social experiments: Some developments over the past 15 years. Annual Review of Psychology, 45, 545-580. Shadish, W.R., Newman, D., Scheirer, M.A., & Wye, C. (1995). Editors' notes. In W.R. Shadish, D. Newman, M.A. Scheirer, & C. Wye (Eds.), Guiding Principles for Evaluators (pp. 1-2). San Francisco: Jossey-Bass. Shadish, W.R., Newman, D., Scheirer, M.A., & Wye, C. (1995). Developing the guiding principles. In W.R. Shadish, D. Newman, M.A. Scheirer, & C. Wye (Eds.), Guiding Principles for Evaluators (pp. 3-18). San Francisco: Jossey-Bass. Shadish, W.R., & Heinsman, D.T. (1997). Experiments versus quasi-experiments: Do they yield the same answer? In W.J. Bukoski (Ed.), Meta-Analysis of Drug Abuse Prevention Programs (NIDA Research Monograph, DHHS Publication No. (ADM) 97-170) (pp. 147-164). Washington DC: Superintendent of Documents. Shadish, W.R. (2000). The empirical program of quasi-experimentation. In L. Bickman (Ed.), Validity and Social Experimentation: Donald Campbells Legacy (pp. 13-35). Thousand Oaks, California: Sage Publications. Shadish, W.R. (2000). Nonrandomized designs. In A.E. Kazdin (Ed.), Encyclopedia of Psychology (Vol. 5, pp. 461-463). Washington, DC/New York: American Psychological Association/Oxford University Press . Shadish, W.R., & Leviton, L.C. (2001). Descriptive values and social justice. In A.P. Benson, D.M. Hinn, & C. Lloyd (Eds.), Visions of Quality: How Evaluators Define, Understand, and Represent Program Quality (pp. 181-200). Oxford, UK: JAI Press. Shadish, W.R. (2001). Quasi-experimental designs. In N.J. Smelser & P.B. Baltes (Eds/) International Encyclopedia of the Social & Behavioral Sciences (Vol. 18, pp. 12655-12659). Oxford, England: Pergamon. Shadish, W.R., & Baldwin, S.A. (2002). Meta-analysis of MFT interventions. In D. Sprenkle (Ed.), Effectiveness Research in Marriage and Family Therapy (pp. 339-370). Washington, D.C.: American Association of Marriage and Family Therapy. Reprinted as Shadish, W.R. & Baldwin, S.A. (2003). Meta-analysis of MFT interventions. Journal of Marital and Family Therapy, 29, 547-570. Shadish, W.R., Phillips, G., & Clark, M.H. (2003). Content and context: The impact of Campbell and Stanley. In R.J. Sternberg (Ed.), The anatomy of impact: What makes the great works of psychology great? (pp. 161-176). Washington, D.C.: American Psychological Association. Shadish, W.R., & Luellen, J.K. (2004). Donald Campbell: The Accidental Evaluator. In M.C. Alkin (Ed.), Evaluation Roots (pp. 80-87). Newbury Park, California: Sage Publications. Shadish, W.R., & Luellen, J.K. (2004). Guiding Principles for Evaluators. In S. Mathison (Ed.), Encyclopedia of Evaluation. Newbury Park, California: Sage Publications. Shadish, W.R., & Luellen, J.K. (2004). History of Evaluation. In S. Mathison (Ed.), Encyclopedia of Evaluation. Newbury Park, California: Sage Publications. Shadish, W.R., & Clark, M.H. (2004). Quasi-experiment. In M. Lewis-Beck, A. Bryman & T. Futing Liao (Eds.), Encyclopedia of Social Science Research Methods (Vol. 3, pp. 898 902). Newbury Park, California: Sage Publications. Shadish, W.R., & Clark, M.H. (2004). Comparison group. In M. Lewis-Beck, A. Bryman & T. Futing Liao (Eds.), Encyclopedia of Social Science Research Methods (Vol. 1, pp. 153 155). Newbury Park, California: Sage Publications. Shadish, W.R., & Clark, M.H. (2004). Matching. In M. Lewis-Beck, A. Bryman & T. Futing Liao (Eds.), Encyclopedia of Social Science Research Methods (Vol. 2, pp. 614 615). Newbury Park, California: Sage Publications. Shadish, W.R., & Clark, M.H. (2004). The Solomon Four Group Design. In M. Lewis-Beck, A. Bryman & T. Futing Liao (Eds.), Encyclopedia of Social Science Research Methods (Vol. 3, pp. 1047 1048). Newbury Park, California: Sage Publications. Shadish, W.R., Luellen, J.K. & Clark, M.H. (in press). Propensity scores and quasi-experimentation. In R.R. Bootzin (Ed.), Festschrift for Lee Sechrest. Washington DC: American Psychological Association. Shadish, W.R. (in press). Prudent inquiry: Conceptual complexity versus practical simplicity in knowing what works. In J. S. Carlson & J. R. Levin (Eds.), Scientifically Based Education Research And Federal Funding Agencies: The Case Of The No Child Left Behind Legislation. Greewich, CT: Information Age Shadish, W.R., & Luellen, J.K. (in preparation). Quasi-Experimental Design. In G. Camilli, P.B. Elmore & J. Green (Eds.), Complementary Methods for Research in Education (3rd Ed.). Washington DC: American Educational Research Association. Shadish, W.R., & Luellen, J.K. (in preparation). Quasi-Experimental Designs. In B. Everitt & D. Howell (Eds.), Encyclopedia of Behavioral Statistics. New York: Wiley. Shadish, W.R., & Luellen, J.K. (in preparation). Attrition. In B. Everitt & D. Howell (Eds.), Encyclopedia of Behavioral Statistics. New York: Wiley. Shadish, W.R., & Luellen, J.K. (in preparation). Regression Discontinuity Design. In B. Everitt & D. Howell (Eds.), Encyclopedia of Behavioral Statistics. New York: Wiley. Chacon-Moscoso, S., & Shadish, W.R. (in preparation). Validity in program evaluation. Chacon-Moscoso, S., Shadish, W.R., & Cook, T.D. (in preparation). Quasi-experiments in program evaluation. Nonrefereed Articles Shadish, W.R. (1982). Evaluation during fiscal stringency. Evaluation News, 3, 89-91. Shadish, W.R. & Reichardt, C.S. (1988). Journals that publish work of interest to evaluators. Evaluation Practice, 9, 29-34. Shadish, W. R. (1996, June). Teaching evaluation: Teaching evaluation theory. Evaluation News & Comment Magazine, 5, 553. Other Manuscripts and Technical Papers: Bootzin, R.R., Shadish, W.R., & McSweeny, A.J. (1979, January). Characterization of Mental Health Long Term Care Facilities. Final Report of research funded by the State of Illinois Department of Mental Health and Developmental Disabilities Grant No. 851-01. Shadish, W.R. (1981). Some methodological comments on the implementation of a mental health data base for the State of Illinois. In M.E. Condon, The Creation of a Statewide Client Assessment System: Design Considerations. Final Report to the Illinois Department of Mental Health and Developmental Disabilities, Extramural Grants Division. Shadish, W.R. & Cordray, D.S. (1979). Documenting the quality of pre-existing data through the creation and maintenance of dossiers. Working paper, Center for Health Services and Policy Research, Northwestern University, Evanston, Illinois. Bootzin, R.R. & Shadish, W.R. (1983, January). Evaluation of Mental Health Long Term Care Facilities. Final report for Illinois Department of Mental Health and Developmental Disabilities Grants Numbers 908-13 and 8209-21. Paper Presentations: Shadish, W.R. & Zarle, T. (1976, September). Development of a behavioral affective relationship scale for encounter group research. American Psychological Association, Washington, D.C. Shadish, W.R. & Zarle, T. (1977, May). Verbal and nonverbal interventions, and measurement in clinical groups. Midwestern Psychological Association, Chicago. Shadish, W.R. & Zarle, T. (1977, August). Intimate communication: Further developments of an encounter group outcome measure. American Psychological Association, San Francisco. Shadish, W.R., Arrick, M., & Hickman, D. (1979, May). Psychological adjustment of the spinal cord injury patient. Midwestern Psychological Association, Chicago. Shadish, W.R. (1979, October). Interfaces between management information systems and evaluation research. Evaluation Research Society, Minneapolis. Cordray, D.S. & Shadish, W.R. (1979, October). Lessons from the CIA: A case for maintaining "dossiers" on the quality of pre-existing data archives. Evaluation Research Society, Minneapolis. Shadish, W.R. (1980, May). Evaluating nursing homes as community care placements for chronic mental patients. Midwestern Psychological Association, St. Louis. Shadish, W.R. (1981, May). Outwitting the metaevaluators: How primary evaluators can anticipate criticisms of the quality of their work. Midwestern Psychological Association, Detroit. Shadish, W.R. (1981, August). Mental health policy, nursing homes, and institutionalization: Failures and opportunities. American Psychological Association, Los Angeles. Shadish, W.R. (1981, August). Evaluations of social programs for improving pregnancy outcomes: An appraisal. American Psychological Association, Los Angeles. Yogev, S. & Shadish, W.R. (1981, August). Impact of gender stereotypes on therapeutic behaviors of beginning psychotherapists. American Psychological Association, Los Angeles. Shadish, W.R. (1981, October). A review of the impact of maternal and child health programs: Evidence versus rhetoric. Evaluation Research Society, Austin, Texas. Shadish, W.R. & Cook, T.D. (1981, October). Mental health evaluation research: A metaevaluation. Evaluation Research Society, Austin, Texas. Shadish, W.R. (1982, March). The CMHC 2% evaluation requirement: A postmortem. Southeastern Psychological Association, New Orleans. Shadish, W.R. (1982, October). Values and community care for mental patients: Why do we do what we do? Evaluation Research Society, Baltimore. Shadish, W.R. (1983, October). Planning for implementability. Evaluation Research Society, Chicago. Shadish, W.R. (1983, October). Evaluation, problem solving, and community-based care for the chronically mentally ill. Evaluation Research Society, Chicago. Shadish, W.R. (1984, June). Nursing and Board-and-Care Homes: Some Observations on Private Sector Mental Health Care. Conference on Public and Private Sector Responsibility for Mental Health and Substance Abuse Services, Nashville, Tennessee. Shadish, W.R. (1984, October). The Political Economy of Evaluation. Evaluation Research Society, San Francisco. Shadish, W.R. (1984, October). Theories and Theorists of Social Program Evaluation. Evaluation Research Society, San Francisco. Miller, S.T., Dismuke, S.E., Fogelman, B.S., Rosenthal, T.L., & Shadish, W.R. (1985, February). Detection of Psychosomatic Problems in an Internal Medicine Practice. Society for Research and Education in Primary Care Internal Medicine, New Orleans. Shadish, W.R. (1985, August). Nursing Homes in Mental Health Policy. American Psychological Association, Los Angeles. Shadish, W.R. (1985, October). Descriptive, Prescriptive, and Metatheories of Valuing in Evaluation. Evaluation Research Society, Toronto. Shadish, W.R. (1985, October). A Critical Multiplist View of Quasi-Experimentation. Evaluation Research Society, Toronto. Shadish, W.R. (1985, October). Social Theory, Local Theory, and Question Formation in Evaluation. Evaluation Research Society, Toronto. Shadish, W.R. (1986, April). The Perception and Evaluation of Quality in Science. The Psychology of Science Conference, Memphis State University, Memphis. Shadish, W.R. & Epstein, R. (1986, October). Patterns of Program Evaluation Practice. American Evaluation Association, Kansas City. Shadish, W.R. (1986, November). The Units of Analysis Problem in the Evaluation of Prevention. American Evaluation Association, Kansas City. Shadish, W.R. (1986, November). Current Status of Program Evaluation. Tennessee Association of Mental Health Centers, Memphis. Shadish, W.R., Montgomery, L.M., & Doherty, M. (1987, October). How Many Unpublished Studies Are in the File Drawer? An Empirical Estimate. American Evaluation Association, Boston. Shadish, W.R. (1987, October). From Program Evaluation to Science Evaluation: A Short Leap. American Evaluation Association, Boston. Shadish, W.R. (1988, August). An Overview and Agenda for the Psychology of Science. American Psychological Association, Atlanta. Shadish, W.R., Doherty, M., & Montgomery, L.M. (1988, August). How Many Studies Are In The File Drawer? American Psychological Association, Atlanta. Shadish, W.R., Montgomery, L.M., Wilson, P., Wilson, M.R., Bright, I., & Okwumabua, T. (1988, October). A Family/Marital Therapy Meta-Analysis: Preliminary Results. American Evaluation Association, New Orleans. Shadish, W.R. (1988, October). Theory Groups in Science. American Evaluation Association, New Orleans. Shadish, W.R. (1988, October). The Role of Jargon and Neologism in Evaluation and Science. American Evaluation Association, New Orleans. Shadish, W.R., Doherty, M., & Sen Gupta, S. (1989, August). What Do Citation Counts Really Measure? American Psychological Association, New Orleans. Shadish, W.R., Montgomery, L.M., Wilson, P., Wilson, M.R., Bright, I., & Okwumabua, T.M. (1989, August). Marital/Family Therapy Effectiveness: Meta-Analysis of 163 Randomized Trials. American Psychological Association, New Orleans. Shadish, W.R. (1989, October). A Research Agenda for Social Psychology of Science. Society for Experimental Social Psychology, Santa Monica, California. Shadish, W.R. (1989, October). Methodological Findings from a Family Therapy Meta-Analysis. American Evaluation Association, San Francisco. Shadish, W.R. (1989, October). OBRA-87 and Mental Health Long Term Care. American Evaluation Association, San Francisco. Shadish, W.R. (1990, August). Novel Statistical Methods in Meta-Analysis: An Application. American Psychological Association, Boston. Church, M.C., & Shadish, W.R. (1990, August). Student Ratings of Faculty Teaching: A Confirmatory Hierarchical Factor Analysis. American Psychological Association, Boston. Shadish, W.R. (1990, October). Meta-Analytic Causal Modeling. American Evaluation Association, Washington DC. Shadish, W.R. (1990, October). The Controlled Attrition Design. American Evaluation Association, Washington DC. Shadish, W.R. (1991, August). Meta-Analysis and the Exploration of Causal Mediating Processes. Invited address to Division 5 (Evaluation, Statistics, and Measurement), American Psychological Association, San Francisco. Shadish, W.R. (1991, August). The development of evaluation theory over 25 years. American Psychological Association, San Francisco. Church, M.B. & Shadish, W.R. (1991, August). The aspirations and expectations of youth from different socioeconomic/racial groups. American Psychological Association, San Francisco. Shadish, W.R. (1991, October). Programming and Implementation Implications from a Family Therapy Meta-Analysis. American Evaluation Association, Chicago. Shadish, W.R. (1991, October). Experimental, quasi-experimental, and nonexperimental meta-analysis. American Evaluation Association, Chicago. Shadish, W.R. (1992, August). Mediators and moderators in psychotherapy meta-analysis. American Psychological Association, Washington DC. Shadish, W.R. (1992, August). Constructing psychology of science. American Psychological Association, Washington DC. Shadish, W.R. (1992, November). Five Things (+/-2) that Random Assignment Does. American Evaluation Association, Seattle. Shadish, W.R. (1992, November). The Developing Contents of Program Evaluation Theory. American Evaluation Association, Seattle. Shadish, W.R., & Haddock, C.K. (1993, August). Meta-analytic summaries of data in their original metric. American Psychological Association, Toronto. Shadish, W.R., & Tolliver, D. (1993, August). Citation Counts: Is All That Glisters Gold? American Psychological Association, Toronto. Shadish, W.R., Newman, D., Scheirer, M.A., & Wye, C. (1993, November). Report from the AEA Task Force on Guiding Principles for Evaluators: Presentation and Discussion. American Evaluation Association, Dallas TX. Shadish, W.R. (1993, November). Pros and Cons for the AEA Guiding Principles. American Evaluation Association, Dallas TX. Shadish, W.R., Heinsman, D., & Ragsdale, K. (1993, November). Randomized versus Quasi-Experiments: Do They Give the Same Results? American Evaluation Association, Dallas TX. Shadish, W.R. (1993, November). Teaching evaluation theories. American Evaluation Association, Dallas TX. Shadish, W.R. (1993, November). Causal generalization. American Evaluation Association, Dallas TX. Haddock, C.K., Shadish, W.R., Klesges, R.C., & Stein, R.J. (1993, November). Treatments for childhood and adolescent obesity: A meta-analysis. Association for the Advancement of Behavior Therapy, Atlanta GA. Stein, R.J., Bracken, B.A., Shadish, W.R., & Haddock, C.K. (1993, November). Development of the Children's Physical Self-Concet Scale. Association for the Advancement of Behavior Therapy, Atlanta GA. Shadish, W.R. (1994, August). Values and Scientific Knowledge: Lessons from Program Evaluation. American Psychological Association, Los Angeles CA. Shadish, W.R., Heinsman, D., & Ragsdale, K. (1994, August). Comparing Experiments and Quasi-Experiments Using Meta-Analysis. American Psychological Association, Los Angeles CA. Shadish, B.D., Ayres, A., Shadish, W.R., Roberson, F., Officer, R., & Weirich, J. (1994, August). Domestic Violence among Psychiatric Veterans and Their Families. American Psychological Association, Los Angeles. Matt, G.E., Shadish, W.R., Navarro, A.M., & Siegle, G. (1994, August). The effects of psychotherapy conducted under clinically representative conditions: A reanalysis of psychotherapy meta-analyses. American Psychological Association, Los Angeles. Shadish, W.R. (1994, November). Descriptive Values and Social Justice. American Evaluation Association, Boston. Shadish, W.R. (1994, November). The Guiding Principles of Evaluation. American Evaluation Association, Boston. Matt, G.E., Shadish, W.R., Navarro, A.M., & Siegle, G. (1994, November). Generalizing from the Research Lab to Clinical Practice: A Reanalysis of Psychotherapy Meta-Analyses. American Evaluation Association, Boston. Shadish, W.R. (1994, November). A Meta-Analytic Perspective on the Efficacy and Effectiveness of Marriage and Family Therapy. American Association of Marriage and Family Therapy, Chicago. Shadish, W.R., Glaser, R.R., & Kowkacki, R.J. (1995, August). Bracketing the Effects of Attrition in Randomized Experiments. American Psychological Association, New York. Glaser, R.R., & Shadish, W.R. (1995, August). Comparing Random versus Quasi-Experimental Designs in Meta-Analysis. American Psychological Association, New York. Ray, J.W., & Shadish, W.R. (1995, August). Agreement between Exact and Inexact Effect Sizes in Meta-Analysis. American Psychological Association, New York. Kownacki, R.J., & Shadish, W.R. (1995, August). A Meta-Analysis of Controlled Studies of Alcoholics Anonymous. American Psychological Association, New York. Glaser, R.R., & Shadish, W.R. (1995, November). Comparing Random versus Nonrandom Assignment Using Meta-Analysis. American Evaluation Association, Vancouver, Canada. Shadish, W.R. (1995, November). Using Descriptive Values in the Logic of Valuing. American Evaluation Association, Vancouver, Canada. Shadish, W.R. (1995, November). Of Boundaries and Politics: The Case of Consequential Validity. American Evaluation Association, Vancouver, Canada. Shadish, W.R. (1995, November). Exploring the Foundations of Program Evaluation: A Chat with Will Shadish. American Evaluation Association, Vancouver, Canada. Shadish, W.R. (1995, November). Ethics and International Perspectives: A Comment. American Evaluation Association, Vancouver, Canada. Shadish, W.R. (1995, November). Lessons Learned about Evaluation Theory. American Evaluation Association, Vancouver, Canada. Shadish, W.R. (1996, August). W(h)ither Validity? American Psychological Association, Toronto, Canada. Shadish, W.R. (1996, August). Putting the Consumer Reports Findings in Context: A Meta-Analytic Perspective. American Psychological Association, Toronto, Canada. Shadish, W.R. (1996, August). Propriety Standards and Ethics. American Psychological Association, Toronto, Canada. Shadish, W.R. (1996, August). Where are the Effectiveness Studies in Psychotherapy? American Psychological Association, Toronto, Canada. Stanton, M.D., & Shadish, W.R. (1996, August). Family and Marital Treatment Outcome for Drug Abuse: Review and Meta-Analysis. American Psychological Association, Toronto, Canada. Zhang, T., & Shadish, W.R. (1996, August). The comparison of exact versus inexact effect sizes computed by change-score methods. American Psychological Association, Toronto, Canada. Shadish, W.R. (1996, November). Ethics? Or What the Market Will Bear? American Evaluation Association, Atlanta, GA. Shadish, W.R. (1996, November). Theory-Based Evaluation: Toward a Comparative Theory of Evaluation Approaches. American Evaluation Association, Atlanta, GA. Shadish, W.R. (1996, November). Donald Campbell and Evaluation Theory. American Evaluation Association, Atlanta, GA. Zhang, T., & Shadish, W.R. (1996). Exact Versus Inexact Effect Sizes Computed by Change Score Methods. American Evaluation Association, Atlanta, GA. Shadish, W.R. (1997, November). Because Its Who We Are. Presidential Address to the annual convention of the American Evaluation Association, San Diego, CA. Glaser, R.R., Robinson, L.A., Klesges, R.C., Zbikowski, S.M., & Shadish, W.R. (1997, November). Using HLM to Analyze Non-linear Multilevel Evaluation Data. American Evaluation Association, San Diego, CA. Shadish, W.R. (1998, February). Marriage and Family Therapy Effectiveness Research. Invited plenary address to the annual convention of the Tennessee Association for Marriage and Family Therapy, Nashville, TN. Shadish, W.R., & Hu, X. (1998, August). The Analysis of Attrition: New Developments. American Psychological Association, San Francisco, CA. Shadish, W.R. (1998, October). Revisiting Experimentation: Field Notes for the Future. Invited plenary address to the annual convention of the Australasian Evaluation Society, Melbourne, Australia. Clark, M.H., & Shadish, W.R. (1998, November). A Laboratory Experiment Comparing Assignment Methods. American Evaluation Association, Chicago, IL. Shadish, W.R. (1998, November). Attrition as a threat to validity. American Evaluation Association, Chicago, IL. Glaser, R.R. & Shadish, W.R. (1998, November). Are Effect Size Estimates from Repeated Measures and ANCOVA Data equivalent to Cohens d? American Evaluation Association, Chicago, IL. Clark, M.H., & Shadish, W.R. (1999, August). A Laboratory Experiment Comparing Assignment Methods and Using Propensity Scores. American Psychological Association, Boston, MA. Phillips, G.A., & Shadish, W.R. (1999, August). A Continuous Measure of the Clinical Representativeness of Psychotherapy Outcome Studies. American Psychological Association, Boston, MA. Shadish, W.R. (2000, August). Revisiting Field Experimentation: Field Notes for the Future. Invited address to Division 5, American Psychological Association, Washington, DC. Shadish, W.R. (2000, August). Validity and Utility: Orthogonal Criteria of Good Evaluation. American Psychological Association, Washington, DC. Phillips, G.A.., & Shadish, W.R. (2000, August). Moderators of Psychotherapy Outcomes Found in Meta-Analyses. American Psychological Association, Washington, DC. Shadish, W.R. (2000, November). The AEA Guiding Principles and Diversity: Reflections from the Task Force Chair. American Evaluation Association, Honolulu, Hawaii. Shadish, W.R. (2000, November). Using Pretest Effect Size to Measure Selection Bias in Meta-Analysis. American Evaluation Association, Honolulu, Hawaii. Shadish, W.R. (2000, November). Guiding Principle E: What We Did and Why We Did It. American Evaluation Association, Honolulu, Hawaii. Shadish, W.R. (2001, February 22). Effect Size Calculation. Campbell Collaboration, Philadelphia, Pennsylvania. Clark, M.H., & Shadish, W.R. (2001, August). Reducing Quasi-Experimental Bias Using Propensity Scores: A Follow-up Study. American Psychological Association, San Francisco. Shadish, W.R. (2001, August). Measuring Selection Bias in Meta-Analysis Using Pretest Effect Size. American Psychological Association, San Francisco. Cook, T.D., Chacn-Moscoso, S., Anguera-Argilaga, M.T., Prez-Gil, J-A., & Shadish, W.R. (2001, September). Convergence between quasi-experimental and observational designs to enhance evaluative results generalization. Sixth Conference of the European Association of Psychological Assessment, Aachen, Germany. Shadish, W.R. (2001, October). Meta-Analytic Response Surface Modeling. Society for Multivariate Experimental Psychology, Monterey, California. Shadish, W.R., Phillips, G., & Clark, M.H. (2001, November). What Makes Great Works Great? The Case of Campbell and Stanley. American Evaluation Association, St. Louis, Missouri. Clark, M. H., Shadish, W.R., & Tang, B. (2001, November). Simulating Data to Evaluate Biases in Non-Randomized Experiments. American Evaluation Association, St. Louis, Missouri. Shadish, W.R., & Baldwin, S.A. (2002, July). The Effects of Marriage and Family Interventions: What Can We Learn From Meta-Analyses? American Association of Marriage and Family Therapy, Reno, Nevada. Clark, M. H., Tang, B., and Shadish, W. R. (August 2002). Using the Rank Order Method to Correlate Simulated, Mixed-Distribution Variables. American Psychological Association, Chicago, IL. Shadish, W.R., & Marcus, S.M. (2002, August). Meta-Analytic Response Surface Modeling: An Initial Exploration. American Psychological Association, Chicago. Phillips, G.A., Shadish, W.R., Murray, D.M., Kubik, M., Lytle, L.A., Birnbaum, A.S. (2002, August). Confirmatory Factor Analysis of CES-D implementing a general hierarchical model. American Psychological Association, Chicago. Shadish, W.R. (2002, September). Some Meta-Analytic Comparisons Between Randomized and Nonrandomized Experiments. Campbell Collaboration Methods Group Conference, Baltimore, Maryland. Shadish, W.R. (2002, October). Meta-Analysis in the United States. European Evaluation Society, Seville, Spain. Shadish, W.R. & Clark, M.H. (2002, October). A Randomized Experiment Comparing Randomized to Nonrandomized Experiments. Society for Multivariate Experimental Psychology, Charlottesville, Virginia. Shadish, W.R. (2002, November). Retrospect: Comments on the Stages of Program Evaluation Theory. American Evaluation Association, Washington DC. Shadish, W.R. (2002, November). Experimental and Quasi-Experimental Design: The Making of Shadish, Cook & Campbell (2002). American Evaluation Association, Washington DC. Clark, M.H., Floyd, R., & Shadish, W.R. (2002, November). Assessing Consistency of Intelligence Quotients Across Measurement Tests. American Evaluation Association, Washington DC. Shadish, W.R. (2002, November). Guiding Principles versus Standards: Where Do Diversity Guidelines Fit? American Evaluation Association, Washington DC. Shadish, W.R. (2003, February). Quasi-Experimental Design Group. Campbell Collaboration, Stockholm, Sweden. Shadish, W.R. (2003, February). Identifying randomized trials and other designs for C2 systematic reviews. Campbell Collaboration, Stockholm, Sweden. Shadish, W.R., Floyd, R.G., & Clark, M.H. (2003, September). The Exchangeability of IQ Scores. Society for Multivariate Experimental Psychology, Keystone, Colorado. Shadish, W.R. (2003, November). Randomized and Nonrandomized Experiments in Campbell Collaboration Reviews and Their Implications for Research on Evidence Based Treatments. American Evaluation Association, Reno, Nevada. Shadish, W.R. (2003, November). Standards of Performance in Making Causal Inferences. American Evaluation Association, Reno, Nevada. Shadish, W.R. (2003, November). Challenges Involved in Developing Standards and Protocols for Evidence Reviews. American Evaluation Association, Reno, Nevada. Baldwin, S.A., & Shadish, W.R. (2003, November). The Effects of Behavioral Marital Therapy Under Clinically Representative Conditions. Society for Psychotherapy Research. Shadish, W.R. (2004, July). Good Enough Evidence for Treatment Effects. American Psychological Association, Honolulu, Hawaii. Blitstein, J.L. Murray, D.M., Hannan, P.J. & Shadish, W.R. (2004, May). A Method for Increasing the Efficiency of Group Randomized Trials. Society for Prevention Research. Invited Colloquia, Workshops, and Presentations: "Clinical Group Research". University of South Dakota, May 1978. "Intimate Behavior in Groups". University of Toledo, May 1978. "Chronic Mental Patients in Nursing Homes". University of Wyoming, March 1981. "Nursing Homes and Mental Health Policy". University of Illinois at Champaign-Urbana, April 1981. "The Evaluation of Evaluations". University of Mississippi, October 1982. "Sources of Methods Choices". Peabody College, Vanderbilt University, March 1983. "Evaluating Evaluation Theorists". Peabody College, Vanderbilt University, March 1983. "Nursing Home Care for the Mentally Deficient". Peabody College, Vanderbilt University, October 1983. "Nursing Homes, Mental Health Policy, and Policy Research". State of Tennessee Department of Mental Health (Nashville), October 1983. "Nursing Homes and Mental Health Policy: Implications for Policy Research". Department of Psychology, Northwestern University, November 1983. "American Experiences Evaluating Social and Health Programs". Invited Address to the Conference: "Evaluation: Basis for Assessing Social and Health Care Programs". Sponsored jointly by the University of Freiburg Department of Psychology, and by the German Ministry of Youth, Family, Women, and Health. Held at Konigswinter, West Germany, April 15, 1987. "Patterns of Program Evaluation Practice: An Empirical Study". Department of Psychology, University of Rhode Island, October 13, 1987. "Contributions of Psychology to an Integrative Science Studies: The Shape of Things to Come". Invited address to the Sociology of Science Yearbook Conference, Department of Philosophy, University of Colorado, Boulder CO, November 23, 1987. (with Robert A. Neimeyer). "Critical Multiplism: A Research Strategy". Invited plenary address to the Conference on Health Services Research Methodology: A Focus on AIDS, Department of Psychology, University of Arizona, Tucson AZ, June 2, 1988. "Methods versus Strategies in Community Research". Invited keynote address to the conference on Researching Community Psychology: Integrating Theories and Methods, Department of Psychology, DePaul University, Chicago IL, September 9, 1988. "Saying It Bluntly". Closing remarks to the conference on Researching Community Psychology: Integrating Theories and Methods, Department of Psychology, DePaul University, Chicago IL, September 10, 1988. "What's in a Name? Naming and Framing Deinstitutionalization". Center for Mental Health Policy, Peabody College, Vanderbilt University, Nashville TN, March 8, 1991. "Program Evaluation: Issues, Options, and Importance". Workshop presented at Dalhousie University, Halifax, Nova Scotia, November 12, 1992. "The Academic and Practical Status of Program Evaluation". University Lecture, Dalhousie University, Halifax, Nova Scotia, November 13, 1992. "Randomized versus Quasi-Experiments: Do you get the same answer?" National Institute of Drug Abuse Technical Review: Meta-Analysis of Drug Abuse Programs. Bethesda, Maryland: July 26, 1993. Comparing Quasi-Experiments to Randomized Trials: Are They as Good as Gold? Invited Colloquium, Health Behavior Research Department. University of Alabama, Birmingham: May 17, 1995. Making a Difference: Eight Lessons I Wish I Had Learned Sooner. Commencement Address, The University of Memphis, August 13, 1995. Recent Developments in the Design and Analysis of Quasi-Experiments. Workshop presented at the Department of Psychometrics and Research Methodology, Rijks University, Leiden, The Netherlands, 4-8 September, 1995. An Overview of Evaluation Issues. Keynote Address, SPNS Cooperative Agreement Evaluation Conference, Health Resources and Services Administration, Arlington Virginia, September 15, 1995. Advanced Topics in Quasi-Experimentation. Paper presented at SPNS Cooperative Agreement Evaluation Conference, Health Resources and Services Administration, Arlington Virginia, September 15, 1995. Using Time Series Designs for Impact Assessment. Presented at the Impact Assessment and Evaluation Workshop conducted by the Consultative Group on International Agricultural Research (CGIAR) Impact Assessment and Evaluation Group (IAEG), April 15-17, 1996, The Hague, The Netherlands. Quantitative and Qualitative: N/ever the twain shall meet. Invited Colloquium to the Department of Psychology, Vanderbilt University, February 21, 1997. Meta-Analysis: Overview and Technical Details. Workshop presented at Case Western Reserve University, Cleveland, Ohio, December 5, 1997. Program Evaluation. Workshop presented to the Queensland chapter of the Australasian Evaluation Society, Brisbane, Australia, October 2, 1998. Meta-Analysis. Workshop presented at the annual conference of the Australasian Evaluation Society, Melbourne, Australia, October 6, 1998. Revisiting Field Experimentation: Some Things We Are Learning. Plenary address to the third annual conference on Applied Psychology, Carbondale IL, February 6, 1999. Psychotherapy Meta-Analysis: Some Findings and Observations from a 10 Year Program of Research. Invited address to the UC Berkeley/Stanford Meta-analysis Conference, Berkeley CA, March 17, 2000. Validity and generalization of results in program evaluation: Methodological advances in design and analysis. Workshop presented to the University of Sevilla (Spain), May 22-25, 2000. A Brief History of Social Experimentation. Invited address presented to the University of Kansas, March 1, 2001. Revisiting Field Experimentation: Field Notes for the Future. Invited colloquium to the Psychology Department at the University of Kansas, March 2, 2001. Psychotherapy in Clinically Representative Settings: A Methodologically Interesting Meta-Analysis. Invited colloquium to the Psychology Department at the University of Arizona, April 5, 2001. Meta-Analysis. Workshop presented at the University of Arizona, Evaluation Group for the Analysis of Data, April 6, 2001. Revisiting Field Experimentation: Field Notes for the Future. Invited colloquium to the Psychology Department at Arizona State University, April 19, 2001. Psychotherapy in Clinically Representative Settings: A Methodologically Interesting Meta-Analysis. Invited colloquium to the Psychology Department at Arizona State University, April 20, 2001. Revisiting Field Experimentation: Field Notes for the Future. Invited colloquium to the Psychology Department at Vanderbilt University, November 28, 2001. Regression Discontinuity Design. Invited talk to NIH/CDC conference on Evaluating the Effects of Complex Community Interventions, May 4-5, 2004. Reflections on Issues and Tradeoffs. Invited talk to NIH/CDC conference on Evaluating the Effects of Complex Community Interventions, Bethesda MD, May 4-5, 2004. Experimental and Quasi-Experimental Designs. Invited workshop to NICHD on Work, Family, Health, and Well-Being, Bethesda MD, July 22-23, 2004. Courses Taught (Course evaluations available upon request) Undergraduate Introductory Psychology Psychological Statistics Graduate Psychotherapy Measurement Theory and Psychometrics Linear Structural Modeling Research Design and Methodology Social and Community Interventions Models of Program Evaluation Field Methodology Advanced Causal Modeling Advanced Design Topics in Advanced Methodology Methods for Research Synthesis University Service Member, Faculty Senate (1985-1987, 1998-1999) Member, Special Committee on the Quality of Teaching, Research, and Service (1988-1989) Member, University Tenure and Promotion Appeals Committee (1987-1990) Member, VanVleet Fellowship Selection Committee (1986-1995) Member, University Institutional Review Board (1989-1992) Member, Provost Search Committee (1991-1992) Chair, University of Memphis Board of Visitors Eminent Faculty Award Committee (1992-1994, 1996-1997), Member (1995-1996) Member, Committee on the Evaluation of Effectiveness in Research (1994-1995) Member, University Standing Committee on Public Records and Forms (1998-1999) Member, Student Evaluation Committee (2001-2002) Member, University Program Review Committee (2002) Member, UC Merced Interim Planning Committee for Instructional Technology and Support (2003-present). Member, UC Merced Seminar Committee (2003-present). Member, UC Merced Faculty Committee on Academic Planning and Resource Allocation (2003-present). Member, UC Merced Committee on Academic Personnel (2003-present). Member, UC Merced Student Health Advisory Committee (2004-present). College Service Member, Dean Search Committee, College of Arts and Sciences (1989-1990) Member, Dean Search Committee, College of Arts and Sciences (1994-1995) Member, Selection Committee, College of Arts and Sciences Meritorious Faculty Award (1992-1995) Member, Dunavant University Professor Award Committee (1999-present) Chair, Search Committee, English Department Chair (1995-1996) Member, UC Merced Faculty Search Committee for Social Sciences, Humanities, and Arts (2003-2004). Member, UC Merced Faculty Search Committee for Biostatistics (2003). Member, UC Merced Faculty Search Committee for Social, Behavioral, and Cognitive Sciences (2004-present). Member, UC Merced Faculty Search Committee for World Cultures and History (2004-present). Member, UC Merced Faculty Search Committee for Bioengineering (2004-present). Department Service Member, Search Committee, Psychology Department Chair (1983-1984) Member, Search Committee, Psychology Department Chair (1989-1990) Member, Search Committee, Psychology Department Lillian and Morrie Moss Chair of Excellence (1996-1998) Member, Department Chair 5-year Evaluation Committee (1998-1999) Director, Center for Applied Psychological Research (1990-1997) Director, Research Design and Statistics Program (1987-present) Chair or Member of Miscellaneous Other Department Committees over time, including numerous faculty search committees, chair's advisory group, diversity committee (current chair), faculty teaching evaluation committee, long-range planning committee, clinical admissions committee, postdoctoral fellow selection committee, coordinating committee for the Masters of Science in General Psychology program, conferences and visitors committee, publicity committee, space committee. Community Service Advisory Board, Project R.A.P. (Responsible Adolescent Parenting), Memphis TN: President (1990-1992), Secretary (1998-present), Member (1988-present). Memphis Beat the Odds Foundation (2001-present), Founding Board Member and Treasurer. Beat the Odds Committee: Treasurer (1997-present), Member (1994-present). Member: Tennessee Department of Mental Health and Mental Retardation Task Force on Public and Private Sector Responsibilities for Mental Health and Substance Abuse Services (1984-5). Member: Care Home Resource Committee, Mental Health Society of Memphis and Shelby County (1984-8). Member: Policy Task Force, Mental Health Society of Memphis and Shelby County (1988). Professional Service: Invited Participant: American Psychological Association, National Conference on Graduate Education. University of Utah, June 13-19, 1987. Program Chair, Division 24 (Theoretical and Philosophical Psychology), 1989 Annual Convention of the American Psychological Association. Program Chair, Division 5 (Evaluation, Measurement, and Statistics), 1994 Annual Convention of the American Psychological Association; Program Committee, 1992-5. Program Chair, Topical Interest Group on Quantitative Methods, 1991 Annual Convention of the American Evaluation Association. Member, Directory Development Committee, American Evaluation Association (1987). Member (Appointed), Board of Directors, American Evaluation Association (1991-1993). Chair, American Evaluation Association, Task Force on the Development of Guiding Principles for Evaluators (1992-1994). Member, Ethics Committee, American Evaluation Association (1994-1996). Member, Test Standards Review Task Force, American Evaluation Association (1996). Member, Publications Task Force, American Evaluation Association (1993-1994). President, Topical Interest Group on Theories of Evaluation, American Evaluation Association (1996). President, American Evaluation Association (1997), President-Elect (1996), Past-President (1998). Co-Convenor, Quasi-Experimentation Group, The Campbell Collaboration (2000-present). Member, Task Force on Guiding Principles for Evaluators Working in Diverse Communities, American Evaluation Association (2001-2002).  PAGE 26  PAGE 27 !4 " > Zv;Yx:Kiz?Pfw$2Wj""w#x##### $ $'$[${$2%N%%%W&&&'''(%('(;(((^))*@*M*f*****++\+ 6CJH*CJaJ 6CJaJ6CJ5CJCJOJQJX !4Stuk%Ox  ^` ^`   $a$d""-s a E 3  ! " @ a @^@`  ^`  EYZx]~C[$o 7 @^@`Kij """ #I#x##### $ $)$*$$`%#&$a$  @^@`#&&K''y()))L*M*h*i**g++,-#../1020001123Y4@^@ @^@`\+++,,v---...f//0(0Z0z0 161w22n33'4N444'5?555 6 6+66777 8S888w999:::;.;;;<0<<<f==&>;>>??@@@ZAsA!B>BBBCC8DTDDDEEPFrF*G[GH9HHIIJJJ#K*CJ6CJCJaY44J555s6t6 77^899::8;;:<<=H>!?@@AKBCC_D@^@ @^@`_DDE}FhGFH&I'IIIJJFKKwL4MNNNN/O0OO|PDQRS ^`^ @^@`lL M'MMNO#OOO[PsPQ7QQQiRRR SSS1TjTUUV"WWWXX Y-YYYYYZZ [-[6[9[[[Z\q\|\!]<]]^p^^^^^__ ___U`f`g`h````aa/bbcccdd}efffaJ6CJ\aJ CJ\aJ 6CJ\CJaJ 6CJaJCJ\6>*CJ6CJCJQSSSTTU/WXX7YYZ9[[|\H]^^ __h`a/bcc ^`d #^#`^ @^@`chdd}efffffhhi|jjjkkllPmQm/n^op2q@^@ @^@` d^` ^`fffgg]hhcii-jJjjj2kRk(lllmmnnnooppqrrstRtOuuavvwwxyyyzz{ |}Z},~k~HDd ,ƃ}e6e>{[݉BË͋΋ 6CJ\CJ\ 6CJaJCJaJ>*CJ6CJ5CJCJW2qVrXstuywzw%x&x!z!{N|}~ՁbDŽT v^v`@^@ @^@`TAB͋΋ߌ:׎uf3dT@s ^` @^@` @^@`΋SߌFW ׎Cks%TVkl'/u6793^Γ$8Dcdޔ QTÕZ.=?@XjӘ@emי.yu>*CJ5CJ 5CJaJ OJQJ^J6OJQJ^J6CJ]aJ CJ\aJOJQJ 6CJaJCJaJ6CJCJKlmĝŝڝ۝6"><p @^@`uIŝ؝ ^a ZRP ] V\A\ħ cĩF֪LȬR̭FmNr9 Aرsh8ִ"vNɶWXuʸ;z5CJ>*CJCJaupu{-eq ߲HճlV8 @^@`>ܻnsuswKd<8j @^@`L^?ļ=½Fݾ>hB/q1F6v+Y~ix7;|~H9 `J cL]#w3g(ZCJ>*CJbM?+D<Vd;v @^@`Z4h>Dv1O:2otUc=}9}i<*ZZgQpCJaJmH sH  >*CJaJCJaJB*CJaJph>*B*CJaJph>*B*CJaJph>*CJ>*CJJv1pOGP~;s:1 ^` @^@`d@&^`139$db t{eV @^@` ^`2pY ]Jf   4 A t | <= !"1^q""""""""""""""0JmHnHu0J j0JU 5CJaJ0J5CJaJ>*CJ5CJ >*CJaJCJaJCJCJaJmH sH >*CJaJmH sH EV"YiPr0f,Y3   /  f   @^@`   4 B Z s t }     +=Vf>' ^` @^@`'<m:!"2z"gL^_r^ @^@`Kga _0 y  !!!;"""$a$ @^@`"""""" @^@`$a$'0 @P/ =!"#$% i0@0 Normal_HmH sH tH PP Heading 1$d^`CJOJQJkHB@B Heading 2 $ CJOJQJkH>@> Heading 3$@^@`CJ<A@< Default Paragraph Font,, Header  !, @, Footer  !&)@& Page Number>>@"> Title$da$5CJOJQJkHDP@2D Body Text 2@d^@`CJ$OB$ APAdCJ8OQ8 MTEquationSection<B*HC@bH Body Text Indent@^@`CJ:'@q: Comment ReferenceCJaJ.U@. Hyperlink >*B*phLR@L Body Text Indent 2^`CJ"W@" Strong5\ d !4Stuk%Ox-saE3!"@a E Y Z x  ] ~ C[$o 7Kij Ix ) * `!#""K##y$)%%L&M&h&i&&g''()#**+1,2,,,--./Y00J111s2t2 33^45566877:889H:!;<<=K>??_@@A}BhCFD&E'EEEFFFGGwH4IJJJJ/K0KK|LDMNOOOPPQ/STT7UUV9WW|XHYZZ [[h\]/^__h``}abbbbbdde|fffgghhPiQi/j^kl2mVnXopqyszs%t&t!v!wNxyz{|}~bǀTAB͇·߈:׊uf3dT@slmęřڙۙ6"><pupu{-eq ߮HկlV8>ܷnsuswKd<8jM?+D<Vd;v1pOGP~;s:139$db t{eV"YiPr0f,Y3/f4 B Z s t }      + = V f      >    '   < m  :!"2z"gL^_r^Kga _0y;00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000(0000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000@0@0@0 0 \+lLf΋uZ" #&Y4_DSc2qTv1V '""" !!8@0(  B S  ? OLE_LINK1 OLE_LINK2T@-5g m n u sz:AWdLS%&3qx #v!: C ~!!!!!!@"G"h#p#z#}#####y&~&((((()))))3*:*****--.....///1111223333n4u4-636;6@6J6Q6677778:8B8 999 9H:N:::!;(;:;@;D<M<Z>a>? ?$?,???AA"A*A4A=AAABBPBYBCCDD=FDFGGGHHJJJJJJJJJJJKK KKK|LL5O^E^L^T^\^`^aaccccccddddTe[eeeffg!gh hhhnisiiiii"j(j/j6jjjkkkk ll&l/lllNmSm]memmmmm nnnnnn ooXo`oooppppGpRppp,q/q?qFqqqqqqq7r?rsssstt=tJtKtVtWtZt[t^tntttztttttttttttttttu&u/u5uuuvvvsvxvvvwwww\xdxlxqxxxy y?{F{{{|#|||||} } "bjqtJRY\Ɂ'./6ƅ΅ԅՅօمIQ9>KR~#)/56: ߌ΍ԍڍu|ҎَFNu|el >E@GNFK")3Aģ'3S\"1ǻʻſ˿hnKQ$+3< $ &W_}  *228-rJPDE23@^ a D E X x  Z ~  C)+f0Z[!$r5{Bl  4{H2WX !0!2!N!" """"#>#J###%(%^%%%%%&&A&&&&&&)'+'f'~''''((3)7)v)))))"***f+++ ,,0,W,, -7---- .w..n///%0'0X0p00000%1'1I111222 3/3333 4]445w555556p6z666777O7~77789809d9f999$:&:E:H:~:;<]<<Z=====>!>H>>???8@^@@@AA*CeCDCDD#E'EEEFFaFFFF!G#GCGGGIHtHwHH I1IIJJJK*KKK[L{LMAMMMMNiNNNNYO[OqOOOORQmQQQR,SSSTT U4U7UlUUU@VVVVVW W6WWWZX{X|XXpZZZZ[[\]/^v^__` `bb'dEd fbfffuhzhiimnnoost=ttxxyzz{&|-||}~~0?'ׄڅ{hlu̇awfɎĒ@uvؓٓ2VXrєӔ@kו|JLÙ _a5 []!S=Y ;suDo_ǣ dfťǥGIt֦oOtɨ˨UzϩFnp,Nsu$:<dìDpqۭޮGhү;k%UvOQʲ̲Z 5Xvxʴ;{MO ;ٷ@BkŸǸ@rùŹGIr޺ kEpüt ItwþHҿԿy,.ad 9<5gy{:g ;}LK~ >`(CO;&S6c)84hk EFu0<o}NEWdeO;} :*,;+,q[\333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333!Su@Z x j 2!!!""##B&M&f++8:809f9AADDIJQQ@VV W9WYZ [6[[[^_bbst)·Ē.?;~,r\0 8_< l William ShadishWilliam ShadishWilliam ShadishWilliam ShadishWilliam ShadishWilliam ShadishWilliam Shadish WILL SHADISH Will ShadishkhakutamC:\Documents and Settings\khakuta\My Documents\Kenji\Merced\SSHA Faculty Website\Faculty\CVs\Will Shadish.DOC @ @ @]@HP LaserJet 6PLPT1:winspoolHP LaserJet 6PHP LaserJet 6P4C odXXLetterDINU"4 PHP LaserJet 6P4C odXXLetterDINU"4 Pu@UnknownGz Times New Roman5Symbol3& z Arial7Georgia3z Times#h*F*FX[k&{)qy*|$0d]"3qHvitavitaPreferred CustomerkhakutaOh+'0   < H T `lt|vitafitaPreferred CustomervitarreitaNormalekhakuta2akMicrosoft Word 9.0@G@D@Tp@Tp{)q՜.+,0 hp  The University of Memphis Psyey]" vita Title  !"#$%&'()*+,-./0123456789:;<=>?@ABCDEFGHIJKLMNOPQRSTUVWXYZ[\]^_`abcdefghijklmnopqrstuvwxyz{|}~Root Entry Fp1TablegWordDocument)dSummaryInformation(DocumentSummaryInformation8CompObjjObjectPoolpp  FMicrosoft Word Document MSWordDocWord.Document.89q