The Compelling Need for Diversity in Higher Education Overall Analytic StrategyAs described in the body of the Report, I conducted three sets of empirical analyses developed specifically for this litigation. Using national data from the Cooperative Institutional Research Program as well as data collected from students at the University of Michigan, these analyses provide a fair test of the effects that campus diversity has on the academic development and democratic values of college students. Standard, generally accepted approaches to systematic data collection and statistical analyses were used to produce this research. Together, the approaches used provide a conservative test of diversity's effects, by statistically accounting for relationships known or expected to contribute to student development before accounting for the effects of campus diversity. As such, the results provide a minimal estimate of diversity's effects, in that the analyses consistently afford other variables in the analysis (i.e., characteristics of students and colleges) a greater opportunity to account for, and possibly explain away, the influence of campus diversity on college students. Figure 1 in the Report provides an overview of the general approach used in the analyses of the CIRP and Michigan Student Study data. I began by first identifying the most relevant data bases that could be analyzed to provide systematic, empirical evidence on the effects of campus diversity on student development, and then by identifying the specific variables available within these data bases that were most closely related to classroom and informal interactional diversity, and to learning and democracy outcomes. Once identified, each of the individual outcome variables was analyzed using a statistical methodology known as multiple regression analysis. The methodology allows one to develop a fair portrayal of the relationship between specific variables of interest and the outcome variable, after controlling for the influence of other variables known (or expected) to bias the relationships of interest. The primary variables of interest are those related to campus diversity in its many forms, in that we are interested in understanding how these variables affect (or predict) different student outcomes. One way to consider the effects of diversity on student outcomes is simply to consider the raw relationship, or correlation, between variables of interest. Unfortunately, these relationships tend to overstate the true degree to which campus diversity influences student development, as other known influences on student development are not considered. To correct for this shortcoming, these analyses use a standard set of variables as statistical controls. This allows us to provide reliably unbiased portrayals of the relationships of interest. Since students come to college with different attitudes, values, and experiences, these variables are first considered as possible explanations for the relationship between campus diversity and student development. Once this first block of control variables is considered, the analysis proceeds to consider the classroom and interactional diversity measures in order to determine whether these variables provide any additional explanatory power. By considering these variables in combination, the results produce a less biased view of the relationship between campus diversity and student outcomes. In reviewing the results in the body of the Report, I concentrated on the relationships between the campus diversity measures and each of the learning and democracy outcomes considered. A basic indicator of the strength of these relationships with the outcome measures is found in the assessment of its statistical significance. A relationship is judged to be statistically significant when its strength is such that it is unlikely to have emerged from the data simply on the basis of chance. We use the most common indicator of statistical significance in reviewing these results. For the white student sample, I only judge relationships to be significant when the odds are less than 1 in 20 that the relationship was simply due to random chance. Since probability levels are related to sample size, I use a slightly different criterion for the samples of African American and Latino students, the odds of less than 1 in 10 that the relationship was simply due to random chance. This approach provides clearly defined statistical evidence on the strength of relationship between the predictors of interest and each of the dependent variables. In addition to considering statistical significance, given the multitude of educational outcomes that we consider, it is also important to consider the consistency of findings across the entire set of analyses. Since each of the educational outcomes considered in these analyses represents a different possible aspect of a student's development, a degree of consistency in the relationships across the outcome variables is additional evidence of the effectiveness of any particular characteristic of campus diversity at producing different kinds of learning and democracy outcomes among college students. As noted above, my regression analyses were conducted on national data from CIRP as well as data collected specifically from students at the University of Michigan. Since the data bases used for these analyses were designed by different individuals as well as for somewhat different purposes, I could not conduct precisely identical analyses using these different data bases, though I have sought to make the analyses as parallel as possible following the theoretical framework represented in Figure 1. It is important to consider the evidence from these two studies in combination, for it provides a more complete picture of the ways in which diversity affects the educational development of college students than could any single data base. For example, while data collected nationally is necessarily somewhat generic in terms of the kinds of questions that might be asked, this limitation is offset by the fact that when data are collected from many different institutions, this allows us to compare directly the effects of structural diversity by examining the degree to which campus diversity creates conditions and opportunities for students to interact with diversity. In contrast to the national data base, the set of evidence derived directly from students attending the University of Michigan allows us the opportunity to directly examine how these issues operate on our campus, especially as it relates to specific programs on the University of Michigan campus. The CIRP Study The national data were collected through the Cooperative Institutional Research Program (CIRP) conducted by the Higher Education Research Institute at the University of California, Los Angeles under the auspices of the American Council on Education. The CIRP is a well-known and respected research program that is the nation's longest and largest on-going empirical study of American higher education. All told, the CIRP program has collected data from more than 1,500 institutions and surveyed more than 9 million students and 500,000 faculty since its inception in 1966. The specific data base used for this investigation is drawn from students who entered college in 1985. These students were surveyed during the summer and early fall of 1985 as they prepared to enter college. In addition, these students also completed follow-up surveys in 1989 (four years after college entry) and 1994 (nine years after college entry) to assess their experiences since entering college. The availability of data from two separate follow-up surveys allows us to examine both near-term and long-term outcomes, as students leave the collegiate environment and begin their transition into their adult roles. Since similar questions were asked on each of these three surveys, by comparing responses from these individuals on the pre-college and one of the post-college surveys, it is possible to examine the degree to which students changed since entry in college. By comparing these patterns of change across different institutional characteristics (after first controlling for relevant student characteristics), it is possible to generate a picture of how these institutional characteristics, and specifically campus diversity, affect student outcomes. The outcomes reflect two ways of capturing growth and change among college students. For about half of the outcomes measured in CIRP four and nine year data, students were asked to report at college entry (during the first orientation days at college) their aspirations, self-rating of abilities compared to the average person their age, and importance of personal goals in the areas of engagement and motivation, citizenship engagement, and racial/cultural engagement. These self-assessments were reported again at four year and nine year survey administrations, allowing the assessment of change or growth of self-assessment in relation to experiences related to diversity in college. A second way of assessing growth was to ask students "how much have you grown since entering college," to capture the key areas where students personally felt significant change had occurred. It is important to note that self-reports of learning outcomes are correlated with traditional measures of achievement (e.g., with College BASE, a criterion-referenced achievement test, and GRE scores for the limited sample of students who took these tests in CIRP -- see Pike, 1993, and Anaya, 1992), and self-reported growth items correspond with growth among undergraduates reported by faculty within institutions (Hurtado, et al., 1998). The CIRP survey program includes a national sample of all types of institutions, though for this set of analyses we limited our investigation to certain types of institutions. Specifically, I excluded historically Black colleges and universities as well as community colleges from the analysis since I believe that both campus diversity issues and educational processes differ dramatically from those found at predominantly white four-year colleges and universities. With this restriction in place, the CIRP data base I analyzed contained information collected from 9,316 students who first enrolled in college in 1985 at one of 184 colleges and universities. I examined 56 outcome measures as part of this analysis. These measures were divided into four categories: learning outcomes and democracy outcomes, measured both near-term (four years after college entry) and long-term (nine-years after college entry), and are described in the section on Measures below, as are the specific student background and institutional characteristics used in the analyses. The analysis of each dependent variable was repeated four times using the same standard set of statistical control variables, but varying in terms of the combination of campus diversity measures being used. Specifically, each CIRP analysis contained the measure of classroom diversity available in the CIRP Study (i.e., enrolling in an ethnic studies course), and one measure of interactional diversity (i.e., participating in a racial/cultural awareness workshop, or discussing racial issues, or socializing with someone from a different racial/ethnic background, or having a close friend of a different racial/ethnic background during college). In this way, I generated a portrait of how each of the aspects of campus diversity relate to each of the near- and long-term learning and democracy outcome measures. My intention here is to investigate the effects of different types of interactional diversity over and above those that could be achieved solely through curricular efforts. This approach was based on previous research which revealed that campuses need actively to engage students in diversity contact when they have no previous experience. Students cannot simply learn about difference in theoretical abstraction; they must engage with each other on diverse campuses to realize the full potential educational benefits. The Michigan Student Study The Michigan student data come from the Michigan Student Study, an intensive investigation of the undergraduate class of 1994. The study was developed and carried out by the Office of Minority Affairs (now the Office of Academic and Multicultural Initiatives) in collaboration with faculty and students from the Center for the Study of Higher Education and the Department of Psychology. The purpose of the study was to increase understanding of the impact of racial/ethnic diversity at the University of Michigan on all groups of Michigan undergraduates. In addition to the insights that the study has provided the university community, the data from this study have been the source of articles in academic journals, papers at national conferences, and seven doctoral dissertations. The specific data base used for this Report comes from the major component of the Michigan Student Study, the longitudinal series of surveys of the undergraduate class of 1994. All students received a survey at point of entrance to the University in September of 1990. All students of color, and a large representative sample of white students were followed up in surveys at the end of their first year, second year, and senior year of college. The data analyses presented in my statement are based on the responses of 187 African American and 1134 white students. The data on Latino students were not analyzed because their numbers at Michigan are not large enough to permit reliable results from the multivariate analyses we have undertaken. I examined ten outcome measures in the analysis of the Michigan Student Study data. They are divided into the same two main categories as in the CIRP analyses (learning outcomes and democracy outcomes measured four years after college entrance). Most of the specific measures differ from those of the CIRP study. These measures are described in the section on Measures below, as are the student background characteristics and measures of students' campus experiences with diversity that are used in my analyses. My data analysis strategy is similar to the one presented for the analysis of the CIRP data. The MSS analyses differ in two general ways. First, the CIRP analyses are based on single-item measures of student characteristics, as one of the strengths of the CIRP is that it asks students to provide a wide variety of information of themselves, and as a result does not ask very many questions with overlapping content. In contrast, one of the strengths of the MSS data is that it was designed to collect more in depth data on fewer topics. As a result, in a number of instances I drew upon this strength by combining responses to related questions to create indices of various constructs. These indices reduce measurement error inherent in any individual question, which helps improve the quality of any analysis based on them. Second, the MSS data base does not contain information from students nine years after college entry, so our analysis is focused solely on near-term learning and democracy outcomes which were measured four years after college entry. With these exceptions, the MSS and CIRP analyses are designed to be as parallel as possible. Separate regressions were run for each of our 10 dependent variables (4 learning outcomes and 6 democracy outcomes). The predictor variables in each of these regressions included the same set of statistical control variables (i.e., student background characteristics), the entrance level measure of the outcome (when the same question was asked in the senior and entrance survey), and the same measure of classroom diversity. This measure of classroom diversity is an index combining the exposure of students to diversity content in their classrooms and their perceptions of how much impact some course had on their views on diversity. The other predictors in the regressions vary in that each regression introduces a different measure of interactional diversity (for example, number of best friends of a different race or ethnicity, quality of interaction with diverse others, number of multiethnic campus events attended). As with the CIRP analyses, the intent was to investigate the effect of each interactional diversity measure on each learning and democracy outcome, over and beyond the effect that could have been achieved just from classroom diversity The IRGCC Study An evaluation study followed for four years the undergraduate entrants to the University in 1990 who as first-year students took an introductory course in the Intergroup Relations, Community, and Conflict Program. This course covered the history of group experiences in the United States, a contemporary analysis of group inequalities in the economic, educational, and political arenas, and an analysis of political issues and policies (such as immigration, bilingual education, affirmative action, sexual harassment, Middle East peace initiatives) that are contested by various groups in contemporary United States. The course also covered theories of conflict and conflict management. All students in the course attended lectures, participated in discussion groups, wrote papers and exams, and took part in a ten-week dialogue group. The explicit goals of the dialogues within the context of this course were to: (1) help students discern and understand differences and similarities between the groups' viewpoints on contested issues, (2) examine differences in viewpoint within each of the two groups in the dialogue, (3) help students identify and negotiate conflicts that arise in the dialogue, and 4) challenge the groups to find a basis for coalition and joint action on a specific issue. The IRGCC Program also offers advanced courses in intergroup relations and training courses in facilitating intergroup dialogues, which some first-year students in he evaluation study subsequently took. Of these various goals, IRGCC's emphasis on intergroup understanding deserves special note. Yeakley (1998) points out that most intergroup contact studies have stressed the impact of contact on liking people from other groups, developing positive evaluations of outgroup members, and decreasing stereotyping among groups. The IRGCC Program does not minimize the importance of these outcomes, but it puts priority on helping students understand the perspectives of other groups. When a dialogue is completed, students from different groups may or may not like each other; they may still disagree with each other. But when a dialogue is successful, however, students understand why others feel and think differently about a specific issue. One student put it this way: "At first, it was like 'you're either with me or you're not.' And, you know, half way through, it was like 'oh, you're a person and I can see from what you've said exactly how you got to feel this way. I still disagree with it and . . . that's okay. What's important is that I can see where the other person is coming from" (Yeakley, p. 115). The IRGCC Program participants were measured as part of the longitudinal Michigan Student Study at the time they entered the University of Michigan. These baseline measures were taken before they enrolled in the first-year course. They were measured again at the end of the course, and again four years later at time of graduation. The evaluation was designed to give a picture of program effect. An equal number of first-year students who did not take the course were measured with the same questionnaires at the same times (at entrance, at the time the participants completed the IRGCC course, and at time of graduation) that the participants were measured. The non-participant group of comparison students were chosen to match the participants as to in-state and out-of-state pre-college residency, first-year residence hall at Michigan, ethnicity/race, and gender. Selection was done randomly within these categories from students who had completed entrance questionnaires in the Michigan Student Study. This study provides a unique opportunity to evaluate the long-term impact of a particular diversity experience that was offered to students at the crucial stage of the first year in college -- a time when discontinuity from the home background and uncertainty about the expectations of the University of Michigan are likely to be maximally influential in the lives of students. It is a period that, following Ruble (1994), I have conceived of as a time of "construction" -- a period before students accommodate to Michigan's diversity and complexity, some retreating to familiarity in peer groups that replicate the home background, and others participating in multiple and diverse peer groups on the campus. I hypothesized that the IRGCC Program would foster both learning and democracy outcomes. To test this hypothesis, the senior questionnaires were constructed to assess complex thinking, perspective taking, appreciation of socio-historical causation, acceptance of conflict as a normal aspect of social life, mutuality of interest and engagement in one's own and other groups, interest in politics, and citizen participation on the campus. As indicated in Tables I1 and I2, the analyses indicate that all of these outcomes were greater for students who participated in the IRGCC Program than for those who did not. Of course, a program as visibly focused on groups as the IRGCC Program might be expected to attract students who as first-year students already had higher scores on these cognitive measures before taking the course. Thus, it is important to check if the senior year differences persisted when initial scores (made available by the Michigan Student Study) were statistically controlled. Our analyses indicated that these differences were still statistically reliable, and that participation in the IRGCC Program had a genuine effect on complex thinking, perspective taking, and socio-historical thinking. One of the democracy outcomes, the mutuality of interest and activity in one's own and other groups, might be particularly noted. The IRGCC study asked students a series of questions about their involvement in their own groups, along with parallel questions about their involvement with other groups. Responses would permit assessment of the extent to which the IRGCC Program had encouraged greater involvement in both, and thus had fostered a mutuality that is important in democracy. One of the charges against diversity and multicultural programs is that they heighten difference, keep people divided from each other, and destroy the unity on which democracy depends. This program asks students to consider multiple perspectives - the perspectives of their own group and the perspectives of other groups. They are challenged to discern the similarities between groups and the differences within groups, as well as the sometimes more obvious differences between groups. They have to find some plan of potential common action, although in the time limits of the semester they do not actually carry out the activity. In these ways, they are encouraged to develop a sense of mutuality and reciprocality. MEASURESCIRP Analysis Measures Student background characteristics
Campus experiences
Institutional characteristics
Four year learning outcomes
Nine year learning outcomes
Four year democracy outcomes
Nine year democracy outcomes
Michigan Student Study MeasuresStudent background characteristics
Campus experiences
Learning outcomes
Democracy outcomes
Intergroup Relations, Community, Conflict Program MeasuresStudent background characteristics
Campus experience
Learning outcomes
Democracy outcomes
*These outcome questions were also asked in the entrance questionnaire. In the analyses of these outcomes, the responses to the entrance questions were statistically controlled, in order to take account of possible selection bias. Next "Gurin" Section | "Gurin" Table of Contents | "Compelling Need" Table of Contents |