Evaluation of Innovative Programs
Local IGERT Assessments:
CIRGE works with the National Science Foundation’s Integrative Graduate Education and Research Traineeship (IGERT) programs at the University of Washington to chart the innovations of this important attempt to bring change to doctoral education. In order to evaluate the learning process of these innovative doctoral programs, CIRGE developed an evaluation plan, conducted web surveys, focus groups, interviews and prepared reports on our findings as well as on the sustainability and best practices of IGERTs. CIRGE facilitated a collaboration between the UW Urban Ecology IGERT and a similar innovative program in Germany. Working with the IGERTs has offered CIRGE a unique opportunity to study innovations in doctoral programs and to develop our expertise in evaluation and assessment of these important programs.
Nerad, M., G. Bradley, M. Alberti, C. Ryan, C. ZumBrunner, E. Shulenberger. 2003. “Creating and Sustaining a Culture of Interdisciplinarity: Novel approaches to graduate education in the environmental sciences.” Unpublished article on the new IGERT programs. Download: Creating and Sustaining Interdisciplinarity
The US National Science Foundation initiated the Integrative Graduate Education and Research Traineeship (IGERT) programs in 1997 in order to meet the challenges of educating PhD students with the interdisciplinary backgrounds, deep knowledge in chosen disciplines, and technical, professional, and personal skills to become leaders and creative agents for change. These programs are intended to contribute to the development of a diverse, interdisciplinary, globally-engaged science and engineering workforce.
Working with the IGERTs at the University of Washington has offered CIRGE a unique opportunity to study innovations in doctoral programs and to develop its expertise in evaluation and assessment of these important programs.
Urban Ecology IGERT
The mission of the Urban Ecology IGERT was “to improve Earth’s condition by engaging policy makers, scientists, students and citizens in the generation, teaching and use of knowledge about the interactions between humans and ecological processes in urbanizing environments.” In December 2004 CIRGE presented the results of three years formative and summative evaluative work to the Urban Ecology IGERT faculty, students, departmental chairs, and campus administration. The report, Urban Ecology Mid-term Evaluation and the University of Washington, presented findings and recommendations for a number of significant program changes for the remaining years of this IGERT. As part of the evaluation activities, CIRGE innovative consultant conducted a series of workshops for faculty and students on program and time management, on teamwork and team teaching, and on conflict resolution.
Download Report: Innovation in PhD Training
International Collaboration
CIRGE facilitated the collaboration of the Urban Ecology IGERT with another urban ecology doctoral program in Berlin, Germany. We added another pair of doctoral programs (Boston University Bioinformatics IGERT and Humboldt University, Berlin, Germany Systems Biology Graduiertenkolleg) to the evaluation research project to provide a broader base for the generalization of findings.
CIRGE undertaken two important research activities with these innovative doctoral programs:
- CIRGE supported implementing and maintaining collaboration included conducting workshops to prepare the visits abroad of faculty and students; facilitating feedback sessions with students and faculty from both programs at the end of joint international workshops; and facilitating ongoing feedback for faculty regarding the collaborative process to improve communication, information, and organizational planning.
- CIRGE conducted formative evaluation focusing on the ongoing activities of the project. We analyzed similarities and differences between the programs, the institutional structures and conditions that support or hinder international cooperation, and we assessed the progress in personal relations and communication processes. During the last year we focused on the (a) process of collaboration, (b) individual expectations, and (c) institutional goals and limitations.
Download Report: Evaluative Framework
Astrobiology IGERT
Astrobiology studies the origin of life on Earth and the distribution of life in the Universe. The cross-disciplinary nature of this field mandates collaboration among biologists, astronomers, oceanographers, atmospheric scientists, chemists, planetary scientists, and geologists. As part of our multi-year evaluation of the Astrobiology IGERT, CIRGE administered two web-based surveys to students in the program. The results are intended to provide anonymous student feedback to the program faculty and to increase understandings of interdisciplinary graduate programs and student experiences of those programs. Additionally, two focus groups were held with Astrobiology graduate students in order to gain more specific feedback on the program. The findings from these activities were summarized and presented to the Astrobiology department in summer of 2007. Another survey of students and interviews of faculty and chairs was reported on in 2009.
Best Practices for IGERT Sustainability
As sustainability of IGERT programs after the NSF funds run out seems to be a common challenge facing IGERT PIs, CIRGE explored ways to meet this challenge by surveying attendees at the 2006 NSF IGERT meeting. Several also participated in phone interviews. These attendees represented the top research universities in the nation. The report on our findings was distributed to all meeting attendees in the summer of 2007.
Download Report: Best Practices for IGERT Sustainability