This is a proposal to conduct the national evaluation of the COSEE Network. In this proposal we lay out an approach for designing and conducting the evaluation. This approach centers around collaborative design, creating a community of evaluators within the COSEE network, and taking a broad perspective on the ways in which the investment in COSEE is making contributions to the field. The major evaluation tasks we propose include an annual survey of Centers, the creation of an evaluator community, and direct data gathering from Centers in the form of interviews and site visits.
We see COSEE as an investment in a national infrastructure for Ocean Sciences education: a network of Centers and associated partners that can not only provide educational services but also build the capacity of the field for doing higher quality and more extended Ocean Sciences education. We believe that the evaluation of COSEE should focus on both the direct educational contributions that COSEE is making, but also on the more intangible contributions in terms of generating leadership, collaborations, knowledge and advocacy for the field. We also argue that the evaluation should help COSEE better understand itself, improving its design, informing its management, and refining its implementation.
The COSEE Network represents a sophisticated arrangement that creates a national network linking together distinct Ocean Sciences Education Centers. The evaluation plan proposed here draws upon and adds to a knowledge base of the design principles underlying networks, centers, and science education improvement. The evaluation will not only document the contributions of the network to public and professional audiences, but also study the network as an example of an improvement infrastructure for Ocean Sciences education. This conceptualization will help to create an evaluative framework that will allow for a richer understanding of the multiple dimensions of NSF's investments in large complex network projects. The evaluation will thus contribute to the knowledge base that informs the design and evaluation of large-scale, field-building initiatives.
This proposed evaluation plan will promote the improvement of education, particularly science education, in multiple ways. First, it will help COSEE understand the investment made in the Network by studying the ways in which and the extent to which the network is serving its intended audiences and providing well-designed opportunities for a variety of audiences to learn Ocean Science. Second, the evaluation will help the COSEE Network better manage the use of its resources, by understanding the needs and opportunities for refining the way in which the Network operates. Third, the evaluation will contribute to a better understanding of ways in which the Network builds both individual and collective capacity for doing high-quality Ocean Sciences education. And finally the evaluation will contribute to a better understanding of how this design -- a network of independent centers -- can be used in other arenas to further develop a national improvement infrastructure for science education.
Centers for Ocean Science Education Excellence (COSEE) National Network Evaluation From the proposal summary: This is a proposal to conduct the national evaluation of the COSEE Network.... Our motivation is to further enable the COSEE Network to document and portray the work that it is doing, and to empower the Network to make the case that COSEE is making a significant contribution to Ocean Sciences education.... Our approach centers around collaborative design, creating a community of evaluators within the COSEE Network, and taking a broad perspective on the ways in which the investment in COSEE is making contributions to the field. Inverness Research conducted the national network evaluation of the Centers for Ocean Science Education Excellence (COSEE). Our work ended in May 2011. We generated the following outcomes and products: • 2009 COSEE Cornerstone Claims Survey: survey instrument, data compilation document presented to COSEE Council, December 1, 2009 Claims Document • "Initial COSEE Center Study" working paper (2009) • COSEE Theory of Action Diagram and Description • 2009 Cross-Center Broadening Participation Survey: survey instrument, data charts and compilation document and "Current Status of COSEE Centers’ Efforts to Broaden Participation" summary of results presented to COSEE Council and to Diversity Working Group; drafted section of Decadal Review document summarizing survey results • 2009 PowerPoint presentation at 2009 Ocean Sciences Meeting COSEE Evaluators’ panel presentation: "Evaluating the Returns on the NSF Investment in the COSEE Network". • 2009 Cross-Center Educators Survey: raw data (with all references to particular centers removed), data compilation in Excel workbook and summary • 2009 and 2010 Cross-Center Scientist Surveys: survey instruments, raw data (with all references to particular centers removed), data compilation in Excel workbook, survey summary (for 2009) • 2009-2010 COSEE Evidence Bank Wiki: created and hosted wiki for purpose of gathering evidence for Cornerstone Claims; all entries submitted by Centers and working groups also available in PDF format • DRAFT of the National Network Evaluation Framework and Final Report For information about or access to any of these materials, please contact COSEE.
