Ohio State University Fact Sheet

Evaluating the Collaboration Process

CDFS-7

Evaluating and monitoring collaborative efforts are essential tasks if we are to be successful in coordinating programs for young people. Evaluation efforts become more manageable when approached from two different levels. These include: 1) evaluation of the collaboration process and 2) measuring the impact of programs for targeted audiences. This fact sheet focuses on evaluating the collaboration process.

An evaluation of the collaborative process can be pursued by studying several different potential outcomes.

Potential Areas of Evaluation

Quality

• Training-What has the group done in training other youth professionals coalition members or youth?
• Continuity-How long has the group been together? Is there still a desire to work together? What type of structure has been developed to assure the continuity of the collaboration such as, officers, membership guidelines, memoranda of understanding?
• Involvement-How active are the group's members? How often do they meet? How much volunteer and professional time is being focused on a particular problem because of the collaboration?

Comprehensiveness

• What types of individuals and organizations are represented? Are these the right type of individuals to accomplish the work of the collaboration?
• Has there been an increase in the number of referrals between collaboration members? What has been the nature of these referrals?
• What types of data bases or directories have been created to facilitate the sharing of information and assistance related to youth issues?

Access and Equity

• Do all youth in the community have equal access to collaboration efforts? Has access to services been enhanced by collaboration efforts?
• How do other non-collaborators obtain access to the information and services of the collaboration members?

Information and Advocacy

• How has information increased to parents, public, policy makers and youth?
• To what extent do member organizations promote each others' efforts, workshops and conferences?
• How is the group serving as an advocate for youth issues in the community?

Cost-effectiveness

• Have existing funds been used more effectively? How?
• Has duplication of services been reduced or eliminated?
• How has the group been able to access new funds because of working together?

Additional General Questions

• What are you doing that is really working well?
• What are the major problems you are facing?
• Are there unanticipated outcomes because of working together?

To explore the questions in the proposed areas of evaluation, many methodologies can be used. Some most common include:

• Surveys/Questionnaires
• Interviews
• Structured Observation
• Review of Records and Reports
• Focus Group Interviews
• Interaction Analysis

References

Brinkerhoff, R. O., D. M. Brethower, T. Hluchyj and J. R. Nowakowski. Program Evaluation: A Practitioners Guide for Trainers and Educators. Boston: Kluwer-Nijhoff Publishing, 1985.

Kagan, S. L., A. M. Rivera and F. L. Parker. Collaborations in Action: Reshaping Services to Young Children and Their Families. Yale University, The Bush Center in Child Development and Social Policy, 1991.