Everyone working at the university level is expected to evaluate the impact of their programs. The knowledge and practice of evaluation is assumed to be among the skill sets of staff, including early career staff, without the provision of professional development or analysis support. This is not the case. In 2024, Rutgers conducted statewide and national surveys of Master Gardener programs. Of staff and faculty responding to Rutgers national survey, 73% said that they either did not have the time or the knowledge of evaluation processes to successfully evaluate their programs.
This workshop will explore the process and outcome of this research followed by a hands-on activity illustrating the pitfalls of survey creation and how to avoid them. This opportunity to learn about survey data collection and analysis while using data that is current and relative to the Master Gardener program is invaluable. The participants of this workshop will experience designing research surveys, evaluating data and using sound research processes while exploring data collected via the Rutgers study from over 2,000 participants ranging from volunteers to national stakeholders. Unexpected vs. invalid outcomes will be included. The data presented as examples is as important as the learning process. For example, 97% of staff respondents, regardless of organization, did not see the Master Gardener volunteers as “masters of horticulture”. Participants will attempt to determine if this is an indication of survey bias or process issues or is the data valid, revealing training deficiencies, performance issues, or bias toward volunteers as non-professionals. Participants will leave with a better understanding of how to evaluate their Master Gardener programs and with foundation data on which to build future analysis.
Moderator: Ruth Carll, State Leader, Consumer Horitculture, Rutgers
Speakers:
- Ruth Carll, State Leader, Consumer Horticulture, Rutgers
- Belinda Chester, Senior Program Coordinator, Rutgers
Overview Goal:
The goal of this workshop is to bring together professionals who manage Master Gardener programs and, through guided discussion, identify methods for implementing surveys that deliver valid data by examining a current survey project’s development process and outcomes.
Format:
- Pre-test
- Group introduction and orientation to the topic
- Small group activities with real-time reporting
- Post-discussion assessment
- Partnership creation
- Wrap-up and distribution of notes
