About the position
Coach Across America is seeking proposals for an external evaluation of its sports-based youth development program. This program utilizes trained sports coaches as role models to teach skills that promote physical activity and positive decision-making among youth in economically vulnerable communities. The evidence-based model, Sports-Based Youth Development (SBYD), combines sports coaching and mentoring with positive youth development methodology. The program focuses on engaging community-based organizations, recruiting local adults as AmeriCorps Coach-Mentors (ACM), training them in SBYD, and conducting SBYD activities. The goal is to expand recreational opportunities, foster non-cognitive skills, and empower ACMs with social capital to benefit their communities.
Responsibilities
• Conduct a mixed-methods study to assess program effectiveness and implementation.
• Examine the effects of program participation on youth outcomes, including social and emotional learning.
• Assess coaches' perceived impacts of the program and the quality of their relationships with youth.
• Document program determinants, including barriers and facilitators to implementation.
• Assess core implementation outcomes such as feasibility, fidelity, appropriateness, and adoption.
• Collaborate with the Coach Across America Research, Monitoring, and Evaluation (RM&E) team to refine study questions.
• Analyze and report on all quantitative and qualitative data in collaboration with the RM&E team.
• Ensure all primary data collected facilitates disaggregation by gender, race/ethnicity, and age.
• Develop a research protocol and data collection tools, including a literature review, study objectives, methodology, data analysis plan, ethical considerations, and consent procedures.
• Provide remote training to the RM&E team and other data collection support staff.
• Support data collection through regular calls with the RM&E team.
• Produce a Final Study Report including an executive summary, background, scope, methodology, findings, limitations, conclusions, recommendations, and appendices with raw data and analysis outputs.
• Create a 2-page Impact Brief summarizing the project, objectives, methodology, key findings, and recommendations.
• Incorporate feedback from Coach Across America into the final report.
• Deliver a final presentation on the study report to Coach Across America leadership and key staff.
Requirements
• Experience in designing and conducting evaluations using a mixed-methods design.
• Experience conducting studies and program evaluations in the field of sport-based youth development and/or mentoring.
• Experience leading studies and program evaluations using community-engaged and participatory approaches.
• Experience leading multi-site and multi-partner studies and/or evaluations.
• Strong written and verbal skills in communicating technical or complex findings to non-specialist audiences.
• A track record of open, collaborative working with clients.
• The ability to prepare, submit, and receive approval from an Institutional Review Board.
• A strong track record of working flexibly to accommodate changes as the project is implemented.
• Ability to provide proposals including personnel allocation (roles/number of days/daily rates), and any other applicable costs.
• Clear indication of background experience and knowledge of the subject area.
• Demonstrated how they meet the required skills and experience.
• Demonstrated availability.
• Submission of a Letter of interest/cover letter.
• Submission of a Technical Proposal Summary (3 pages Max.) including: Overview of relevant experience, proposed methodological approaches (measures, sample size for qualitative data collection, analysis strategy, timeframe).
• CV for each evaluator.
• Example of a previous evaluation report with a similar scope of work.
• Cost estimate.
• Submissions returned as a signed form or on official letterhead.
Nice-to-haves
• Experience with AmeriCorps grant cycles.
• Familiarity with Sports-Based Youth Development (SBYD) methodology.
Apply tot his job
Apply To this Job