SMART Girls Outcome Evaluation: SMART Girls is a small-group health, fitness, prevention and education and self-esteem enhancement program designed to meet the developmental needs of girls in three age groups from ages 8-18. The SMART Girls program was created by Boys & Girls Clubs of America in partnership with the Kimberly Clark Foundation. With additional support from the Kimberly Clark Foundation, BGCA will conduct an outcome evaluation to assess the overall impact of the program on participants.
BGCA is committed to engaging in a high- quality program evaluation to explore the degree to which the program has a positive impact on participants. To this end, BGCA seeks an experienced evaluator to conduct an outcome evaluation of the revised SMART Girls curriculum with a focus on the how well the program reaches the desired outcomes.
This evaluation seeks to: • Analyze the relevancy of the SMART Girls program as it relates to the current health, social and life challenges girls are facing. • Analyze the impact of the program on the social and emotional development of girls using existing Boys & Girls Clubs of America’s measures. • Explore the impact of the curriculum’s content on member’s short- term, intermediate and long term outcomes including knowledge, skills and attitudes gained. • Determine best practices in implementing the program in a Boys & Girls Club to achieve intended outcomes. • Position the SMART Girls program to be certified as an evidence-based curricula • Identify the components of the SMART Girls program that can be replicated in other areas of the Club as a part of the overall Club Model.
Project Scope and Timelines
The scope of this evaluation is from April 2018 through October 2019 which includes all aspects of implementing an outcomes evaluation. Contractor’s responsibilities and duties will include, but are not limited to:
1. Conducting a systematic literature review detailing the current health, social and life challenges girls are facing to determine relevancy of the SMART Girls program. 2. Designing an overall evaluation plan, data collection tools and instruments, quality assurance assessments, sample size and the criteria for Club selection. 3. Collecting data from Club sites 4. Synthesizing and analyzing data to identify and assess the impact of SMART Girls 5. Preparing an interim evaluation report on preliminary baseline evaluation findings. 6. Preparing a final evaluation report analyzing the impact of the SMART Girls program, identifying gaps and recommendations for best practices for program implementation.
Evaluation Activities In this project, the following deliverables will be required from the contractor:
1. Evaluation Design a. Evaluation timeline b. Systematic literature review to evaluate SMART Girls program relevancy c. Data collection plan d. Joint development of instruments and measures e. Club selection criteria and sample size 2. Program Implementation & Evaluation a. Work with a select group of Clubs to evaluate the program’s impact on intended outcomes. a. Investigate best practices in implementation of the program, including identifying alternative delivery procedures. b. Schedule monthly meetings with BGCA to determine project progress and data collection updates
3. Interim Report a. Provide an Interim Report that may be shared with stakeholders including BGCA staff, Club staff and corporate partners. b. The Interim Report may include: • Current progress of evaluation • Preliminary findings from baseline data • Observations critical to the success and safety of SMART Girls participants with results used to make necessary changes to design and implementation
4. Final Evaluation Report a. Provide an executive summary that will appeal to a variety of stakeholders (e.g. Club staff, Board Members, Funders) b. Provide Report with an emphasis on context-specific findings • Summary of survey findings • Member outcomes • Observational Findings • Process evaluation findings including fidelity and quality assurance measures c. Make Recommendations based on findings. Recommendations include: • Recommendations on program dosage and fidelity guidelines based on Club type including traditional Clubs, schools, military installations and Native Lands. • Recommendations on adapting the program to fit the cultural needs of the unique communities served. • Recommendations of program improvements based on potential gaps discovered in reference to achieving intended outcomes. • Recommendations of best practices to achieve intended program outcomes • Recommendations of key program elements that should be replicated across all areas of the Club.
Documentation should be provided in electronic (Microsoft Office) format. Graphic files should be provided in Adobe- compatible formats. Electronic materials should be emailed, or a link provided for download.
Evaluation Budget: The total budget is $300,000.00 inclusive for any travel or expenses incurred by the contractor.
Evaluation proposals are due on April 20, 2018 by 11:59pm EST.