Planning a program evaluation worksheet

WORKSHEET 6.1A: Evaluation Planning Questionnaire

Use the filled-out Worksheet 6.1B in the book as an example to follow as you complete this questionnaire.

1. What questions will your organization’s evaluation activities seek to answer?

The following questions will be the main focus in performing the evaluation of the Children’s Care Academy of Pinellas complimentary nutritious food program:

· Is the complimentary food program helping to decrease hunger among the children?

· Are the complimentary snacks and meals provided to the children helping to provide parents and caregivers with increased quality family time at home?

· Is the complimentary food program aiding in the healing process for parents and caregivers receiving treatment at the adjacent cancer center?

· Is the current menu efficiently providing the proper foods within the set budget?

2. What are the specific evaluation plans and time frames?

The complimentary food program will be evaluated for its effectiveness six months after its inception, with quarterly assessments thereafter. This is will include assessing the food budget and meal planning process. The new healthy snack program will be evaluated within two weeks of initiation. Parents and caregivers will be interviewed on a montly basis with the cancer center surveys held on a quarterly basis. The food budget will be analyzed monthly to start then quarterly thereafter.

· Observe children during meal and snack times to see if they are enjoying the new healthier snack choices and menu items.

· Conduct one-on-one interviews with the parents and caregivers to see if the newly initiated food program is contributing to reducing hunger among children lending to increased quality family time together.

· Survey the adjacent cancer center regarding healing processes among the parents and caregivers.

· Analyze the effectiveness of the menu and food budget. This

is to ensure the academy is able to purchase heart-healthy foods the children will enjoy within the allotted food budget.

a. What kinds of data will be collected?

The following data will be collected during the process of evaluating the complimentary food program:

· The percentage of children taking advantage of the complimentary meal program aiming to reduce hunger

· The precentage of children that are enjoying the healthy snacks and food choices offered

· The percentage of parents or caregivers who are experiencing increased quality family time together

· The percentage of parents and caregivers showing increased healing

· What changes in the budget and menu, if any, need to be made

b. At what points?

The evaluation process will begin within 2 weeks of healthy snack implementation and six months after the food progam is implemented with quarterly assessements to monitor effectiveness. Parents and caregivers will be interviewed montly to ensure needs are being met. The cancer center surveys will be conducted on a quarterly basis to ensure all families, current and future, are included in the evaluation process. The budget will be analyzed quarterly after the first six months of monthly analyzing.

c. Using what strategies or instruments?

· Staff and volunteers will actively observe and interact with the children during snack and meal times to assess their likes and dislikes of food provided.

· The academy will conduct one-on-one personal interviews with the parents and caregivers of the academy to assess the effectiveness of the food program in regard to hunger reduction among the children and increased quality family time at home.

· The owner of academy will speak with phyicians at the adjacent cancer center to determine if the complimentary food program is in fact helping to reduce stress among the parents and caregivers receiving treatment helping to aid in the healing process.

· The owner will work closely with the chef and dietician regarding the assessment of the overall menu and budgeting process.

d. Using what comparison group or baseline, if any?

There will not be any comparison group or baseline studies due the the unique concept of this program being the first of its kind.

WORKSHEET 6.1A: Evaluation Planning Questionnaire (Continued)

3. If you intend to study a sample of participants, how will this sample be constructed?

Due to the governmental HIPAA regulations, the evaluation of the parents and caregivers regarding the healing processes through the cancer center, will be conducted in a generalized fashion as to adhere to the HIPAA patient confidentiality healthcare laws. The physicians will be asked to complete a simple survey regarding parents and caregivers who utilize the academy’s complimentary childcare services and food program and how it may affect the healing processes without disclosing any personal information.

4. What procedures will you use to determine whether the program was implemented as planned?

The academy will employ observation, interviews, surveys and analyzing procedures to help determine if the complimentary nutritious food program was implemented as planned.

5. Who will conduct the evaluation?

The evaluation of the complimentary nutritious food program will be conducted by the owner of the academy with the assistance of the staff; certified chef, registered dietician and part-time employees serving children during meal times.

6. Who will receive the results?

The results of the evaluation will be shared with the board of directors representing the academy. Once the evaluation has been shared with the board of directors, the academy will then share the results with the staff and families being served at the academy. Evaluation outcomes will be submitted the grantor, Allegany Franciscan Ministries, upon approval.

7. How are you defining success for this program or project?

The success of the complimentary nutritious food program will be defined through the positive outcomes experienced by the academy. Positive outcomes will be a reduction in hunger among children and helping families spend more quality time together. This will aid in the healing process of parents and caregivers undergoing cancer treatment all within the confines of the allotted budget. Spurring growth within the surrounding community and beyond due to the fruits of the outreach program will further establish program success.