We use cookies to distinguish you from other users and to provide you with a better experience on our websites. Close this message to accept cookies or find out how to manage your cookie settings.
To save content items to your account,
please confirm that you agree to abide by our usage policies.
If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account.
Find out more about saving content to .
To save content items to your Kindle, first ensure no-reply@cambridge.org
is added to your Approved Personal Document E-mail List under your Personal Document Settings
on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part
of your Kindle email address below.
Find out more about saving to your Kindle.
Note you can select to save to either the @free.kindle.com or @kindle.com variations.
‘@free.kindle.com’ emails are free but can only be saved to your device when it is connected to wi-fi.
‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.
This study evaluates the maintenance of a clinically meaningful weight loss (≥ 5 %) after 12 and 36 months of participation in an intervention to promote fruit and vegetable (FV) consumption. A randomised controlled trial was conducted in a primary health care service. For 7 months, participants in the control group (CG) and in the intervention group (IG) performed guided physical exercise three times/week; the IG also participated in collective activities to promote FV consumption. This study selected participants (n 267) who showed clinically meaningful weight loss after nutritional intervention. Sociodemographic, health and body weight data were collected in a face-to-face interview at baseline (T0) and after intervention (T1). Participants were reassessed after 12 (T2) and 36 months (T3) by telephone interview, and the self-reported weight was corrected. The outcome measures weight changes at three time points: M1, comparing T2 with T1; M2, comparing T3 with T2; and M3, comparing T3 with T1. The generalised estimating equation, adjusted for individual characteristics, was used. Participants in the CG showed an increase of 4·2 kg (P < 0·001) at M1 and 4·6 kg (P < 0·001) at M3, while IG individuals showed an increase of 3·6 kg (P < 0·001) at M1 and 3·8 kg (P < 0·001) at M3. The between-group analyses show the effect of nutritional intervention on the maintenance of weight loss at M2 (P = 0·033). Although CG and IG participants increased in weight, the nutritional intervention was associated with maintenance over the long term. This reveals the importance of the promotion of FV consumption for body weight maintenance.
Scholarly activity is a key component of most residency programmes. To establish fundamental research skills and fill gaps within training curricula, we developed an online, asynchronous set of modules called Research 101 to introduce trainees to various topics that are germane to the conduct of research and evaluated its effectiveness in resident research education. Research 101 was utilised by residents at One Brooklyn Health in Brooklyn, NY. Resident knowledge, confidence, and satisfaction were assessed using pre- and post-module surveys with 5-point Likert scaled questions, open-ended text responses, and a multiple-choice quiz. Pre-module survey results indicated that residents were most confident with the Aligning expectations, Introduction to research, and Study design and data analysis basics modules and least confident with the Submitting an Institutional Review Board protocol and Presenting your summer research modules. Post-module survey responses demonstrated increased learning compared to pre-module results for all modules and learning objectives (p < 0.0001). “This module met my needs” was endorsed 91.4% of the time. The median score for the final quiz that consisted of 25 multiple-choice questions was 23. Thematic analysis of open-ended post-module survey responses identified multiple strengths and opportunities for improvement in course content and instructional methods. These data demonstrate that residents benefit from completion of Research 101, as post-module survey scores were significantly higher than pre-module survey scores for all modules and questions, final quiz scores were high, and open-ended responses highlighted opportunities for additional resident learning.
Very few would dispute the proposition that evidence about the effects of different policy options should inform policy decisions. However, there is less agreement on the nature of the evidence needed. In addition, there may be problems in evaluating that evidence. This is particularly the case when experts offer conflicting advice. This article presents the position held by Professor Nevile that in giving policy advice to the government, it is almost always desirable to draw on a range of different policy instruments. While theoretical input is usually important, it is even more important that theory does not lose contact with the real world. Factual descriptions of the real world and the use of a theoretical toolkit containing more than one theory are essential in achieving this goal. These principles are illustrated by a discussion of a particular category of policy advice – the evaluation of government programmes.
The science-informed approach to clinical practice is founded upon ongoing quality improvement and involves key skills that allow clinical psychologists to confidently provide services in a competitive health care market. Thus, programme evaluation is a core clinical psychology competency but needs to be provided via a co-design framework. The chapter outlines how co-designed programme evaluation addresses patients’ needs in five steps: (i) asking the right questions, (ii) developing an evaluation plan, (iii) collecting and analysing data to produce usable findings, (iv) translating the findings into recommendations for action, and (v) advocating and promoting change. The chapter illustrates how empirically-based programme evaluation supports accountable clinical practice, both at the level of the individual patient and at the aggregate level of the service provider or agency.
To determine whether the ‘Read for Nutrition’ programme would increase liking and consumption of broccoli (a target vegetable) in preschool children and test acceptability and practicality of the programme.
Design:
Pilot pre-post intervention study, where childcare teachers received training and coaching followed by reading the book ‘Monsters Don’t Eat Broccoli’ multiple times with the children during a three-week intervention.
Setting:
Five classrooms of Educare, Lincoln, Nebraska in 2018.
Participants:
Sixty-nine (11 to 16 children per classroom) preschool-aged children and sixteen teachers (minimum, three per classroom).
Results:
Average total consumption of broccoli increased 35 % (0·14 ounces or 0·05th cup) after the ‘Read for Nutrition’ programme (t = 2·66; P = 0·01; 95 % CIs (0·035, 0·246)) for all children. Proportional consumption increased for children who received ≥ five exposures to the book (t46 = 2·77; P = 0·008). Exposures to the book predicted proportional consumption (β = 0·365; P = 0·002). Liking of broccoli increased (W69 = 2·2, P = 0·03) as well. Teachers rated the programme as acceptable, practical and enjoyable to children and to themselves.
Conclusions:
Programmes such as ‘Read for Nutrition’ have the potential to improve children’s vegetable liking and consumption in early care and education settings with only book readings and no exposure to a real vegetable.
This article reports on the early results of using behavioural and educational data to evaluate a residential education programme. The programme serves male and female students between 12 and 16 years of age who have been suspended or expelled from school due to behavioural issues or who refused to attend school. Using measures of behavioural and educational progress during care and reporting these changes over time provided empirical evidence that the programme was achieving its primary aims of ‘behaviour change and educational gains.’ Collecting and reporting this data has empowered the programme to increase programme effectiveness through both data-informed decision-making and ongoing programme evaluation.
To investigate (i) changes in stakeholder commitment and (ii) perceptions of the purpose, challenges and benefits of healthy food and beverage provision in community sports settings during the stepwise implementation of a healthy beverage policy.
Design:
Convergent, parallel, mixed-methods design complemented (i) repeat semi-structured interviews with council stakeholders (n 17 interviews, n 6 interviewees), with (ii) repeat quantitative stakeholder surveys measuring Commitment to Organisational Change; (iii) weekly sales data examining health behaviour and revenue effects (15 months pre-intervention; 14 months post-intervention); (iv) customer exit surveys (n 458); and (v) periodic photographic audits of beverage availability. Interviews were analysed inductively. Stakeholder surveys, sales data, customer surveys and audits were analysed descriptively.
Setting:
Four local government-owned sports and recreation centres in Melbourne, Australia, completed a 3-month trial to increase the availability of healthy beverages and decrease the availability of unhealthy beverages in food outlets.
Participants:
Interviews were conducted with council managers and those involved in implementation (September 2016–October 2017). Customers were surveyed (September–October 2017).
Results:
Interviews and surveys indicated that stakeholders’ commitment to policies varied such that, over time, optimism that changing beverage availability could increase the healthiness of customers’ purchases became more widespread among interviewees. Stakeholder focus generally progressed from anticipatory concern to solutions-focused discussions. Sales, audit and customer survey data supported interview findings.
Conclusions:
We found a general increase in optimism regarding policy outcomes over time during the implementation of a healthy beverage policy. Stepwise trials should be further explored as an engagement tool within community retail settings.
To evaluate the impact of a preschool-based nutrition education programme consisting of twelve ‘hands on’ nutrition education lessons delivered during the school year on young children’s willingness to consume fruits and vegetables.
Design:
Quasi-experimental, pre-post design including the collection of plate waste evaluation data at the start and end of the 2015–2016 school year within two groups: (1) randomly selected classrooms receiving the intervention and (2) within conveniently sampled preschool classrooms not receiving the intervention serving as a comparison group.
Setting:
Centre-based preschool programmes serving low-income families in the Denver metro area.
Participants:
Three- to five-year-old children in preschool classrooms participating in the intervention during the 2015–2016 school year (n 308) and children enrolled in comparison classrooms (n 215).
Results:
Repeated-measures logit models assessed whether increases in the odds of consuming small samples of fruits and vegetables between Time 1 (pre-intervention) and Time 2 (post-intervention) were different for children within the intervention group compared with the comparison group. Analyses showed that the change over time in consumption of the three vegetable samples varied by intervention status with greater change occurring among children within the intervention group (edamame: P = 0·001; cauliflower: P ≤ 0·0001 and red pepper: P ≤ 0·0001). Unlike vegetables, the change over time in consumption of the two fruit samples was not different between children within the intervention and comparison groups.
Conclusions:
An experiential-learning nutrition education programme can positively influence eating behaviours of low-income preschoolers in a centre-based setting by increasing willingness to consume vegetables.
The purpose of this study was to evaluate the quality of life of heroin dependent patients before and 1 year after the start of methadone maintenance treatment. Subjects were patients (n = 102) requesting treatment in a public methadone maintenance programme in Geneva (Switzerland). This was a prospective follow-up study using a validated questionnaire (SQLP). The SQLP was well accepted by patients and staff. Validity of the questionnaire was reconfirmed in this population. Compared to previously studied populations, the quality of life of heroin dependent patients before start of treatment was poor. More than half the patients were still in treatment after 1 year and their quality of life had clearly improved, in most domains. Like many of their peers in the psychiatric field, the patients had high initial expectations. Expectations decreased significantly over time. It was found that the higher were the initial expectations, the poorer was the quality of life after 1 year. The quality of life of heroin abusers requesting treatment is mediocre, and improved considerably after 1 year of comprehensive methadone maintenance treatment. Quality of life evaluation is feasible in this population and can offer an additional evaluation of quality of substance abuse treatment.
In this paper we explain some of the difficulties of providing forecasts of the financial benefits of early intervention programmes, focussing on those delivered during the early childhood period. We highlight the diversity of early intervention, and the complexity and multiplicity of outcomes. We summarise recent work at the Early Intervention Foundation to assess the evidence on the impacts of early intervention, recognising the diversity of approaches to delivery and the importance of innovation and local practice as well as of rigorous approaches to evaluating causal effects. We also describe new ways of assessing accurately the local fiscal costs of late intervention and consider the implications of this for addressing the well-established barriers to investment in prevention. Our analysis brings to the fore gaps in the evidence from which even the most rigorous ‘gold-standard’ research is not immune. These limitations prevent the production of an accurate and realistic cost-benefit ratio or net present value for the majority of programmes as delivered in practice. We suggest some paths towards a firmer foundation of evidence and a better alignment of evidence and policy.
To identify the features of a nutrition education programme for disadvantaged adults deemed most attractive and useful by participants.
Design
A two-year, multi-method, qualitative evaluation of pre and post data collected from programme participants. Data were imported into NVivo10 for coding to facilitate a thematic analysis.
Setting
Western Australia.
Participants
Individuals attending the Western Australian FOODcents nutrition education programme that is designed to provide knowledge and skills needed to consume a healthy diet on a budget. Focus groups were conducted several weeks after course completion (five groups, forty-seven participants), observations were conducted during FOODcents sessions (thirty-one observation episodes, 237 participants), and open-ended questions were asked in pre–post hard-copy surveys administered in sessions (n 927) and an online survey administered on average six weeks after course completion (n 114).
Results
The course attributes that were found to be especially important to participants were: (i) user-friendly, practical information that could be immediately translated to their daily lives; (ii) experiential learning that involved direct contact with food products; and (iii) opportunities for social interaction. These aspects of nutrition education were described as being highly influential in the decision to participate in the course, the application of the information in their subsequent food purchase and preparation activities, and their word-of-mouth communications with others about the course.
Conclusions
Incorporating aspects of most importance to participants into nutrition education programme delivery and promotion may increase joining rates, enjoyment, satisfaction with course content and, ultimately, the uptake of recommended behaviours.
The objective of this study was to assess the effectiveness of a catheter-related bloodstream infection (CR BSI) reduction programme and healthcare workers' compliance with recommendations. A 3-year surveillance programme of CR BSIs in all hospital settings was implemented. As part of the programme, there was a direct observation of insertion and maintenance of central venous catheters (CVCs) to determine performance. A total of 38 education courses were held over the study period and feedback reports with the results of surveillance and recommendations were delivered to healthcare workers every 6 months. A total of 6722 short-term CVCs were inserted in 4982 patients for 58 763 catheter-days. Improvements of compliance with hand hygiene was verified at the insertion (87·1–100%, P < 0·001) and maintenance (51·1–72·1%, P = 0·029) of CVCs; and the use of chlorhexidine for skin disinfection was implemented at insertion (35·7–65·4%, P < 0·001) and maintenance (33·3–45·9%, P < 0·197) of CVCs. There were 266 CR BSI incidents recorded with an annual incidence density of 5·75/1000 catheter-days in the first year, 4·38 in the second year [rate ratio (RR) 0·76, 95% confidence interval (CI) 0·57–1·01] and 3·46 in the third year (RR 0·60, 95% CI 0·44–0·81). The education programme clearly improved compliance with recommendations for CVC handling, and was effective in reducing the burden of CR BSIs.
To evaluate the effectiveness of an Interprofessional Education (IPE) programme in eating disorders for mental health practitioners using a case-based learning approach.
Methods
A total of 25 mental health clinicians were asked to evaluate their IPE programme as part of training for the National Clinical Programme in Eating Disorders. They completed a Readiness for Interprofessional Learning Scale (RIPLS), a learner reaction questionnaire after each session and a final open evaluation at 4 months. Non-parametric statistical analysis was employed to analyse learner attitudes and reactions, and qualitative information was coded.
Results
A total of 23 (92%) clinicians from five disciplines participated. Baseline attitudes towards IPE were positive on all RIPLS subscales, and those with prior IPE experience had most positive views as to its benefits for teamwork and patient care (p=0.036). Learner reactions on content, delivery, outcome and structure indicated that individual learning experience was strongly positively endorsed. Change in clinical practice behaviour was reported in terms of communication, clinical activity, outcome evaluation and confidence. Barriers included other demands on time, organisational support, not having enough patients or co-workers to practice skills, and knowledge differentials between learners.
Conclusions
IPE using a case based learning approach is an effective and acceptable means of developing specialist training across existing service, team and professional boundaries. It has potential for positive impact on knowledge, clinical behaviour and service delivery. Recommendations include the introduction of IPE group guidelines, wider circulation of learning points and content, and the use of self-competency ratings and reflective logs.
For more than 20 years, the FOODcents adult nutrition education programme has been delivered to Western Australians. The aim of the programme is to provide disadvantaged individuals with the knowledge, skills and motivation to buy healthy foods on a limited budget. The present study evaluated whether the FOODcents curriculum and the way it is delivered are effective in improving participants’ nutrition-related knowledge and behaviours.
Design
Evaluation data were collected via in-session pre–post questionnaires and a post-course online questionnaire.
Setting
Western Australia.
Subjects
Data were collected from participants attending just over one-half (54 %) of the FOODcents courses conducted over the two-year evaluation period. In total, 927 course participants provided usable data.
Results
After exposure to the course, respondents demonstrated an improved ability to: (i) categorize foods according to the frequency with which they should be consumed and the proportion of the food budget that should be allocated to them; (ii) correctly interpret nutrition labels on food products; and (iii) appreciate the link between diet/obesity and a range of diseases. Improvements in the latter were especially pronounced among participants of low socio-economic status. In terms of behaviour change, significant improvements in fruit and vegetable consumption were reported, along with reductions in the consumption of fast food. Participants of low socio-economic status reported the greatest changes.
Conclusions
The results indicate that the FOODcents nutrition education programme improves participants’ nutrition-related knowledge and behaviours.
To examine behavioural intention to reduce soda consumption after exposure to the Choose Health LA ‘Sugar Pack’ campaign in Los Angeles County, California, USA.
Design
A cross-sectional street-intercept survey was conducted to assess knowledge, attitudes, health behaviours and behavioural intentions after exposure to the ‘Sugar Pack’ campaign. A multivariable regression analysis was performed to examine the relationships between the amount of soda consumed and self-reported intention to reduce consumption of non-diet soda among adults who saw the campaign.
Setting
Three pre-selected Los Angeles County Metro bus shelters and/or rail stops with the highest number of ‘Sugar Pack’ campaign advertisement placements.
Subjects
Riders of the region’s Metro buses and railways who were the intended audience of the campaign advertisements.
Results
The overall survey response rate was 56 % (resulting n 1041). Almost 60 % of respondents were exposed to the advertisements (619/1041). The multivariable logistic regression analysis suggested that the odds of reporting intention to reduce soda consumption among moderate consumers (1–6 sodas/week) were 1·95 times greater than among heavy consumers (≥1 soda/d), after controlling for clustering and covariates. Respondents with less than a high-school education and who perceived sugary beverage consumption as harmful also had higher odds; in contrast, respondents aged ≥65 years had lower odds.
Conclusions
Results suggest that future campaigns should be tailored differently for moderate v. heavy consumers of soda. Similar tailoring strategies are likely needed for younger groups, for those with less educational attainment and for those who do not perceive consumption of soda as harmful.
To evaluate the impact of the Baby-Friendly Hospital Initiative (BFHI) on breast-feeding initiation and duration overall and according to maternal education.
Design
Quasi-experimental study using data from five states (Alaska, Maine, Nebraska, Ohio, Washington) that participated in the Pregnancy Risk Assessment Monitoring System from 1999 to 2009. Using differences-in-differences models that included year and hospital fixed effects, we compared rates of breast-feeding initiation and duration (any and exclusive breast-feeding for ≥4 weeks) before and after BFHI accreditation between mothers who gave birth in hospitals that were accredited or became accredited and mothers from matched non-BFHI facilities. We stratified analyses into lower and higher education groups.
Setting
Thirteen BFHI hospitals and nineteen matched non-BFHI facilities across five states in the USA.
Subjects
Mothers (n 11 723) who gave birth in BFHI hospitals and mothers (n 13 604) from nineteen matched non-BFHI facilities.
Results
Although we did not find overall differences in breast-feeding initiation between birth facilities that received BFHI accreditation compared with non-Baby-Friendly facilities (adjusted coefficient = 0·024; 95 % CI −0·00, 0·51), breast-feeding initiation increased by 3·8 percentage points among mothers with lower education who delivered in Baby-Friendly facilities (P = 0·05), but not among mothers with higher education (adjusted coefficient = 0·002; 95 % CI −0·04, 0·05). BFHI accreditation also increased exclusive breast-feeding for ≥4 weeks by 4·5 percentage points (P = 0·02) among mothers with lower education who delivered in BFHI facilities.
Conclusions
By increasing breast-feeding initiation and duration among mothers with lower education, the BFHI may reduce socio-economic disparities in breast-feeding.
Ecotourism has been promoted to reconcile seemingly conflicting goals of tourism development and nature conservation. Given its importance, how has ecotourism fared in the Annapurna Conservation Area (ACA) and how resilient was it to the Maoist insurgency in Nepal (1996–2006)? Drawing upon more than 10 months of field research, participant observation, semi-structured surveys and content analysis of 21 annual reports, ecotourism was evaluated by organizing ACA's programmes and activities under the four major emerging themes, namely local capacity building, waste management, education and infrastructure development; the most prominent theme was local capacity building. Annual visitor numbers declined during the insurgency, but ecotourism managed to survive, mainly due to self-organization of local tourism entrepreneurs. Local tourism entrepreneurs facilitated self-organization through capacity building and diversification of livelihoods. In the aftermath of the insurgency, visitor numbers rebounded and ecotourism continued to develop and evolve; ecotourism was thus resilient to the insurgency. Building local capacity, facilitating self-organization and diversifying livelihoods can enhance the resilience of ecotourism, sustaining stability and helping to deal with uncertainty.
As part of a larger evaluation of school nutrition programmes (SNP), the present study examined programme coordinators’ perceptions of strengths, weaknesses, opportunities and threats (SWOT) regarding their SNP and public health professionals’ support.
Design
Qualitative interviews were conducted with twenty-two of eighty-one programme coordinators who had completed a programme evaluation survey. Interviews followed a SWOT framework to evaluate programmes and assessed coordinators’ perceptions regarding current and future partnerships with public health professionals.
Setting
The study was conducted in a large, urban region within Ontario.
Subjects
The twenty-two coordinators who participated represented a cross-section of elementary, secondary, Public and Catholic schools.
Results
SNP varied enormously in foods/services offered, how they offered them and perceived needs. Major strengths included universality, the ability to reach needy students and the provision of social opportunities. Major weaknesses included challenges in forming funding partnerships, lack of volunteers, scheduling and timing issues, and coordinator workload. Common threats to effective SNP delivery included lack of sustainable funding, complexity in tracking programme use and food distribution, unreliable help from school staff, and conflicts with school administration. Opportunities for increased public health professionals’ assistance included menu planning, nutrition education, expansion of programme food offerings, and help identifying community partners and sustainable funding.
Conclusions
The present research identified opportunities for improving SNP and strategies for building on strengths. Since programmes were so diverse, tailored strategies are needed. Public health professionals can play a major role through supporting menu planning, food safety training, access to healthy foods, curriculum planning and by building community partnerships.
This paper reviews three UK-based welfare-to-work programmes featuring time-limited financial incentives to leave out-of-work benefits for employment. The policies considered are (i) the Employment Retention and Advancement demonstration, aimed at lone parents and the long-term unemployed; (ii) In-Work Credit, aimed at lone parents on welfare; (iii) Pathways to Work, aimed at recipients of incapacity benefits. I illustrate the difficulties in extrapolating from specific findings to general policy-relevant conclusions. Finally, I depict the challenge facing evaluators in future and point to the directions in which evaluation will need to develop if it is to contribute more fully to policy-relevant evaluation.
The current fiscal climate is focusing attention on the need for more efficient government. However, we have remarkably little rigorous information on which are the most cost-effective strategies for achieving common goals like delivering high quality education in deprived neighbourhoods or reducing carbon emissions. This paper argues that randomised impact evaluations can provide an effective way to generate the information needed to make government more effective. Advances in the theory and practice of running randomised evaluations mean that a wider range of questions can be answered than ever before. Elsewhere in the world, fundamental questions are being answered about how humans behave, which in turn are being used to design new policies which themselves are rigorously tested. By learning from these results, and by conducting more randomised evaluations on issues important to UK policy (both at home and abroad) it will be possible to design more effective policies and do more with less.