Evaluate the impact and implementation of care and health practice and policy
SCIE’s evaluation services help care and health commissioners, providers and policy makers to demonstrate how they are implementing policy and the impact it has on practice and outcomes.
Increased local accountability, growing numbers of self-funders, reduced budgets and high levels of public scrutiny mean resource allocation has never been more challenging. Robust evaluation can help care providers and commissioners to test the impact and cost-effectiveness of their activities and support decision making.
We very much welcome the honesty, clarity and accuracy of this evaluation of our Care Act implementation work. I would encourage other authorities to consider this type of approach to getting an informed external view of their service areas and believe SCIE provided this in an objective and professional way.Alan Lotinga, Service Director, Health and Wellbeing, Birmingham City Council
You can commission SCIE to provide:
- large-scale evaluations of local and national initiatives
- experimental, longitudinal (change over time) evaluations including trial approaches, such as quasi-experimental and randomised control trials
- formative and summative evaluation incorporating a realist approach to our work, we work in partnership with clients to ensure findings are used to inform and drive service development and improvement
- cooperative action research to develop our clients’ sustainable capacity to conduct their own evaluation
- multi-method evaluations incorporating qualitative and quantitative approaches, such as interviews, focus groups, literature reviews, document reviews, observation and survey work
- commissioning and managing independent evaluation contractors for clients. As well as directly conducting evaluations for our clients, we also provide a commissioning and evaluation management service to clients, which includes developing invitations to tenders (ITTs), assessing ITT responses, selecting contractors and drawing up and managing the resulting evaluation contracts.
- evaluation advice, scoping and design. We can support you to develop your own inhouse evaluation services.
- translation of evaluation findings into practical implementation tools and resources (see our Digital services offer)
- dissemination of evaluation findings across the care and health sectors (see our Communications services)
We provide evaluation services to a wide range of clients including local authorities, care providers, national agencies, government departments, foundation trusts, research agencies and universities. Some of our evaluation clients are outlined below.
Birmingham City Council - Care Act Programme Review – November 2015Open
Following the initial implementation of the Care Act 2014, Birmingham City Council commissioned SCIE to undertake an external review of the approach taken by the Council in order to be Care Act compliant.
The aims of the review were to recommend the next steps required in order to meet the Care Act requirements and embed its principles around five key areas: assessment and eligibility determination, custodial settings, independent advocacy, personal budgets and transition from children’s to adults’ services.
The review identified whether the Council had put in place the appropriate tools to meet the Care Act duties and to enable staff to embed the Care Act principles in due time.
SCIE’s review, which was carried out over 6 weeks (spending four days onsite), involved:
- 10 interviews with a total of 25 people including Care Act Leads, key players in implementing the changes and operational managers
- 5 focus group attended by more than 35 front line staff
- reviewing almost 60 documents including forms, protocols, procedures, guidance, training material and leaflets.
The final report, which was provided as an action plan, identified:
- findings – strengths and areas of consideration
- traffic light analysis against Care Act 2014 and Regulation duties.
An overview of the findings and recommendations was presented to a forum of 50 people including the Adult Social Care Lead member, the Care Act Regional Lead, the Service Director for Business Change, the Service Director Health and Wellbeing (who commissioned the review) and two assistant directors with the remit for Adult Social Care.
The review is being used by the Council to identify priorities and next for the next six months in order to ensure Care Act compliance and improving outcomes for local people and staff in BCC.
We very much welcome the honesty, clarity and accuracy of this evaluation. The level of support and guidance given by SCIE throughout has been much appreciated. The process has been well managed and co-ordinated; and delivered in an expert manner. The evaluation was flexible, thorough and was undertaken with sensitivity to local pressures and circumstances. Recommendations made have proved to be a good basis for making improvements across our service. I would encourage other authorities to consider this type of approach to getting an informed external view of their service areas and believe SCIE provided this in an objective and professional wayAlan Lotinga, Service Director, Health and Wellbeing, Birmingham City Council
Department of Health, Government Equalities Office and the Department for Work and Pensions – Supporting carers in employment pilotOpen
In April 2015, a consortium of Government departments commissioned SCIE to manage the delivery and evaluation of a two-year pilot programme, which aims to test what works to support carers to remain in and/or return to employment.
The Carers in Employment (CIE) programme explores the different ways local authorities can meet this challenge. Pilots are funded to explore the different ways this challenge can be addressed. To date, pilot activity falls into three broad areas: engagement and awareness with employers, information and advice to carers and assistive technology.
SCIE’s role involves managing the independent evaluation of CIE by the Institute of Employment Studies (IES). The aim of the evaluation is to find out what works best to support carers and to share learning as widely as possible. Interim report findings are due in September 2016, with the final evaluation of the pilots in July 2017.
SCIE is also coordinating and supporting the delivery of pilots which involves regular network learning events and the use of a remote learning hub and discussion forum.
HC-One – evaluation of development of nursing assistant roles (October 2015 – January 2016)Open
Care home provider, HC-One, commissioned SCIE to conduct an independent evaluation of their development programme for their senior carers to become nursing assistants.
As part of a strategic transformation of its services, HC-One developed the new role of nursing assistant in order to retain high-performing staff and improve the quality of care. The nursing assistant is a new intermediate role that sits between the senior carer and the qualified nurse. It provides a new opportunity for senior carers to grow their skills, responsibility and pay, while reducing the pressure on nursing staff.
HC-One provides an assessment and training package to support applicants in making the transition to becoming nursing assistants – called the Care Assistant Development Programme.
The aim of SCIE’s review was to:
- evaluate the short-term impact of the Care Assistant Development Programme (CAPD) on the quality and consistency of care
- inform the development, implementation and ongoing evaluation of the Programme
- validate the programme against national good practice markers for the delivery of safe and good care.
Our methodology included qualitative and quantitative research, action research with selected sites and stakeholders, and reviews of key resources. It involved:
- Scoping interviews with stakeholders
- 60 nursing assistants took part in before and after survey
- 42 homes took part in survey of residents and relatives
- 6 qualitative case studies with homes
- 50 interviews with home managers, deputy managers, nursing assistants, senior carers, carers, residents and relatives
- 2 interviews with HC-One stakeholders
- 3 interviews with external stakeholders
- 16 homes took part in analysis of Key Performance Indicators
- Review of key documents
The findings were launched at a care sector seminar, hosted by SCIE, on 13 June 2016.
SCIE also produced two short films about the CAPD from the perspective of a HC-One nursing assistant and a care home resident.
- Read the report and view videos
- Read SCIE press release
- Blog from HC-One’s Alison Innes-Furguhar
- SCIE’s evaluation service
The Care Assistant Development Programme is an enterprising scheme to release the ambition and increase the skills of kind, caring staff. SCIE grasped the potential of this immediately and developed their evaluation in a dynamic and constructive way. This really is promoting social care excellence and I commend their capacity for active, critical friend evaluationsJohn Ransford, Non-Executive Director at HC-One
Lloyds Bank Foundation Trust and the Big Lottery Fund – evaluation of HomeshareOpen
SCIE is managing the evaluation of a two-year pilot of the UK’s first national Homeshare programme. The evaluation, managed by SCIE and undertaken by the Office of Public Management, is focused on testing and finding out what works to make the Homeshare model of care and accommodation a sustainable and economically viable business.