Hm Treasury
class="gem-c-govspeak govuk-govspeak gem-c-govspeak--direction-ltr govuk-!-margin-bottom-0">
Q. What is the Evaluation Registry?
A. The Evaluation Registry is the home for all Government evaluations. It is a website where all planned, live and published evaluations conducted or commissioned by Government Departments are registered. Evaluations on the Registry can be searched and browsed by users looking to learn from previous evaluations of Government policies, projects and programmes.
Q. What is an evaluation?
A. An evaluation refers to impact, process, and value for money evaluation studies conducted in line with the Magenta Book. The Magenta Book defines evaluation as as a systematic assessment of the design, implementation and outcomes of an intervention. Evaluations help us understand the impact of an intervention, whether it was good value for money, and whether we could have delivered it more effectively.
Q. Does my policy/project/programme need to be evaluated?
A. All policies, programmes and projects should be subject to proportionate evaluation. The Green Book states that all proposals for funding should include a proportionate budget, and a management plan, for monitoring and evaluation.
Not all interventions will require the same level of scrutiny or have the same learning needs. In the case of a low-risk, well-evidenced and low priority intervention, a light-touch monitoring and evaluation exercise to ensure it has been delivered as intended and achieved the predicted outcomes is likely to be all that is necessary. On the other hand, a high risk, high profile, high spend and/or high learning potential intervention is likely to require a large-scale evaluation.
Q. Does my evaluation need to be registered?
A. All planned and live evaluations and evaluation reports signed off from 1st April 2024 onwards should be registered on the Evaluation Registry. Evaluation reports should be published and entered on the Registry within 12 weeks of sign-off by the relevant internal Departmental governance processes. This applies to planned evaluations, live evaluations, and evaluation reports produced by all Central Government Departments.
This includes:
- Pilot evaluations
- Impact evaluations
- Process evaluations
- Value for Money evaluations (cost benefit and cost effectiveness analyses)
- Evidence syntheses, including systematic reviews, rapid evidence assessments, meta-analyses, meta-ethnography and realist synthesis
- Post implementation reviews, in cases where these apply one or more evaluation methods outlined in Annex A of the Magenta Book
This does not include:
- Regulatory or Enactment Impact assessments, also known as regulatory impact assessments or final impact assessments, used for policy regulation
- Feasibility studies
- Literature reviews
- Post implementation reviews, in cases where these do not apply evaluation methods outlined in Annex A of the Magenta Book
- Benefits monitoring and realisation reports (excluding cost benefit or cost effectiveness analyses)
- Outputs from social research, where this is not part of an evaluation
Q. Who is responsible for registering evaluations?
A. The organisation responsible for delivering the evaluation of an intervention is responsible for creating and updating the Registry entry for the evaluation. The individual responsible for creating the Registry entry will vary between departments (for example, in some departments central evaluation teams manage all entries, whereas in others the policy or project delivery colleagues may be responsible for this). Check with your central evaluation team or lead if you are not sure who should create and maintain the entry.
This will typically be the organisation delivering the intervention, but in cases where multiple organisations are working together to deliver an intervention the organisation responsible for overseeing the evaluation of said intervention should be responsible for creating the Registry entry. If there is no single organisation responsible for the evaluation, please discuss with your central evaluation team/lead to decide which organisation is best placed to take on this responsibility.
Q. Why do we need to register planned evaluations?
A. The GSR Publication Protocol states that Departments should make high level information publicly available on all research and analysis commissioned externally, and internal research where there is an intention to publish. Announcements should be made as early as is practicable. Please refer to the Government Social Research publication protocol for more information.
There is no requirement to upload an evaluation plan or framework in a document format. However, it is best practice to publish evaluation plans formally on GOV.UK in addition to registering them. The published plan can then be hyperlinked in the associated Registry entry.
Q. Why do we need to provide planned publication dates for evaluation reports?
A. The Registry aims to implement the terms of the Government Social Research publication protocol, which states that Publication dates should be preannounced. If this is not feasible, for example due to short notice requirements, departments need alternative approaches, where possible, to promote public trust in the transparency and objectivity of release arrangements. Departments should provide an estimated publication date for the final evaluation report.
This information is used to monitor which evaluations are still ongoing, and which are due to publish results shortly. This information also helps the Task Force identify where evaluation evidence is being withheld, and ensure results are published where appropriate.
The date provided on the Registry can easily be amended and updated on the site at any time, and users should look to ensure these dates remain up to date if publication timelines change.
Q. When do planned evaluations need to be registered?
A. Teams should register planned evaluations as early as is practicable under the terms of the Government Social Research publication protocol. For the Registry this means registering planned evaluations at the stage at which the plan for the evaluation has been approved through the relevant internal governance processes. In all cases plans should be registered before the first round of data collection for the evaluation takes place.
We know evaluation plans may also change along the way in relation to scope change or feasibility of planned methods. Users are able to edit and update entries on the Registry to reflect changes in evaluation plans whenever they need to. Entries should be regularly maintained as an up-to-date record for the planned evaluation.
Q. What is the approval process for making an entry on the Registry?
A. Before registering evaluations on the platform, users are responsible for ensuring that the planned evaluation or report has been approved through the relevant internal governance processes prior to registration. If you are unsure of the approvals you require before creating a new Registry entry, please get in touch with your Departments central evaluation team or lead to check.
New entries, and updates to existing entries, will need to be approved on the site by someone with publisher site permissions within your department. Once you have created a new entry (or made an update to an existing entry) on the site you can submit it to a publisher for approval via the submit for approval button.
If you have further questions, please email evaluation.registry@cabinetoffice.gov.uk.
Q. What information do I need to provide for a Registry entry?
A. You will need the following information to register an evaluation: 1. Title of the evaluation 2. The names of all organisations involved in the evaluation 3. Type of evaluation (impact, process, value for money) 4. Evaluation methods 5. Description of the intervention 6. Whether your evaluation is an evaluation of a grant scheme 7. Whether your evaluation is an evaluation of a Major Project 8. Start and end dates of the intervention 9. Planned publication date for the evaluation report
If the evaluation has published one or more reports, you will also need to provide:
- A link to the published report/s
- A summary of the evaluation findings
- The cos