Frequently Asked Questions
REF 2028: Future Research Assessment Programme (FRAP)
Q. What is FRAP?
FRAP – The ‘Future Research Assessment Programme’, which was launched by the
four UK funding bodies in May 2021 to evaluate the previous Research Assessment
Exercise (REF2021) and to identify approaches to future research assessment
that:
- encourage and strengthen the emphasis on delivering
excellent research and impact,
- support a positive, productive research culture, while
- simplifying and reducing the administrative burden on the
HE sector.
Following a period evaluation and consultation with the
sector, some initial decisions about the next exercise (REF2028) have been
announced.
Q. Why is the Research Excellence Framework changing and how is it
changing?
The initial decisions of FRAP represent a shift towards a broader and more
holistic approach to research assessment.
There is a stronger focus on people and culture, and a move away from assessing
individuals.
The exercise will be conducted in 2028, with institutions submitting in late
2027.
You can find out more detail here.
Q. If individuals are no longer being assessed, how can I
contribute to REF2028?
There are a number of ways that individuals will contribute to
REF2028. The University will continue to
submit research outputs and impact case studies authored by individuals
associated with the University.
We will also include information about the collective contributions,
achievements and successes of individuals employed by the University through a
range of narrative statements.
This will include contributions from academic staff and professional service
staff.
Q. What does it mean to be Significantly Responsible for Research (SigRes)?
The term SigRes was first introduced in REF2021 as a means to identify
those staff within an institution who are employed on a specific contract type (Research
or Teaching and Research) and where explicit time and resources are made
available to them to actively engage in independent research.
The University’s current criteria for determining
significant responsibility for research is:
- Staff members on a teaching and research contract, who have normally received a
research allowance of at least 20% per year with associated research
objectives.
Or
- Staff members on a research-only contract who are considered independent (as
opposed to supporting others’ research).
Q. How do I know if I am SigRes?
As part of the annual ‘MyContribution’ objective setting meetings, academic staff,
in agreement with their line manager and Head of Research, can request an
allocation of protected research time in exchange for delivering on one or more
research deliverables. The deliverables
can vary but may include things like, production of research outputs,
disseminating research, generating impact or leading a significant research
task. It may also include working on externally funded research grants or supervising research degrees.
Those staff receiving research time above the 20% threshold would be considered
SigRes.
Some staff might be considered ‘developing in research’ if they are allocated
research time below this threshold. In this case the objectives set would be
commensurate to the time and expectations of the individual.
Staff who are considered to be SigRes will be recorded as such in our annual
HESA staff data[i]
and this measure will be used to calculate the volume of research that we ultimately
need to submit to REF2028.
Staff on research-only contracts who are conducting independent research will also be classified as SigRes
Please note the University may consult upon and update our
SigRes criteria in due course.
[i] Higher Education Statistics Agency, responsible for collecting standardised data in HE
Q. What does being ‘SigRes’ mean for REF2028 submission?
Unlike in REF2021, SigRes staff do not need to be returned to REF2028 with a minimum or maximum number of outputs associated with them, because this exercise aims to break the link between individuals and submission.
The exercise recognises that there could be valid reasons why a staff member deemed to be SigRes may not be an author on outputs or impacts submitted to the exercise.
Q. I am not SigRes, but would like to contribute to REF2028, can I?
In REF2028, it is being proposed that institutions can submit research from any staff member so long as there is a substantive link to the submitting institution.
If you have ambitions to contribute to a future research assessment exercise, you should speak with your line manager and Head of Research in the first instance to agree appropriate research objectives as part of your My Contribution objective setting / career development plan.
The REF team will be developing processes to identify the research that is eligible for submission to REF2028, and we will be consulting further on the internal criteria for final selection of outputs.
Regardless of the final selection of outputs and impact submitted, staff will be recognised in REF2028 through other elements such as the narrative components of the submission which will recognise wider contributions.
Q. I am a non-academic or member of Professional Services, can I contribute to REF2028?
In REF2028, it is being proposed that institutions can submit research from any staff member so long as there is a substantive link to the submitting institution. This means we may seek to submit or recognise research from staff on Professional services or non-academic contracts, or from staff who have since left the institution.
The REF team will be developing processes to identify the research that is eligible for submission to REF2028, and we will be consulting further on the internal criteria for final selection of outputs.
Regardless of the final selection of outputs and impact submitted, staff will be recognised in REF2028 through other elements such as the narrative components of the submission which will recognise wider contributions.
Q. How will these changes affect my career development and
promotion opportunities?
The University’s academic promotions framework recognises a range of criterion associated with research activity.
Submission to REF is not specifically one of those criteria. However, staff applying for promotion on the research pathway would be required to demonstrate the quality of their research outputs using evidence aligned to REF quality thresholds of internationally excellent standard.
Q. When will we know the final details and guidance for
REF2028?
It is expected that the draft guidance for REF2028 will be published in
2024 followed by final guidance in 2025.
Q. How can I engage in the internal consultation exercise
and find out more about REF2028?
In response to the initial decisions document, the Funding
bodies invited views from the sector via consultation. Edinburgh Napier's response was submitted on 26th September.
General
Q. What is the UK Research Assessment Framework and why is it important?
The Research Excellence Framework (REF) is an internationally recognised system for assessing the quality of research in UK Higher Education Institutions (HEIs).
It is important because the results determine the amount of government funding received by each HEI.
The four UK higher education funding bodies use the REF to inform the allocation of around £2 billion of research funding per year. The thoroughness of the exercise is designed to provide accountability for public investment in research, demonstrating its benefits and impact.
Q. I would like to learn more about UK Research Assessment – where can I find out more?
You can learn more about the previous Research Excellence Framework (REF2021) by watching a video from the Vice-Principal Research and Innovation, Professor Nick Antonopoulos.
This presentation provides an overview of the most recent UK Research Assessment exercise, covering the period 2014 to 2021, as well as providing some information about the University’s recent REF2021 results.
In addition, the REF team based in the Research, Innovation and Enterprise Office will be developing a programme of REF awareness raising for all staff and the Post Grdauate Research community. More details will be provided soon.
Q. When is the next Research Excellence Framework?
We don’t yet know the shape or date of the future assessment. There is a sector-wide consultation currently occurring which is expected to conclude at the end of 2022.
However, we do know with certainty that UK Research Assessment will continue in some form, and that it will continue to inform the allocation of UK research funding.
Q. Why are we preparing now, if we don’t know the shape of a future assessment?
Although we don’t know the detail, it is likely that some core components of the existing exercise will be retained. This is likely to include the assessment of research outputs and evaluation of impact from research.
It is also important for us to understand the quality of research being produced at Edinburgh Napier University and to introduce appropriate support mechanisms that will enhance the quality of the research conducted, regardless of external assessment frameworks.
Q. I would like to be considered for a future REF / research assessment exercise – how do I note interest?
Until the sector wide consultation (FRAP) concludes, we don’t know what the staff eligibility criteria will look like in a future Research Assessment exercise. If you have ambitions to contribute to a future research assessment exercise, you should speak with your line manager and Head of Research in the first instance to agree appropriate research objectives as part of your My Contribution objective setting / career development plan.
A full glossary of terms can be found here.
Q. Why is the UK Research Assessment Framework of interest to me and my career development?
The REF exercise is important for all staff who have ambitions to work in research and those supporting it.
Here are just a few:
- The results determine the amount of government funding the University receives. This funding is re-invested into the School to enhance our research environment and provide development opportunities for staff
- Contributing to REF and being able to demonstrate research of high-quality on a sector-wide quality scale can enhance opportunities for your career progression and movement
- The outcomes of REF can help to attract research students and staff, thus enhancing the vibrancy of our research culture and environment
- It can help us to learn more about a University or department and understand sector trends
- It can help to identify and foster research collaborations within the University, with other HEIs and/or with external partners
- It provides an opportunity to benchmark your own research and enhance quality through internal development opportunities such a mentoring and co-authoring.
For more information about the REF exercise, have a look here.
Outputs
Q. What is a Research Output?
A research output is the product of research. An underpinning principle of the REF is that all forms of research output will be assessed on a fair and equal basis. You can access the full list of eligible output types here.
Q. When is the next Research Excellence Framework?
We don’t yet know the shape of the future assessment. There is a sector-wide consultation currently occurring which is expected to conclude at the end of 2022.
However, we do know with certainty that UK Research Assessment will continue in some form, and that it will continue to inform the allocation of UK research funding.
Q. Why am I being contacted now, if we don’t know the shape of a future assessment?
Although we don’t know the detail, it is likely that some core components of the existing exercise will be retained. This is likely to include the assessment of research outputs. To make the internal process more manageable and less burdensome, we will be conducting an annual output review process.
It is also important for us to understand the quality of research being produced at Edinburgh Napier University and to introduce support mechanisms that will enhance the quality of the research conducted, regardless of external assessment frameworks. This is of benefit to the University and to you and your career development.
We also know that there is a need to understand and improve accuracy in output evaluation. The current process is intended to enable us to benchmark accuracy and implement training to improve reliability in internal assessment.
Q. I haven’t produced any REF-eligible outputs as yet, what should I do?
We appreciate that not all identified staff will have produced REF eligible outputs this early on in the new REF cycle. If this is the case, you can respond with a nil return and you may be contacted again in a future annual review.
If you need additional support to help deliver on your research objectives, please contact your line manager and/or Head of Research to discuss.
Q. I am unfamiliar with the REF criteria, and I do not feel well-enough equipped to provide a score for my output/s, what should I do?
The output self-scoring field is optional. We appreciate that some staff may not be familiar with the criteria and are therefore unable to provide a reliable score.
The REF team will be working with Schools to develop a programme of REF awareness and output quality enhancement which will aim to promote understanding of REF criteria and enable staff to score their work in future.
For those staff who do wish to provide a score, please refer to the REF output criteria.
Q. Can I refer to Journal impact factors or other metrics as a basis of Output quality?
An underpinning principle of REF is that journal impact factors or any hierarchy of journals, journal-based metrics (this includes ABS rating, journal ranking and total citations) should not be used in the assessment of outputs. No output is privileged or disadvantaged on the basis of the publisher, where it is published or the medium of its publication.
An output should be assessed on its content and contribution to advancing knowledge in its own right and in the context of the REF quality threshold criteria, irrespective of the ranking of the journal or publication outlet in which it appears.
You should refer only to the REF output quality criteria if you are adding the optional self-score field and you should not refer to any journal ranking sources.
Q. What is Open Access Policy and how does it affect my outputs?
Under current rules, to be eligible for future research assessment exercises, higher education institutions (HEIs) are required to implement processes and procedures to comply with the REF Open Access policy.
It is a requirement for all journal articles and conference proceedings with an International Standard Serial Number (ISSN), accepted for publication after 1 April 2016, to be made open access. This can be achieved by either publishing the output in an open access journal outlet or by depositing an author accepted manuscript version in the University’s repository within three months of the acceptance date.
Although the current Open Access policy applies only to journal and conference proceedings with an ISSN, Edinburgh Napier University expects staff to deposit all forms of research output in the University research management system, subject to any publishers’ restrictions.
You can read the University’s Open Access Policy here.
Q. My Output is likely to form part of a portfolio of work (multi-component output), how do I collate and present this type of output for assessment?
The REF team will be working with relevant School research leadership teams to develop platforms to present multicomponent / portfolio submissions. In the meantime, please use the 100 word statement to describe how your output could form part of a multicomponent submission and provide information about any useful contextual information.
Q. How will the information I provide about my outputs be used and for what purpose?
In this exercise, a minimum of one output identified by each author will be reviewed by a panel of internal and external subject experts.
The information provided will be used to enable us to report on research quality measures as identified in the University R&I strategy.
More importantly, the information will also be used to inform a programme of training in each of the Schools with an overall aim to identify and enhance quality and to improve accuracy in REF scoring.
Output quality data will be recorded centrally on the University’s REF module in Worktribe. Access to this data is restricted to a core team of REF staff based with the Research, Innovation and Enterprise Office and key senior leaders in the School.
The data will not be used for any other purpose, other than for monitoring REF-related preparations.
Q. Who else will be involved in reviewing my output/s?
Outputs will be reviewed by an expert panel of internal and external independent reviewers.
Q. Will I receive feedback on my Output/s?
The REF team encourages open and transparent communication relating to output review and feedback. We will be working with senior research leaders within the School to promote this.
Q. I have identified more than one Output, will all of my identified outputs be reviewed this year?
We are committed to reviewing at least one output from each author via an internal, external and moderation review process.
An output review process will be repeated annually. If an output is not reviewed in the current year, we anticipate that it will be included in future review processes if it remains in your top selection.
Once we know more about the shape of a future REF, we will adapt the process to meet the new criteria / eligibility.
If you have any further queries, please contact the REF team.