Purpose: This article presents the design and validation of evaluation criteria checklist aimed at facilitating decision-making processes regarding participation in research projects and allocation of resources before the preparation of research proposals.
Materials and methods: A multidisciplinary team developed a comprehensive evaluation focusing on the proposal preparation phase of research projects. A Delphi survey method was used to establish a connection between the relevance of the project and the possible success of research proposals. Assessment criteria were agreed upon, each assigned specific weights. The results of the survey were applied to a database of 62 proposals for which our research group sought funding during 2020-2021. The method was validated using the funding body's outcomes (approval or rejection) of the submitted proposals as the ground truth per project type (national, European and regional).
Results: The results of the survey generated a checklist of 8 criteria (excellence, impact, and efficiency aspects) that effectively assess the possibility of success of research proposals during the preparatory phase. For national projects, the tool validation demonstrated a sensitivity of 100% and a specificity of 76.19%; European projects exhibited a sensitivity of 100% and a specificity of 53.84%; and regional projects showed a sensitivity of 80% and a specificity of 30%.
Conclusions: By establishing an agreed set of evaluation criteria, the developed comprehensive index enables a more precise decision support tool for the participation in research proposals and the allocation of necessary resources. This control system saves valuable time and effort for research groups while enhancing the overall efficiency of available resources.
Keywords: Composite Indicator; Efficiency; Opportunity cost; Optimisation; Research; Resources; Return of Investment.
Copyright © 2024. Published by Elsevier B.V.