There is increasing evidence that scientific misconduct is more common than previously thought. Strong emphasis on scientific productivity may increase the sense of publication pressure. We administered a nationwide survey to Flemish biomedical scientists on whether they had engaged in scientific misconduct and whether they had experienced publication pressure. A total of 315 scientists participated in the survey; 15% of the respondents admitted they had fabricated, falsified, plagiarized, or manipulated data in the past 3 years. Fraud was more common among younger scientists working in a university hospital. Furthermore, 72% rated publication pressure as "too high." Publication pressure was strongly and significantly associated with a composite scientific misconduct severity score.
Abstract Background Concerns about research misbehavior in academic science have sparked interest in the factors that may explain research misbehavior. Often three clusters of factors are distinguished: individual factors, climate factors and publication factors. Our research question was: to what extent can individual, climate and publication factors explain the variance in frequently perceived research misbehaviors?
Methods From May 2017 until July 2017, we conducted a survey study among academic researchers in Amsterdam. The survey included three measurement instruments that we previously reported individual results of and here we integrate these findings.
Results One thousand two hundred ninety-eight researchers completed the survey (response rate: 17%). Results showed that individual, climate and publication factors combined explained 34% of variance in perceived frequency of research misbehavior. Individual factors explained 7%, climate factors explained 22% and publication factors 16%.
Conclusions Our results suggest that the perceptions of the research climate play a substantial role in explaining variance in research misbehavior. This suggests that efforts to improve departmental norms might have a salutary effect on behavior.
We call on research funding organisations to experiment with different models for integrating partial randomisation into their grant allocation processes as well as to assess the feasibility, the potential implications, and the perceptions of such models. Traditional models of grant allocation have usually been based on peer review to rank applications and allocate grants. These models have been shown to suffer from various shortcomings. In particular, we believe that partial randomisation holds the potential of being more fair, more efficient, and more diverse. In addition, it may lead to more responsible research practices. We outline a proposal for such a grant allocation process and sketch various arguments in favour of it. We also address potential counterarguments and conclude that partial randomisation in grant allocation holds the potential to lead to many benefits and therefore warrants further experimentation and implementation.
This opinion piece aims to inform future research funding programs on responsible research practices (RRP) based on three specific objectives: (1) to give a sketch of the current international discussion on responsible research practices (RRPs); (2) to give an overview of current initiatives and already obtained results regarding RRP; and (3) to give an overview of potential future needs for research on RRP. In this opinion piece, we have used seven iterative methodological steps (including literature review, ranking, and sorting exercises) to create the proposed research agenda. We identified six main themes that we believe need attention in future research: (1) responsible evaluation of research and researchers, (2) the influence of open science and transparency on RRP, (3) research on responsible mentoring, supervision, and role modeling, (4) the effect of education and training on RRP, (5) checking for reproducibility, and (6) responsible and fair peer review. These themes have in common that they address aspects of research that are mostly on the level of the scientific system, more than on the level of the individual researcher. Some current initiatives are already gathering substantial empirical evidence to start filling these gaps. We believe that with sufficient support from all relevant stakeholders, more progress can be made.
Marketization and quantification have become ingrained in academia over the past few decades. The trust in numbers and incentives has led to a proliferation of devices that individualize, induce, benchmark, and rank academic performance. As an instantiation of that trend, this article focuses on the establishment and contestation of 'algorithmic allocation' at a Dutch university medical centre. Algorithmic allocation is a form of data-driven automated reasoning that enables university administrators to calculate the overall research budget of a department without engaging in a detailed qualitative assessment of the current content and future potential of its research activities. It consists of a range of quantitative performance indicators covering scientific publications, peer recognition, PhD supervision, and grant acquisition. Drawing on semi-structured interviews, focus groups, and document analysis, we contrast the attempt to build a rationale for algorithmic allocation—citing unfair advantage, competitive achievement, incentives, and exchange—with the attempt to challenge that rationale based on existing epistemic differences between departments. From the specifics of the case, we extrapolate to considerations of epistemic and market fairness that might equally be at stake in other attempts to govern the production of scientific knowledge in a quantitative and market-oriented way.
In: Labib , K , Roje , R , Bouter , L , Widdershoven , G , Evans , N , Marušić , A , Mokkink , L & Tijdink , J 2021 , ' Important Topics for Fostering Research Integrity by Research Performing and Research Funding Organizations : A Delphi Consensus Study ' , Science and Engineering Ethics , vol. 27 , no. 4 , 47 , pp. 1-22 . https://doi.org/10.1007/s11948-021-00322-9
To foster research integrity (RI), it is necessary to address the institutional and system-of-science factors that influence researchers' behavior. Consequently, research performing and research funding organizations (RPOs and RFOs) could develop comprehensive RI policies outlining the concrete steps they will take to foster RI. So far, there is no consensus on which topics are important to address in RI policies. Therefore, we conducted a three round Delphi survey study to explore which RI topics to address in institutional RI policies by seeking consensus from research policy experts and institutional leaders. A total of 68 RPO and 52 RFO experts, representing different disciplines, countries and genders, completed one, two or all rounds of the study. There was consensus among the experts on the importance of 12 RI topics for RPOs and 11 for RFOs. The topics that ranked highest for RPOs concerned education and training, supervision and mentoring, dealing with RI breaches, and supporting a responsible research process (e.g. through quality assurance). The highest ranked RFO topics concerned dealing with breaches of RI, conflicts of interest, and setting expectations on RPOs (e.g. about educating researchers about RI). Together with the research policy experts and institutional leaders, we developed a comprehensive overview of topics important for inclusion in the RI policies of RPOs and RFOs. The topics reflect preference for a preventative approach to RI, coupled with procedures for dealing with RI breaches. RPOs and RFOs should address each of these topics in order to support researchers in conducting responsible research.
Abstract Background There is increasing evidence that research misbehaviour is common, especially the minor forms. Previous studies on research misbehaviour primarily focused on biomedical and social sciences, and evidence from natural sciences and humanities is scarce. We investigated what academic researchers in Amsterdam perceived to be detrimental research misbehaviours in their respective disciplinary fields.
Methods We used an explanatory sequential mixed methods design. First, survey participants from four disciplinary fields rated perceived frequency and impact of research misbehaviours from a list of 60. We then combined these into a top five ranking of most detrimental research misbehaviours at the aggregate level, stratified by disciplinary field. Second, in focus group interviews, participants from each academic rank and disciplinary field were asked to reflect on the most relevant research misbehaviours for their disciplinary field. We used participative ranking methodology inducing participants to obtain consensus on which research misbehaviours are most detrimental.
Results In total, 1080 researchers completed the survey (response rate: 15%) and 61 participated in the focus groups (3 three to 8 eight researchers per group). Insufficient supervision consistently ranked highest in the survey regardless of disciplinary field and the focus groups confirmed this. Important themes in the focus groups were insufficient supervision, sloppy science, and sloppy peer review. Biomedical researchers and social science researchers were primarily concerned with sloppy science and insufficient supervision. Natural sciences and humanities researchers discussed sloppy reviewing and theft of ideas by reviewers, a form of plagiarism. Focus group participants further provided examples of particular research misbehaviours they were confronted with and how these impacted their work as a researcher.
Conclusion We found insufficient supervision and various forms of sloppy science to score highly on aggregate detrimental impact throughout all disciplinary fields. Researchers from the natural sciences and humanities also perceived nepotism to be of major impact on the aggregate level. The natural sciences regarded fabrication of data of major impact as well. The focus group interviews helped to understand how researchers interpreted 'insufficient supervision'. Besides, the focus group participants added insight into sloppy science in practice. Researchers from the natural sciences and humanities added new research misbehaviours concerning their disciplinary fields to the list, such as the stealing of ideas before publication. This improves our understanding of research misbehaviour beyond the social and biomedical fields.
"Co-creation is a qualitative research methodology that engages stakeholders in playful activities to produce user-centered outputs. Through an interactive and open approach, co-creation explores stakeholders' latent values, generates innovative ideas, and captures minority views, allowing for in-depth understanding of how stakeholders are affected by various factors. Therefore, co-creation is a promising methodology for developing guidelines on research integrity (RI), although there is no literature available about co-creation in this context. In our presentation, we share experiences of using co-creation to design institutional guidelines on RI together with research managers, funders and researchers across Europe. We conducted 24 co-creation workshops on topics ranging from RI education, to creating a responsible research environment, resulting in concrete guidelines that research institutions and funders can implement to foster RI. Our experience has provided us with valuable insights on using co-creation for RI guideline development. While motivating research stakeholders – often serious and analytically oriented people – to engage in creative exercises can be a challenge, particularly in the online setting, it is possible to achieve when 'play' and 'work' are carefully balanced. Additionally, to ensure the concreteness of guidelines while accounting for differences among institutions and countries, best practice examples can be used to show different approaches to implementing more general guidance. We have also learned that it is valuable to explore stakeholders' preferences regarding the guideline format, since implementability is not only influenced by the content. These insights provide practical considerations that other researchers can use when co-creating RI guidelines. "
AbstractEducation is important for fostering research integrity (RI). Although RI training is increasingly provided, there is little knowledge on how research stakeholders view institutional RI education and training policies. Following a constructivist approach, we present insights about research stakeholders' views and experiences regarding how research institutions can develop and implement RI education and training policies. We conducted thirty focus groups, engaging 147 participants in eight European countries. Using a mixed deductive-inductive thematic analysis, we identified five themes: (1) RI education should be available to all; (2) education and training approaches and goals should be tailored; (3) motivating trainees is essential; (4) both formal and informal educational formats are necessary; and (5) institutions should take into account various individual, institutional, and system-of-science factors when implementing RI education. Our findings suggest that institutions should make RI education attractive for all and tailor training to disciplinary-specific contexts.