Reporting of sex and gender in randomized controlled trials in Canada: a cross-sectional methods study
In: Research integrity and peer review, Band 2, Heft 1
ISSN: 2058-8615
4 Ergebnisse
Sortierung:
In: Research integrity and peer review, Band 2, Heft 1
ISSN: 2058-8615
Background: Accurate reporting on sex and gender in health research is integral to ensuring that health interventions are safe and effective. In Canada and internationally, governments, research organizations, journal editors, and health agencies have called for more inclusive research, provision of sex-disaggregated data, and the integration of sex and gender analysis throughout the research process. Sex and gender analysis is generally defined as an approach for considering how and why different subpopulations (e.g., of diverse genders, ages, and social locations) may experience health conditions and interventions in different or similar ways. The objective of this study was to assess the extent and nature of reporting about sex and/or gender, including whether sex and gender analysis (SGA) was carried out in a sample of Canadian randomized controlled trials (RCTs) with human participants.Methods: We searched MEDLINE from 01 January 2013 to 23 July 2014 using a validated filter for identification of RCTs, combined with terms related to Canada. Two reviewers screened the search results to identify the first 100 RCTs that were either identified in the trial publication as funded by a Canadian organization or which had a first or last author based in Canada. Data were independently extracted by two people from 10% of the RCTs during an initial training period; once agreement was reached on this sample, the remainder of the data extraction was completed by one person and verified by a second.Results: The search yielded 1433 records. We screened 256 records to identify 100 RCTs which met our eligibility criteria. The median sample size of the RCTs was 107 participants (range 12–6085). While 98% of studies described the demographic composition of their participants by sex, only 6% conducted a subgroup analysis across sex and 4% reported sex-disaggregated data. No article defined "sex" and/or "gender". No publication carried out a comprehensive sex and gender analysis.Conclusions: Findings highlight poor uptake of ...
BASE
Background: Accurate reporting on sex and gender in health research is integral to ensuring that health interventions are safe and effective. In Canada and internationally, governments, research organizations, journal editors, and health agencies have called for more inclusive research, provision of sex-disaggregated data, and the integration of sex and gender analysis throughout the research process. Sex and gender analysis is generally defined as an approach for considering how and why different subpopulations (e.g., of diverse genders, ages, and social locations) may experience health conditions and interventions in different or similar ways. The objective of this study was to assess the extent and nature of reporting about sex and/or gender, including whether sex and gender analysis (SGA) was carried out in a sample of Canadian randomized controlled trials (RCTs) with human participants. Methods: We searched MEDLINE from 01 January 2013 to 23 July 2014 using a validated filter for identification of RCTs, combined with terms related to Canada. Two reviewers screened the search results to identify the first 100 RCTs that were either identified in the trial publication as funded by a Canadian organization or which had a first or last author based in Canada. Data were independently extracted by two people from 10% of the RCTs during an initial training period; once agreement was reached on this sample, the remainder of the data extraction was completed by one person and verified by a second. Results: The search yielded 1433 records. We screened 256 records to identify 100 RCTs which met our eligibility criteria. The median sample size of the RCTs was 107 participants (range 12–6085). While 98% of studies described the demographic composition of their participants by sex, only 6% conducted a subgroup analysis across sex and 4% reported sex-disaggregated data. No article defined "sex" and/or "gender." No publication carried out a comprehensive sex and gender analysis. Conclusions: Findings highlight poor uptake of sex and gender considerations in the Canadian RCT context and underscore the need for better articulated guidance on sex and gender analysis to improve reporting of evidence, inform policy development, and guide future research. ; Applied Science, Faculty of ; Medicine, Faculty of ; Non UBC ; Anesthesiology, Pharmacology and Therapeutics, Department of ; Nursing, School of ; Reviewed ; Faculty
BASE
We conducted preregistered replications of 28 classic and contemporary published findings, with protocols that were peer reviewed in advance, to examine variation in effect magnitudes across samples and settings. Each protocol was administered to approximately half of 125 samples that comprised 15,305 participants from 36 countries and territories. Using the conventional criterion of statistical significance (p <.05), we found that 15 (54%) of the replications provided evidence of a statistically significant effect in the same direction as the original finding. With a strict significance criterion (p <.0001), 14 (50%) of the replications still provided such evidence, a reflection of the extremely highpowered design. Seven (25%) of the replications yielded effect sizes larger than the original ones, and 21 (75%) yielded effect sizes smaller than the original ones. The median comparable Cohen's ds were 0.60 for the original findings and 0.15 for the replications. The effect sizes were small (< 0.20) in 16 of the replications (57%), and 9 effects (32%) were in the direction opposite the direction of the original effect. Across settings, the Q statistic indicated significant heterogeneity in 11 (39%) of the replication effects, and most of those were among the findings with the largest overall effect sizes; only 1 effect that was near zero in the aggregate showed significant heterogeneity according to this measure. Only 1 effect had a tau value greater than.20, an indication of moderate heterogeneity. Eight others had tau values near or slightly above.10, an indication of slight heterogeneity. Moderation tests indicated that very little heterogeneity was attributable to the order in which the tasks were performed or whether the tasks were administered in lab versus online. Exploratory comparisons revealed little heterogeneity between Western, educated, industrialized, rich, and democratic (WEIRD) cultures and less WEIRD cultures (i.e., cultures with relatively high and low WEIRDness scores, respectively). Cumulatively, variability in the observed effect sizes was attributable more to the effect being studied than to the sample or setting in which it was studied.
BASE