In: Bulletin of the World Health Organization: the international journal of public health = Bulletin de l'Organisation Mondiale de la Santé, Band 87, Heft 6, S. 407-407
Background Information about effects of treatments based on unsystematic reviews of research evidence may be misleading. However, finding trustworthy information about the effects of treatments based on systematic reviews, which is accessible to patients and the public can be difficult. The objectives of this study were to identify and evaluate free sources of health information for patients and the public that provide information about effects of treatments based on systematic reviews. Methods We reviewed websites that we and our colleagues knew of, searched for government sponsored health information websites, and searched for online sources of health information that provide evidence-based information. To be included in our review, a website had to be available in English, freely accessible, and intended for patients and the public. In addition, it had to have a broad scope, not limited to specific conditions or types of treatments. It had to include a description of how the information is prepared and the description had to include a statement about using systematic reviews. We compared the included websites by searching for information about the effects of eight treatments. Results Three websites met our inclusion criteria: Cochrane Evidence, Informed Health, and PubMed Health. The first two websites produce content, whereas PubMed Health aggregated content. A fourth website that met our inclusion criteria, CureFacts, was under development. Cochrane Evidence provides plain language summaries of Cochrane Reviews (i.e. summaries that are intended for patients and the public). They are translated to several other languages. No information besides treatment effects is provided. Informed Health provides information about treatment effects together with other information for a wide range of topics. PubMed Health was discontinued in October 2018. It included a large number of systematic reviews of treatment effects with plain language summaries for Cochrane Reviews and some other reviews. None of the three websites included links to ongoing trials, and information about treatment effects was not reported consistently on any of the websites. Conclusion It is possible for patients and the public to access trustworthy information about the effects of treatments using the two of the websites included in this review.
Abstract Background The Internet offers a seemingly endless amount of health information of varying quality. Health portals, which provide entry points to quality-controlled collections of websites, have been hailed as a solution to this problem. The objective of this study is to assess the extent to which government-run health portals provide access to relevant, valid and understandable information about the effects of health care. Methods We selected eight clinically relevant questions for which there was a systematic review, searched four portals for answers, and compared the answers we found to the results of the systematic reviews. Results Our searches resulted in 3400 hits, 155 of which mentioned both the condition and the intervention in one of the eight questions. Sixty-three of the 155 web pages did not give any information about the effect of the intervention. Seventy-seven qualitatively described the effects of the intervention. Twenty-six of these had information that was too unclear to be categorised; 15 were not consistent with the systematic review; and 36 were consistent with the review, but usually did not mention what happens without the intervention, what outcomes have been measured or when they were measured. Fifteen web pages quantitatively described effects. Four of these were abstracts from the systematic review, nine had information that was incomplete and potentially misleading because of a lack of information about people not receiving the intervention and the length of follow-up; one had information that was consistent with the review, but only referred to three trials whereas the review included six; and one was consistent with the review. Conclusion Information accessible through health portals is unlikely to be based on systematic reviews and is often unclear, incomplete and misleading. Portals are only as good as the websites they lead to. Investments in national health portals are unlikely to benefit consumers without investments in the production and maintenance of relevant, valid and understandable information to which the portals lead.
This is a protocol for a Cochrane Review (Intervention). The objectives are as follows: This review addresses the following question: Are local consensus processes effective in improving professionals' practice or health care outcomes? To answer this question we will consider the comparisons listed below. (1) Any intervention in which local consensus processes are a component compared to no intervention. The primary aim of this analysis will be to explore heterogeneity, including potential differences between the effects of local consensus processes alone and local consensus processes as a component of multifaceted interventions. The main explanatory factors that we will consider are: the type of intervention (local consensus processes or multifaceted interventions that included local consensus processes); the contribution of local consensus processes as a component of the intervention for multifaceted interventions; setting of care (primary versus hospital); complexity of the targeted behaviour; seriousness of the outcome; baseline compliance; study quality (high or moderate protection against bias). (2) Local consensus processes compared to no intervention. (3) Any intervention in which local consensus processes is a component compared to local consensus processes alone. (4) Local consensus processes (alone or as a component) compared to other interventions. (5) Comparison of different types of local consensus processes. (6) Comparison of formal and informal local consensus process
Background: Corruption is the abuse or complicity in abuse, of public or private position, power or authority to benefit oneself, a group, an organisation or others close to oneself; where the benefits may be financial, material or non-material. It is wide-spread in the health sector and represents a major problem. Objectives: Our primary objective was to systematically summarise empirical evidence of the effects of strategies to reduce corruption in the health sector. Our secondary objective was to describe the range of strategies that have been tried and to guide future evaluations of promising strategies for which there is insufficient evidence. Search methods: We searched 14 electronic databases up to January 2014, including: CENTRAL; MEDLINE; EMBASE; sociological, economic, political and other health databases; Human Resources Abstracts up to November 2010; Euroethics up to August 2015; and PubMed alerts from January 2014 to June 2016. We searched another 23 websites and online databases for grey literature up to August 2015, including the World Bank, the International Monetary Fund, the U4 Anti-Corruption Resource Centre, Transparency International, healthcare anti-fraud association websites and trial registries. We conducted citation searches in Science Citation Index and Google Scholar, and searched PubMed for related articles up to August 2015. We contacted corruption researchers in December 2015, and screened reference lists of articles up to May 2016. Selection criteria: For the primary analysis, we included randomised trials, non-randomised trials, interrupted time series studies and controlled before-after studies that evaluated the effects of an intervention to reduce corruption in the health sector. For the secondary analysis, we included case studies that clearly described an intervention to reduce corruption in the health sector, addressed either our primary or secondary objective, and stated the methods that the study authors used to collect and analyse data. Data collection and analysis: One review author extracted data from the included studies and a second review author checked the extracted data against the reports of the included studies. We undertook a structured synthesis of the findings. We constructed a results table and 'Summaries of findings' tables. We used the Grading of Recommendations Assessment, Development and Evaluation (GRADE) approach to assess the certainty of the evidence. Main results: No studies met the inclusion criteria of the primary analysis. We included nine studies that met the inclusion criteria for the secondary analysis. One study found that a package of interventions coordinated by the US Department of Health and Human Services and Department of Justice recovered a large amount of money and resulted in hundreds of new cases and convictions each year (high certainty of the evidence). Another study from the USA found that establishment of an independent agency to investigate and enforce efforts against overbilling might lead to a small reduction in overbilling, but the certainty of this evidence was very low. A third study from India suggested that the impacts of coordinated efforts to reduce corruption through increased detection and enforcement are dependent on continued political support and that they can be limited by a dysfunctional judicial system (very low certainty of the evidence). One study in South Korea and two in the USA evaluated increased efforts to investigate and punish corruption in clinics and hospitals without establishing an independent agency to coordinate these efforts. It is unclear whether these were effective because the evidence is of very low certainty. One study from Kyrgyzstan suggested that increased transparency and accountability for co-payments together with reduction of incentives for demanding informal payments may reduce informal payments (low certainty of the evidence). One study from Germany suggested that guidelines that prohibit hospital doctors from accepting any form of benefits from the pharmaceutical industry may improve doctors' attitudes about the influence of pharmaceutical companies on their choice of medicines (low certainty of the evidence). A study in the USA, evaluated the effects of introducing a law that required pharmaceutical companies to report the gifts they gave to healthcare workers. Another study in the USA evaluated the effects of a variety of internal control mechanisms used by community health centres to stop corruption. The effects of these strategies is unclear because the evidence was of very low certainty. Authors' conclusions: There is a paucity of evidence regarding how best to reduce corruption. Promising interventions include improvements in the detection and punishment of corruption, especially efforts that are coordinated by an independent agency. Other promising interventions include guidelines that prohibit doctors from accepting benefits from the pharmaceutical industry, internal control practices in community health centres, and increased transparency and accountability for co-payments combined with reduced incentives for informal payments. The extent to which increased transparency alone reduces corruption is uncertain. There is a need to monitor and evaluate the impacts of all interventions to reduce corruption, including their potential adverse effects.
THE GRADE WORKING GROUP IS DEVELOPING and evaluating a common, sensible approach to grading quality of evidence and strength of recommendations in health care. In this article, we discuss the advantages and disadvantages of using letters, numbers, symbols or words to represent grades of evidence and recommendations. Using multiple strategies, we searched for comparative studies of alternative ways of representing ordered categories in any context. In addition, we contacted experts and reviewed theoretical work and qualitative research on how best to communicate grades of any kind quickly and clearly. We were unable to identify health care research that addressed, either directly or indirectly, the best way to present grades of evidence and recommendations. We found examples of symbols used by government, commercial and consumer organizations to communicate quality of evidence or strength of recommendations, but no comparative studies. Although a number of grading systems are used in health care and other fields, there is little or no evidence of how well various presentations are understood. Before promoting the use of specific symbols, numbers, letters or words, the extent to which the intended message is comprehended should be evaluated.
Abstract Background Previous surveys of organizations that support the development of evidence-informed health policies have focused on organizations that produce clinical practice guidelines (CPGs) or undertake health technology assessments (HTAs). Only rarely have surveys focused at least in part on units that directly support the use of research evidence in developing health policy on an international, national, and state or provincial level ( i.e ., government support units, or GSUs) that are in some way successful or innovative or that support the use of research evidence in low- and middle-income countries (LMICs). Methods We drew on many people and organizations around the world, including our project reference group, to generate a list of organizations to survey. We modified a questionnaire that had been developed originally by the Appraisal of Guidelines, Research and Evaluation in Europe (AGREE) collaboration and adapted one version of the questionnaire for organizations producing CPGs and HTAs, and another for GSUs. We sent the questionnaire by email to 176 organizations and followed up periodically with non-responders by email and telephone. Results We received completed questionnaires from 152 (86%) organizations. More than one-half of the organizations (and particularly HTA agencies) reported that examples from other countries were helpful in establishing their organization. A higher proportion of GSUs than CPG- or HTA-producing organizations involved target users in the selection of topics or the services undertaken. Most organizations have few (five or fewer) full-time equivalent (FTE) staff. More than four-fifths of organizations reported providing panels with or using systematic reviews. GSUs tended to use a wide variety of explicit valuation processes for the research evidence, but none with the frequency that organizations producing CPGs, HTAs, or both prioritized evidence by its quality. Between one-half and two-thirds of organizations do not collect data systematically about uptake, and roughly the same proportions do not systematically evaluate their usefulness or impact in other ways. Conclusion The findings from our survey, the most broadly based of its kind, both extend or clarify the applicability of the messages arising from previous surveys and related documentary analyses, such as how the 'principles of evidence-based medicine dominate current guideline programs' and the importance of collaborating with other organizations. The survey also provides a description of the history, structure, processes, outputs, and perceived strengths and weaknesses of existing organizations from which those establishing or leading similar organizations can draw.
Abstract Background Only a small number of previous efforts to describe the experiences of organizations that produce clinical practice guidelines (CPGs), undertake health technology assessments (HTAs), or directly support the use of research evidence in developing health policy ( i.e. , government support units, or GSUs) have relied on interviews and then only with HTA agencies. Interviews offer the potential for capturing experiences in great depth, particularly the experiences of organizations that may be under-represented in surveys. Methods We purposively sampled organizations from among those who completed a questionnaire in the first phase of our three-phase study, developed and piloted a semi-structured interview guide, and conducted the interviews by telephone, audio-taped them, and took notes simultaneously. Binary or categorical responses to more structured questions were counted when possible. Themes were identified from among responses to semi-structured questions using a constant comparative method of analysis. Illustrative quotations were identified to supplement the narrative description of the themes. Results We interviewed the director (or his or her nominee) in 25 organizations, of which 12 were GSUs. Using rigorous methods that are systematic and transparent (sometimes shortened to 'being evidence-based') was the most commonly cited strength among all organizations. GSUs more consistently described their close links with policymakers as a strength, whereas organizations producing CPGs, HTAs, or both had conflicting viewpoints about such close links. With few exceptions, all types of organizations tended to focus largely on weaknesses in implementation, rather than strengths. The advice offered to those trying to establish similar organizations include: 1) collaborate with other organizations; 2) establish strong links with policymakers and stakeholders; 3) be independent and manage conflicts of interest; 4) build capacity; 5) use good methods and be transparent; 6) start small and address important questions; and 7) be attentive to implementation considerations. The advice offered to the World Health Organization (WHO) and other international organizations and networks was to foster collaborations across organizations. Conclusion The findings from our interview study, the most broadly based of its kind, extend to both CPG-producing organizations and GSUs the applicability of the messages arising from previous interview studies of HTA agencies, such as to collaborate with other organizations and to be attentive to implementation considerations. Our interview study also provides a rich description of organizations supporting the use of research evidence, which can be drawn .
Abstract Background Previous efforts to produce case descriptions have typically not focused on the organizations that produce research evidence and support its use. External evaluations of such organizations have typically not been analyzed as a group to identify the lessons that have emerged across multiple evaluations. Case descriptions offer the potential for capturing the views and experiences of many individuals who are familiar with an organization, including staff, advocates, and critics. Methods We purposively sampled a subgroup of organizations from among those that participated in the second (interview) phase of the study and (once) from among other organizations with which we were familiar. We developed and pilot-tested a case description data collection protocol, and conducted site visits that included both interviews and documentary analyses. Themes were identified from among responses to semi-structured questions using a constant comparative method of analysis. We produced both a brief (one to two pages) written description and a video documentary for each case. Results We conducted 51 interviews as part of the eight site visits. Two organizational strengths were repeatedly cited by individuals participating in the site visits: use of an evidence-based approach (which was identified as being very time-consuming) and existence of a strong relationship between researchers and policymakers (which can be challenged by conflicts of interest). Two organizational weaknesses – a lack of resources and the presence of conflicts of interest – were repeatedly cited by individuals participating in the site visits. Participants offered two main suggestions for the World Health Organization (and other international organizations and networks): 1) mobilize one or more of government support, financial resources, and the participation of both policymakers and researchers; and 2) create knowledge-related global public goods. Conclusion The findings from our case descriptions, the first of their kind, intersect in interesting ways with the messages arising from two systematic reviews of the factors that increase the prospects for research use in policymaking. Strong relationships between researchers and policymakers bodes well given such interactions appear to increase the prospects for research use. The time-consuming nature of an evidence-based approach, on the other hand, suggests the need for more efficient production processes that are 'quick and clean enough.' Our case descriptions and accompanying video documentaries provide a rich description of organizations supporting the use of research evidence, which can be drawn upon by those establishing or leading similar organizations, particularly .
Background: Determinants of practice are factors that might prevent or enable improvements. Several checklists, frameworks, taxonomies, and classifications of determinants of healthcare professional practice have been published. In this paper, we describe the development of a comprehensive, integrated checklist of determinants of practice (the TICD checklist). Methods: We performed a systematic review of frameworks of determinants of practice followed by a consensus process. We searched electronic databases and screened the reference lists of key background documents. Two authors independently assessed titles and abstracts, and potentially relevant full text articles. We compiled a list of attributes that a checklist should have: comprehensiveness, relevance, applicability, simplicity, logic, clarity, usability, suitability, and usefulness. We assessed included articles using these criteria and collected information about the theory, model, or logic underlying how the factors (determinants) were selected, described, and grouped, the strengths and weaknesses of the checklist, and the determinants and the domains in each checklist. We drafted a preliminary checklist based on an aggregated list of determinants from the included checklists, and finalized the checklist by a consensus process among implementation researchers. Results: We screened 5,778 titles and abstracts and retrieved 87 potentially relevant papers in full text. Several of these papers had references to papers that we also retrieved in full text. We also checked potentially relevant papers we had on file that were not retrieved by the searches. We included 12 checklists. None of these were completely comprehensive when compared to the aggregated list of determinants and domains. We developed a checklist with 57 potential determinants of practice grouped in seven domains: guideline factors, individual health professional factors, patient factors, professional interactions, incentives and resources, capacity for organisational change, and social, political, and legal factors. We also developed five worksheets to facilitate the use of the checklist. Conclusions: Based on a systematic review and a consensus process we developed a checklist that aims to be comprehensive and to build on the strengths of each of the 12 included checklists. The checklist is accompanied with five worksheets to facilitate its use in implementation research and quality improvement projects. ; publishedVersion
INTRODUCTION: Indoor residual spraying (IRS) and insecticide-treated nets (ITNs), two principal malaria control strategies, are similar in cost and efficacy. We aimed to describe recent policy development regarding their use in Mozambique, South Africa and Zimbabwe. METHODS: Using a qualitative case study methodology, we undertook semi-structured interviews of key informants from May 2004 to March 2005, carried out document reviews and developed timelines of key events. We used an analytical framework that distinguished three broad categories: interests, ideas and events. RESULTS: A disparate mix of interests and ideas slowed the uptake of ITNs in Mozambique and Zimbabwe and prevented uptake in South Africa. Most respondents strongly favoured one strategy over the other. In all three countries, national policy makers favoured IRS, and only in Mozambique did national researchers support ITNs. Outside interests in favour of IRS included manufacturers who supplied the insecticides and groups opposing environmental regulation. International research networks, multilateral organizations, bilateral donors and international NGOs supported ITNs. Research evidence, local conditions, logistic feasibility, past experience, reaction to outside ideas, community acceptability, the role of government and NGOs, and harm from insecticides used in spraying influenced the choice of strategy. The end of apartheid permitted a strongly pro-IRS South Africa to influence the region, and in Mozambique and Zimbabwe, floods provided conditions conducive to ITN distribution. CONCLUSIONS: Both IRS and ITNs have a place in integrated malaria vector management, but pro-IRS interests and ideas slowed or prevented the uptake of ITNs. Policy makers needed more than evidence from trials to change from the time-honoured IRS strategy that they perceived was working. Those intending to promote new policies such as ITNs should examine the interests and ideas motivating key stakeholders and their own institutions, and identify where shifts in thinking or coalitions among the like-minded may be possible.
Abstract Background The evidence base for improving reproductive health continues to grow. However, concerns remain that the translation of this evidence into appropriate policies is partial and slow. Little is known about the factors affecting the use of evidence by policy makers and clinicians, particularly in developing countries. The objective of this study was to examine the factors that might affect the translation of randomised controlled trial (RCT) findings into policies and practice in developing countries. Methods The recent publication of an important RCT on the use of magnesium sulphate to treat pre-eclampsia provided an opportunity to explore how research findings might be translated into policy. A range of research methods, including a survey, group interview and observations with RCT collaborators and a survey of WHO drug information officers, regulatory officials and obstetricians in 12 countries, were undertaken to identify barriers and facilitators to knowledge translation. Results It proved difficult to obtain reliable data regarding the availability and use of commonly used drugs in many countries. The perceived barriers to implementing RCT findings regarding the use of magnesium sulphate for pre-eclampsia include drug licensing and availability; inadequate and poorly implemented clinical guidelines; and lack of political support for policy change. However, there were significant regional and national differences in the importance of specific barriers. Conclusion The policy changes needed to ensure widespread availability and use of magnesium sulphate are variable and complex. Difficulties in obtaining information on availability and use are combined with the wide range of barriers across settings, including a lack of support from policy makers. This makes it difficult to envisage any single intervention strategy that might be used to promote the uptake of research findings on magnesium sulphate into policy across the study settings. The publication of important trials may therefore not have the impacts on health care that researchers hope for.
BACKGROUND: The evidence base for improving reproductive health continues to grow. However, concerns remain that the translation of this evidence into appropriate policies is partial and slow. Little is known about the factors affecting the use of evidence by policy makers and clinicians, particularly in developing countries. The objective of this study was to examine the factors that might affect the translation of randomised controlled trial (RCT) findings into policies and practice in developing countries. METHODS: The recent publication of an important RCT on the use of magnesium sulphate to treat pre-eclampsia provided an opportunity to explore how research findings might be translated into policy. A range of research methods, including a survey, group interview and observations with RCT collaborators and a survey of WHO drug information officers, regulatory officials and obstetricians in 12 countries, were undertaken to identify barriers and facilitators to knowledge translation. RESULTS: It proved difficult to obtain reliable data regarding the availability and use of commonly used drugs in many countries. The perceived barriers to implementing RCT findings regarding the use of magnesium sulphate for pre-eclampsia include drug licensing and availability; inadequate and poorly implemented clinical guidelines; and lack of political support for policy change. However, there were significant regional and national differences in the importance of specific barriers. CONCLUSION: The policy changes needed to ensure widespread availability and use of magnesium sulphate are variable and complex. Difficulties in obtaining information on availability and use are combined with the wide range of barriers across settings, including a lack of support from policy makers. This makes it difficult to envisage any single intervention strategy that might be used to promote the uptake of research findings on magnesium sulphate into policy across the study settings. The publication of important trials may therefore not have the impacts on health care that researchers hope for.
BACKGROUND: Pharmaceuticals are important interventions that could improve people's health. Pharmaceutical pricing and purchasing policies are used as cost‐containment measures to determine or affect the prices that are paid for drugs. Internal reference pricing establishes a benchmark or reference price within a country which is the maximum level of reimbursement for a group of drugs. Other policies include price controls, maximum prices, index pricing, price negotiations and volume‐based pricing. OBJECTIVES: To determine the effects of pharmaceutical pricing and purchasing policies on health outcomes, healthcare utilisation, drug expenditures and drug use. SEARCH METHODS: We searched the Cochrane Central Register of Controlled Trials (CENTRAL), part of The Cochrane Library (including the Effective Practice and Organisation of Care Group Register) (searched 22/10/2012); MEDLINE In‐Process & Other Non‐Indexed Citations and MEDLINE, Ovid (searched 22/10/2012); EconLit, ProQuest (searched 22/10/2012); PAIS International, ProQuest (searched 22/10/2012); World Wide Political Science Abstracts, ProQuest (searched 22/10/2012); INRUD Bibliography (searched 22/10/2012); Embase, Ovid (searched 14/12/2010); NHSEED, part of The Cochrane Library (searched 08/12/2010); LILACS, VHL (searched 14/12/2010); International Political Science Abstracts (IPSA), Ebsco (searched (17/12/2010); OpenSIGLE (searched 21/12/10); WHOLIS, WHO (searched 17/12/2010); World Bank (Documents and Reports) (searched 21/12/2010); Jolis (searched 09/10/2011); Global Jolis (searched 09/10/2011) ; OECD (searched 30/08/2005); OECD iLibrary (searched 30/08/2005); World Bank eLibrary (searched 21/12/2010); WHO ‐ The Essential Drugs and Medicines web site (browsed 21/12/2010). SELECTION CRITERIA: Policies in this review were defined as laws; rules; financial and administrative orders made by governments, non‐government organisations or private insurers. To be included a study had to include an objective measure of at least one of the following outcomes: ...