Research & Advocacy

The HCV Synthesis Project: Scope, methodology, and preliminary results

BMC Medical Research Methodology - Sat, 13/09/2008 - 23:00
Background: The hepatitis C virus (HCV) is hyper-endemic in injecting drug users. There is also excess HCV among non-injection drug users who smoke, snort, or sniff heroin, cocaine, crack, or methamphetamine. Methods: To summarize the research literature on HCV in drug users and identify gaps in knowledge, we conducted a synthesis of the relevant research carried out between 1989 and 2006. Using rigorous search methods, we identified and extracted data from published and unpublished reports of HCV among drug users. We designed a quality assurance system to ensure accuracy and consistency in all phases of the project. We also created a set of items to assess study design quality in each of the reports we included. Results: We identified 629 reports containing HCV prevalence rates, incidence rates and/or genotype distribution among injecting or non-injecting drug user populations published between January 1989 and December 2006. The majority of reports were from Western Europe (41%), North America (26%), Asia (11%) and Australia/New Zealand (10%). We also identified reports from Eastern Europe, South America, the Middle East, and the Caribbean. The number of publications reporting HCV rates in drug users increased dramatically between 1989 and 2006 to 27-52 reports per year after 1998. Conclusions: The data collection and quality assurance phases of the HCV Synthesis Project have been completed. Recommendations for future research on HCV in drug users have come out of our data collection phase. Future research reports can enhance their contributions to our understanding of HCV etiology by clearly defining their drug user participants with respect to type of drug and route of administration. Further, the use of standard reporting methods for risk factors would enable data to be combined across a larger set of studies; this is especially important for HCV seroconversion studies which suffer from small sample sizes and low power to examine risk factors.

Data management for prospective research studies using SAS software

BMC Medical Research Methodology - Wed, 10/09/2008 - 23:00
Background: Maintaining data quality and integrity is important for research studies involving prospective data collection. Data must be entered, erroneous or missing data must be identified and corrected if possible, and an audit trail created. Methods: Using as an example a large prospective study, the Missouri Lower Respiratory Infection (LRI) Project, we present an approach to data management predominantly using SAS software. The Missouri LRI Project was a prospective cohort study of nursing home residents who developed an LRI. Subjects were enrolled, data collected, and follow-ups occurred for over three years. Data were collected on twenty different forms. Forms were inspected visually and sent off-site for data entry. SAS software was used to read the entered data files, check for potential errors, apply corrections to data sets, and combine batches into analytic data sets. The data management procedures are described. Results: Study data collection resulted in over 20,000 completed forms. Data management was successful, resulting in clean, internally consistent data sets for analysis. The amount of time required for data management was substantially underestimated. Conclusions: Data management for prospective studies should be planned well in advance of data collection. An ongoing process with data entered and checked as they become available allows timely recovery of errors and missing data.

The challenges of corruption in the water sector

Influencing Policy (Eldis) - Wed, 10/09/2008 - 18:40
Divided into three parts, this collaborative work looks at the varied challenges brought about as a result of corruption in the water sector. It also ...

Industry-supported meta-analyses compared with meta-analyses with non-profit or no support: Differences in methodological quality and conclusions

BMC Medical Research Methodology - Mon, 08/09/2008 - 23:00
Background: Studies have shown that industry-sponsored meta-analyses of drugs lack scientific rigour and have biased conclusions. However, these studies have been restricted to certain medical specialities. We compared all industry-supported meta-analyses of drug-drug comparisons with those without industry support. Methods: We searched PubMed for all meta-analyses that compared different drugs or classes of drugs published in 2004. Two authors assessed the meta-analyses and independently extracted data. We used a validated scale for judging the methodological quality and a binary scale for judging conclusions. We divided the meta-analyses according to the type of support in 3 categories: industry-supported, non-profit support or no support, and undeclared support. Results: We included 39 meta-analyses. Ten had industry support, 18 non-profit or no support, and 11 undeclared support. On a 0-7 scale, the median quality score was 6 for meta-analyses with non-profit or no support and 2.5 for the industry-supported meta-analyses (P < 0.01). Compared with industry-supported meta-analyses, more meta-analyses with non-profit or no support avoided bias in the selection of studies (P = 0.01), more often stated the search methods used to find studies (P = 0.02), searched comprehensively (P < 0.01), reported criteria for assessing the validity of the studies (P = 0.02), used appropriate criteria (P = 0.04), described methods of allocation concealment (P = 0.05), described methods of blinding (P = 0.05), and described excluded patients (P = 0.08) and studies (P = 0.15). Forty percent of the industry-supported meta-analyses recommended the experimental drug without reservations, compared with 22% of the meta-analyses with non-profit or no support (P = 0.57). In a sensitivity analysis, we contacted the authors of the meta-analyses with undeclared support. Eight who replied that they had not received industry funding were added to those with non-profit or no support, and 3 who did not reply were added to those with industry support. This analysis did not change the results much. Conclusions: Transparency is essential for readers to make their own judgment about medical interventions guided by the results of meta-analyses. We found that industry-supported meta-analyses are less transparent than meta-analyses with non-profit support or no support.

Industry-supported meta-analyses compared with meta-analyses with non-profit or no support: Differences in methodological quality and conclusions

BMC Medical Research Methodology - Mon, 08/09/2008 - 23:00
Background: Studies have shown that industry-sponsored meta-analyses of drugs lack scientific rigour and have biased conclusions. However, these studies have been restricted to certain medical specialities. We compared all industry-supported meta-analyses of drug-drug comparisons with those without industry support. Methods: We searched PubMed for all meta-analyses that compared different drugs or classes of drugs published in 2004. Two authors assessed the meta-analyses and independently extracted data. We used a validated scale for judging the methodological quality and a binary scale for judging conclusions. We divided the meta-analyses according to the type of support in 3 categories: industry-supported, non-profit support or no support, and undeclared support. Results: We included 39 meta-analyses. Ten had industry support, 18 non-profit or no support, and 11 undeclared support. On a 0-7 scale, the median quality score was 6 for meta-analyses with non-profit or no support and 2.5 for the industry-supported meta-analyses (P < 0.01). Compared with industry-supported meta-analyses, more meta-analyses with non-profit or no support avoided bias in the selection of studies (P = 0.01), more often stated the search methods used to find studies (P = 0.02), searched comprehensively (P < 0.01), reported criteria for assessing the validity of the studies (P = 0.02), used appropriate criteria (P = 0.04), described methods of allocation concealment (P = 0.05), described methods of blinding (P = 0.05), and described excluded patients (P = 0.08) and studies (P = 0.15). Forty percent of the industry-supported meta-analyses recommended the experimental drug without reservations, compared with 22% of the meta-analyses with non-profit or no support (P = 0.57). In a sensitivity analysis, we contacted the authors of the meta-analyses with undeclared support. Eight who replied that they had not received industry funding were added to those with non-profit or no support, and 3 who did not reply were added to those with industry support. This analysis did not change the results much. Conclusions: Transparency is essential for readers to make their own judgment about medical interventions guided by the results of meta-analyses. We found that industry-supported meta-analyses are less transparent than meta-analyses with non-profit support or no support.

Alternative regression models to assess increase in childhood BMI

BMC Medical Research Methodology - Sun, 07/09/2008 - 23:00
Background: Body mass index (BMI) data usually have skewed distributions, for which common statistical modeling approaches such as simple linear or logistic regression have limitations. Methods: Different regression approaches to predict childhood BMI by goodness-of-fit measures and means of interpretation were compared including generalized linear models (GLMs), quantile regression and Generalized Additive Models for Location, Scale and Shape (GAMLSS). We analyzed data of 4967 children participating in the school entry health examination in Bavaria, Germany, from 2001 to 2002. TV watching, meal frequency, breastfeeding, smoking in pregnancy, maternal obesity, parental social class and weight gain in the first 2 years of life were considered as risk factors for obesity. Results: GAMLSS showed a much better fit regarding the estimation of risk factors effects on transformed and untransformed BMI data than common GLMs with respect to the generalized Akaike information criterion. In comparison with GAMLSS, quantile regression allowed for additional interpretation of prespecified distribution quantiles, such as quantiles referring to overweight or obesity. The variables TV watching, maternal BMI and weight gain in the first 2 years were directly, and meal frequency was inversely significantly associated with body composition in any model type examined. In contrast, smoking in pregnancy was not directly, and breastfeeding and parental social class were not inversely significantly associated with body composition in GLM models, but in GAMLSS and partly in quantile regression models. Risk factor specific BMI percentile curves could be estimated from GAMLSS and quantile regression models. Conclusions: GAMLSS and quantile regression seem to be more appropriate than common GLMs for risk factor modeling of BMI data.

Alternative regression models to assess increase in childhood BMI

BMC Medical Research Methodology - Sun, 07/09/2008 - 23:00
Background: Body mass index (BMI) data usually have skewed distributions, for which common statistical modeling approaches such as simple linear or logistic regression have limitations. Methods: Different regression approaches to predict childhood BMI by goodness-of-fit measures and means of interpretation were compared including generalized linear models (GLMs), quantile regression and Generalized Additive Models for Location, Scale and Shape (GAMLSS). We analyzed data of 4967 children participating in the school entry health examination in Bavaria, Germany, from 2001 to 2002. TV watching, meal frequency, breastfeeding, smoking in pregnancy, maternal obesity, parental social class and weight gain in the first 2 years of life were considered as risk factors for obesity. Results: GAMLSS showed a much better fit regarding the estimation of risk factors effects on transformed and untransformed BMI data than common GLMs with respect to the generalized Akaike information criterion. In comparison with GAMLSS, quantile regression allowed for additional interpretation of prespecified distribution quantiles, such as quantiles referring to overweight or obesity. The variables TV watching, maternal BMI and weight gain in the first 2 years were directly, and meal frequency was inversely significantly associated with body composition in any model type examined. In contrast, smoking in pregnancy was not directly, and breastfeeding and parental social class were not inversely significantly associated with body composition in GLM models, but in GAMLSS and partly in quantile regression models. Risk factor specific BMI percentile curves could be estimated from GAMLSS and quantile regression models. Conclusions: GAMLSS and quantile regression seem to be more appropriate than common GLMs for risk factor modeling of BMI data.

Key lessons for up-scaling and out-scaling of DFID research

Influencing Policy (Eldis) - Thu, 21/08/2008 - 11:24
This report consists of a series of short syntheses which bring together key lessons for up-scaling and out-scaling research based on 19 key reviews, ...

Pooling overdispersed binomial data to estimate event rate

BMC Medical Research Methodology - Mon, 18/08/2008 - 23:00
Background: The beta-binomial model is one of the methods that can be used to validly combine event rates from overdispersed binomial data. Our objective is to provide a full description of this method and to update and broaden its applications in clinical and public health research. Methods: We describe the statistical theories behind the beta-binomial model and the associated estimation methods. We supply information about statistical software that can provide beta-binomial estimations. Using a published example, we illustrate the application of the beta-binomial model when pooling overdispersed binomial data. Results: In an example regarding the safety of oral antifungal treatments, we had 41 treatment arms with event rates varying from 0% to 13.89%. Using the beta-binomial model, we obtained a summary event rate of 3.44% with a standard error of 0.59%. The parameters of the beta-binomial model took the values of 1.24 for alpha and 34.73 for beta. Conclusions: The beta-binomial model can provide a robust estimate for the summary event rate by pooling overdispersed binomial data from different studies. The explanation of the method and the demonstration of its applications should help researchers incorporate the beta-binomial method as they aggregate probabilities of events from heterogeneous studies.

Communicating for sustainable development

Influencing Policy (Eldis) - Mon, 18/08/2008 - 09:12
Media, no matter how technologically advanced, messages, no matter how skillfully packaged, and information, no matter how relevant, are not enough ...

Sampling 'hard-to-reach' populations in health research: yield from a study targeting Americans living in Canada

BMC Medical Research Methodology - Sun, 17/08/2008 - 23:00
Background: Some populations targeted in survey research can be hard to reach, either because of lack of contact information, or non-existent databases to inform sampling. Here, we present a methodological "case-report" of the yield of a multi-step survey study assessing views on health care among American emigres to Canada, a hard-to-reach population. Methods: To sample this hard-to-reach population, we held a live media conference, supplemented by a nation-wide media release announcing the study. We prepared an 'op-ed' piece describing the study and how to participate. We paid for advertisements in 6 newspapers. We sent the survey information to targeted organizations. And lastly, we asked those who completed the web survey to send the information to others. We use descriptive statistics to document the method's yield. Results: The combined media strategies led to 4 television news interviews, 10 newspaper stories, 1 editorial and 2 radio interviews. 458 unique individuals accessed the on-line survey, among whom 310 eligible subjects provided responses to the key study questions. Fifty-six percent reported that they became aware of the survey via media outlets, 26 percent by word of mouth, and 9 percent through both the media and word of mouth. Conclusions: Our multi-step communication method yielded a sufficient sample of Americans living in Canada. This combination of paid and unpaid media exposure can be considered by others as a unique methodological approach to identifying and sampling hard-to-reach populations.

Performing meta-analysis with incomplete statistical information in clinical trials

BMC Medical Research Methodology - Sun, 17/08/2008 - 23:00
Background: Results from clinical trials are usually summarized in the form of sampling distributions. When full information (mean, SEM) about these distributions is given, performing meta-analysis is straightforward. However, when some of the sampling distributions only have mean values, a challenging issue is to decide how to use such distributions in meta-analysis. Currently, the most common approaches are either ignoring such trials or for each trial with a missing SEM, finding a similar trial and taking its SEM value as the missing SEM. Both approaches have drawbacks. As an alternative, this paper develops and tests two new methods, the first being the prognostic method and the second being the interval method, to estimate any missing SEMs from a set of sampling distributions with full information. A merging method is also proposed to handle clinical trials with partial information to simulate meta-analysis. Methods: Both of our methods use the assumption that the samples for which the sampling distributions will be merged are randomly selected from the same population. In the prognostic method, we predict the missing SEMs from the given SEMs. In the interval method, we define intervals that we believe will contain the missing SEMs and then we use these intervals in the merging process. Results: Two sets of clinical trials are used to verify our methods. One family of trials is on comparing different drugs for reduction of low density lipprotein cholesterol (LDL) for Type-2 diabetes, and the other is about the effectiveness of drugs for lowering intraocular pressure (IOP). Both methods are shown to be useful for approximating the conventional meta-analysis including trials with incomplete information. For example, the meta-analysis result of Latanoprost versus Timolol on IOP reduction for six months provided in [1] was 5:05+/-1.15 (Mean+/-SEM) with full information. If the last trial in this study is assumed to be with partial information, the traditional analysis method for dealing with incomplete information that ignores this trial would give 6:49 +/- 1:36 while our prognostic method gives 5:02+/-1.15, and our interval method provides two intervals as Mean [4:25; 5:63] and SEM [1:01; 1:24]. Conclusions: Both the prognostic and the interval methods are useful alternatives for dealing with missing data in meta-analysis. We recommend clinicians to use the prognostic method to predict the missing SEMs in order to perform meta-analysis and the interval method for obtaining a more cautious result.

Managing water reserves in the North-western Sahara aquifer system

Influencing Policy (Eldis) - Fri, 15/08/2008 - 12:18
The North-western Sahara aquifer system (NWSAS) shared by Algeria, Libya and Tunisia contains considerable water reserves; however, it is largely unrenewable ...

Engaging participants in a complex intervention trial in Australian General Practice

BMC Medical Research Methodology - Tue, 12/08/2008 - 23:00
Background: The paper examines the key issues experienced in recruiting and retaining practice involvement in a large complex intervention trial in Australian General Practice Methods: Reflective notes made by research staff and telephone interviews with staff from general practices which expressed interest, took part or withdrew from a trial of a complex general practice intervention. Results: Recruitment and retention difficulties were due to factors inherent in the demands and context of general practice, the degree of engagement of primary care organisations (Divisions of General Practice), perceived benefits by practices, the design of the trial and the timing and complexity of data collection, Conclusions: There needs to be clearer articulation to practices of the benefits of the research to participants and streamlining of the design and processes of data collection and intervention to fit in with their work practices. Ultimately deeper engagement may require additional funding and ongoing participation through practice research networks. Current Controlled Trials ACTRN12605000788673

Non-response to a life course socioeconomic position indicator in surveillance: comparison of telephone and face-to-face modes

BMC Medical Research Methodology - Tue, 12/08/2008 - 23:00
Background: Measurement of socioeconomic position (SEP) over the life course in population health surveillance systems is important for examining differences in health and illness between different population groups and for monitoring the impact of policies and interventions aimed at reducing health inequities and intergenerational disadvantage over time. While face-to-face surveys are considered the gold standard of interviewing techniques, computer-assisted telephone interviewing is often preferred for cost and convenience. This study compared recall of parents' highest level of education in telephone and face-to-face surveys. Methods: Questions about father's and mother's highest education level were included in two representative population health surveys of South Australians aged 18 years and over in Spring 2004. A random sample selected from the electronic white pages (EWP) responded to a computer-assisted telephone interview (n=2999), and a multistage clustered area sample responded to a face-to-face interview (n=2893). A subsample of respondents in the face-to-face sample who owned a telephone that was listed in the EWP (n=2206) was also compared to the telephone interview sample. Results: The proportion of respondents who provided information about their father's and mother's highest education level was significantly higher in the face-to-face interview (86.3% and 87.8%, respectively) than in the telephone interview (80.4% and 79.9%, respectively). Recall was also significantly higher in the subsample of respondents in the face-to-face interview who had a telephone that was listed in the EWP. Those with missing data for parents' education were more likely to be socioeconomically disadvantaged regardless of the survey mode. Conclusions: While face-to-face interviewing obtained higher item response rates for questions about parents' education, survey mode did not appear to influence the factors associated with having missing data on father's or mother's highest education level.

Why are local people often resistant to conservation efforts?

Influencing Policy (Eldis) - Tue, 12/08/2008 - 16:28
This paper presents a framework to understand how conservation is resisted, particularly in protected areas and national parks. Informed largely ...

An overview of decision-making on sustainable developent in Africa

Influencing Policy (Eldis) - Mon, 11/08/2008 - 14:41
The African Ministerial Conference on the Environment (AMCEN) is the primary ministerial level forum for environment and development issues in Africa. ...

The efficiency and effectiveness of utilizing diagrams in interviews: an assessment of participatory diagramming and graphic elicitation

BMC Medical Research Methodology - Thu, 07/08/2008 - 23:00
Background: This paper focuses on measuring the efficiency and effectiveness of two diagramming methods employed in key informant interviews with clinicians and health care administrators. The two methods are 'participatory diagramming', where the respondent creates a diagram that assists in their communication of answers, and 'graphic elicitation', where a researcher-prepared diagram is used to stimulate data collection. Methods: These two diagramming methods were applied in key informant interviews and their value in efficiently and effectively gathering data was assessed based on quantitative measures and qualitative observations. Results: Assessment of the two diagramming methods suggests that participatory diagramming is an efficient method for collecting data in graphic form, but may not generate the depth of verbal response that many qualitative researchers seek. In contrast, graphic elicitation was more intuitive, better understood and preferred by most respondents, and often provided more contemplative verbal responses, however this was achieved at the expense of more interview time. Conclusions: Diagramming methods are important for eliciting interview data that are often difficult to obtain through traditional verbal exchanges. Subject to the methodological limitations of the study, our findings suggest that while participatory diagramming and graphic elicitation have specific strengths and weaknesses, their combined use can provide complementary information that would not likely occur with the application of only one diagramming method. The methodological insights gained by examining the efficiency and effectiveness of these diagramming methods in our study should be helpful to other researchers considering their incorporation into qualitative research designs.

Regression toward the mean - a detection method for unknown population mean based on Mee and Chua's algorithm

BMC Medical Research Methodology - Wed, 06/08/2008 - 23:00
Background: Regression to the mean (RTM) occurs in situations of repeated measurements when extreme values are followed by measurements in the same subjects that are closer to the mean of the basic population. In uncontrolled studies such changes are likely to be interpreted as a real treatment effect. Methods: Several statistical approaches have been developed to analyse such situations, including the algorithm of Mee and Chua which assumes a known population mean mu. We extend this approach to a situation where mu is unknown and suggest to vary it systematically over a range of reasonable values. Using differential calculus we provide formulas to estimate the range of mu where treatment effects are likely to occur when RTM is present. Results: We successfully applied our method to three real world examples denoting situations when (a) no treatment effect can be confirmed regardless which mu is true, (b) when a treatment effect must be assumed independent from the true mu and (c) in the appraisal of results of uncontrolled studies. Conclusions: Our method can be used to separate the wheat from the chaff in situations, when one has to interpret the results of uncontrolled studies. In meta-analysis, health-technology reports or systematic reviews this approach may be helpful to clarify the evidence given from uncontrolled observational studies.

Correspondence Experiences of a long-term randomized controlled prevention trial in a maiden environment: Estonian Postmenopausal Hormone Therapy trial [ISRCTN35338757].

BMC Medical Research Methodology - Thu, 31/07/2008 - 23:00
Background: Preventive drugs require long-term trials to show their effectiveness or harms and often a lot of changes occur during post-marketing studies. The purpose of this article is to describe the research process in a long-term randomized controlled trial and discuss the impact and consequences of changes in the research environment. Methods: The Estonian Postmenopausal Hormone Therapy trial (EPHT), originally planned to continue for five years, was planned in co-operation with the Women's International Study of Long-Duration Oestrogen after Menopause (WISDOM) in the UK. In addition to health outcomes, EPHT was specifically designed to study the impact of postmenopausal hormone therapy (HT) on health services utilization. Results: After EPHT recruited in 1999-2001 the Women's Health Initiative (WHI) in the USA decided to stop the estrogen-progestin trial after a mean of 5.2 years in July 2002 because of increased risk of breast cancer and later in 2004 the estrogen-only trial because HT increased the risk of stroke, decreased the risk of hip fracture, and did not affect coronary heart disease incidence. WISDOM was halted in autumn 2002. These decisions had a major influence on EPHT. Conclusions: Changes in Estonian society challenged EPHT to find a balance between the needs of achieving responses to the trial aims with a limited budget and simultaneously maintaining the safety of trial participants. Flexibility was the main key for success. Rapid changes are not limited only to transiting societies but are true also in developed countries and the risk must be included in planning all long-term trials. The role of ethical and data monitoring committees in situations with emerging new data from other studies needs specification. Longer funding for preventive trials and more flexibility in budgeting are mandatory. Who should prove the effectiveness of an (old) drug for a new preventive indication? In preventive drug trials companies may donate drugs but they take a financial risk, especially with licensed drugs. Public funding is crucial to avoid commercial biases. Legislation to share the costs of large post-marketing trials as well as regulation of manufacturer's participation is needed. [ISRCTN35338757]
Syndicate content