This site uses cookies to store information on your computer. Learn more x


Providing perspectives on recent research into vitamins and nutritionals


Not all Meta-Analyses and Review Papers Adopt the Same Standards

By Michael McBurney

What to believe? Who to trust? Complicated questions with so many available information sources, clamoring for attention. Historically, governments had the last word on nutrition policy but social media is challenging agencies every day.

Because of financial interests, scientific research funded by industry has been viewed suspiciously but people are motivated by many factors other than financial gain. White hat bias is a threat to the integrity of scientific reporting because it distorts interpretation and fuels misunderstanding.

Sometimes research papers are retracted because of errors. Even more unfortunately, some scientists publish faked data.  Fraudulent acts, like those of Andrew Wakefield who altered facts about patients’ medical histories, may have been driven by self-interests to identify a new syndrome.

For this reason, guidance on the proper use of individual participant data (IDP) from controlled trials (RCTs) is important. When reading a meta-analysis of RCTs or any review, these questions should be asked:

  • Is the meta-analysis part of a systematic review? Were all the eligible trials identified?
  • Were IDP obtained from most trials? Was the integrity of the IDP checked?
  • Were the analyses prespecified in detail? Was the risk of bias included trials assessed? Did the authors assess randomization, allocation concealment or blinding? Did the study include result from every randomized participant?
  • Were all relevant outcomes reported? Did the investigators check the quality of time-to-event outcome data?
  • Were the methods of analysis appropriate? Does this extend to overall effects and did they differ by trial or participant characteristics? For example, compliance or nutritional status?

These are important questions. Whether one is assessing the benefits of vitamin D and calcium on bone health or the impact of omega-3 status on heart, eye, or prostate health, it is important to have common assessments of status.

Vitamin D is important for more than bone health. For every 25 nmol/L drop in serum 25-hydroxyvitamin D concentration, Chowdhury and associates reported a 16% increased risk of mortality.  The combination of a SINGLE measure of vitamin D status, serum 25-hydroxyvitamin D, across 73 studies involving 850,000 individuals leads to a strong conclusion.

Contrast this with the situation faced in omega-3 research where there is a lack of standard methodology. A 2015 meta-analysis of prospective RCTs had to rely upon both dietary omega-3 fatty acid intake and blood biomarker data to evaluate the impact of omega-3 fatty acids on prostate cancer risk. Not surprisingly, the 12 RCTs assessing only dietary intake were non-conclusive. A reduced risk of prostate cancer was observed in the 9 biomarker studies measuring blood omega-3 concentrations. However, the fact that the RCTs used different biological measures of omega-3 status (plasma phospholipid (PL) fatty acids, serum PL fatty acids, serum cholesterol fatty acids, and red blood cell membrane fatty acids) undermines the robustness of the conclusion.

As Cope and Allison write, we would benefit from a renewed commitment to faithfulness in research reporting . By following the recommendations of Tierney et al, journal reviewers and editors can apply standards to meta-analyses and decision-makers can better recognize those that are well designed and conducted.

Main Citation

Tierney JF, Vale C, Riley R, Smith CT, Stewart L, Clarke M, Rovers M. Individual participant data (IPD) meta-analyses of randomized controlled trials: Guidance on their use. 2015 PLoSMed doi: 10.1371/journal.pmed.1001855

Other Citations

Cope MB, Allison DB. White hat bias: a threat to the integrity of scientific reporting. 2010 Acta Paediatr doi: 10.1111/j.1651-2227.2010.02006.x

Cope MB, Allison DB. White hat bias: examples of its presence in obesity research and a call for renewed commitment to faithfulness in research reporting. 2010 Int J Obes doi: 10.1038/ijo.2009.239

Alexander DD,  Bassett JK, Weed DL, Barrett EC, Watson H, Harris W. Meta-analysis of long-chain omega-3 polyunsaturated fatty acids (LCω-3PUFA) and prostate cancer. 2015 Nutr Cancer doi: 10.1080/01635581.2105.1015745

Grey A, Bolland M. Web of industry, advocacy, and academia in the management of osteoporosis. 2015 BMJ doi: 10.1136/bmj.h3170

Chowdhury R, Kunutsor S, Vitezova A, et al. Vitamin D and risk of cause specific death: systematic review and meta-analysis of observational cohort and randomised intervention studies. 2014 BMJ doi: 10.1136/bmj.g1903

You are signed in as:
whn May 11, 2017 10:37 AM
Under the snow peak, Zhuo is the lake. "Why? So why do this? I just want to be a mother, want to have a child of their own, but you are not willing to pay, every time you are affixed to the fine do not shoot, God, I hate you! I hate you! You are a ruthless selfish person. "A stunning woman stands in the water naked upper body, while crying while patting the lake, chest full of breasts with the body twist Rhythm of the shaking, emitting a white holy luster. The shore of a Qiu must go back and forth pacing, watching a woman in the water sprinkle soared, heart disgust: "You crazy woman, really want the child to be crazy, two people more comfortable, have children do? "Said the air Xiu Xiu turned away, and ignored the woman's crying. "Trained and trained !!" see her husband and ignore their own to leave alone, the woman heartbroken, crying for a while slowly came to the shore. "Call" Suddenly the lake rises in a bucket-like thick snake tail, snake body up to two scales scales glittering, the woman every step of the chest breast and snake around the swing is really good look, line to the lake only to find this stunning woman Turned out to be the first snake body, upper body naked near ten feet, the snake is more than two feet long, on the shore to drive clouds to the east away. Wanshan ancestors, the top of the Kunlun, jade virtual peak of a Tsing Yi old man sigh: "Oh! And quarreled, and nearly nearly eight thousand eight hundred and thirty back! I was this sister is really hard, married the fool Every day to know what Jiugong gossip, stood such a beautiful wife do not accompany the woman is the need to coax you! You do not have time to accompany her, according to her request to give birth to a child to the companion, but not willing to pay A trace of God, really a stubborn and selfish guy, three days to quarrel, has been quarreling for more than a million years, so when the day is a head ah? "Think of this thing between husband and wife is not easy to intervene , Helplessly shook his head and turned to the hole and walked. Line to the way suddenly paused the body, smile soon as: it seems trouble or come to the door, and want to hide can not hide ah! "Brother!" Midwive came a woman's call, come is just in the lake crying people first snake body stunning woman, the old man has always been feeling that the arrival of those who stopped to wait for. Old man slowly turned the body, asked to smile asked: "Shimei today how free to see my old man? Is not and Fuxi quarreled?" Women down the cloud Jiao Jiao said: "Brother, I am not a special trip to To see you, nor to listen to you say that thousands of times all the way, I just come to you to help find a child's way. "" What is the way to find my child! "Old man at the foot of a staggering," Shimei You still bypass my old bones it! If it was Fuxi know that it is not Grilled my skin. "The old man frightened, hand pendulum and rattle like. Woman's face crimson, snapped: "Brother, where do you want to go! Old right! I just come to you to find a child's magic, not to say that you and that ... ..." "What Old man gas beard Alice, Long said: "chaos beginning to this point, I have lived for three million years, and now alone or alone in vain, you! You actually said that I am not serious "The old man angry big sleeves flushed back, the woman was covered with" Puchi "smile. The original, the chaos opened to the beginning of this also five people, they are Hongjun, Pangu, Nu Wa, Pan Xing, Fu Xi, because Hongjun is the birth of the first world of wisdom, behind a few people more or less Have been educated by Hongjun, so everyone is consistent with the Hongjun respect for the big brother. Later Pangu and the plate Xing two fight for the brother of a war, then that war to play the darkness, broken mountains and rivers, sun and the moon without light, the final panic body into a towering Kunlun will be calm in the abyss, can be described as a lose-lose The Now this world also Hongjun, Nu Wa, Fu Xi three, this old man is Hongjun, the first snake body of the woman is of course Nu Wa. So this Hongjun think not single is immune, Nu Wa is laughing for this
0 Replies » Reply