{"id":4051,"date":"2014-07-15T12:18:18","date_gmt":"2014-07-15T18:18:18","guid":{"rendered":"http:\/\/minkhollow.ca\/beckerblog\/?p=4051"},"modified":"2014-08-10T15:02:25","modified_gmt":"2014-08-10T21:02:25","slug":"plos-medicine-why-most-published-research-findings-are-false","status":"publish","type":"post","link":"http:\/\/minkhollow.ca\/beckerblog\/2014\/07\/15\/plos-medicine-why-most-published-research-findings-are-false\/","title":{"rendered":"PLOS Medicine: Why Most Published Research Findings Are False"},"content":{"rendered":"<span class=\"span-reading-time rt-reading-time\" style=\"display: block;\"><span class=\"rt-label rt-prefix\">Approximate Reading Time: <\/span> <span class=\"rt-time\"> &lt; 1<\/span> <span class=\"rt-label rt-postfix\">minute<\/span><\/span><p><a href=\"http:\/\/www.plosmedicine.org\/article\/info%3Adoi\/10.1371\/journal.pmed.0020124\">PLOS Medicine: Why Most Published Research Findings Are False<\/a>.<\/p>\n<p><span class=\"author no_author_meta\"> <span class=\"person\"> John P. A. Ioannidis<\/span><\/span>,\u00a0 Published: August 30, 2005<br \/>\nDOI: 10.1371\/journal.pmed.0020124<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignright\" src=\"http:\/\/www.plosmedicine.org\/article\/fetchObject.action?uri=info:doi\/10.1371\/journal.pmed.0020124.g001&amp;representation=PNG_I\" alt=\"\" width=\"320\" height=\"714\" \/>Interesting.<\/p>\n<blockquote><p>There is increasing concern that most current published research findings are false. The probability that a research claim is true may depend on study power and bias, the number of other studies on the same question, and, importantly, the ratio of true to no relationships among the relationships probed in each scientific field. In this framework, a research finding is less likely to be true when the studies conducted in a field are smaller; when effect sizes are smaller; when there is a greater number and lesser preselection of tested relationships; where there is greater flexibility in designs, definitions, outcomes, and analytical modes; when there is greater financial and other interest and prejudice; and when more teams are involved in a scientific field in chase of statistical significance. Simulations show that for most study designs and settings, it is more likely for a research claim to be false than true. Moreover, for many current scientific fields, claimed research findings may often be simply accurate measures of the prevailing bias. In this essay, I discuss the implications of these problems for the conduct and interpretation of research.<\/p><\/blockquote>\n<div class='wp_likes' id='wp_likes_post-4051'><a class='like' href=\"javascript:wp_likes.like(4051);\" title='' ><img decoding=\"async\" src=\"http:\/\/minkhollow.ca\/beckerblog\/wp-content\/plugins\/wp-likes\/images\/like.png\" alt='' border='0'\/><\/a><span class='text'>Be the first to like.<\/span><\/p>\n<div class='like' ><a href=\"javascript:wp_likes.like(4051);\">Like<\/a><\/div>\n<div class='unlike' ><a href=\"javascript:wp_likes.unlike(4051);\">Unlike<\/a><\/div>\n<\/div>\n","protected":false},"excerpt":{"rendered":"<p><span class=\"span-reading-time rt-reading-time\" style=\"display: block;\"><span class=\"rt-label rt-prefix\">Approximate Reading Time: <\/span> <span class=\"rt-time\"> &lt; 1<\/span> <span class=\"rt-label rt-postfix\">minute<\/span><\/span>PLOS Medicine: Why Most Published Research Findings Are False. John P. A. Ioannidis,\u00a0 Published: August 30, 2005 DOI: 10.1371\/journal.pmed.0020124 Interesting. There is increasing concern that most current published research findings are false. The probability that a research claim is true &hellip; <a class=\"more-link\" href=\"http:\/\/minkhollow.ca\/beckerblog\/2014\/07\/15\/plos-medicine-why-most-published-research-findings-are-false\/\">Continue reading <span class=\"meta-nav\">&rarr;<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2},"jetpack_post_was_ever_published":false},"categories":[14],"tags":[204,212,80],"class_list":["post-4051","post","type-post","status-publish","format-standard","hentry","category-general","tag-bad-science","tag-research","tag-science"],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","jetpack_shortlink":"https:\/\/wp.me\/p4Hsb6-13l","jetpack_sharing_enabled":true,"jetpack-related-posts":[{"id":4276,"url":"http:\/\/minkhollow.ca\/beckerblog\/2015\/07\/12\/on-repeatability-and-educational-research\/","url_meta":{"origin":4051,"position":0},"title":"On Repeatability and Educational Research","author":"Katrin Becker","date":"July 12, 2015","format":false,"excerpt":"Came across this a while back (OK, it was nearly a year a go)\u00a0which sparked a rather strong reaction from a fellow educationalist.\u00a0I don't want to make it personal, so\u00a0I'm just going to relay the exchange, as I think it is representative of the views of\u00a0a lot of education faculty.\u2026","rel":"","context":"In &quot;Academia&quot;","block_context":{"text":"Academia","link":"http:\/\/minkhollow.ca\/beckerblog\/category\/academia\/"},"img":{"alt_text":"New Cloning Machine  by KepowOb","src":"https:\/\/i0.wp.com\/minkhollow.ca\/beckerblog\/wp-content\/uploads\/2014\/08\/New-Cloning-Machine-by-KepowOb-300x224.png?resize=350%2C200","width":350,"height":200},"classes":[]},{"id":4628,"url":"http:\/\/minkhollow.ca\/beckerblog\/2014\/12\/31\/peer-review-could-reject-breakthrough-manuscripts-study-shows\/","url_meta":{"origin":4051,"position":1},"title":"Peer review could reject breakthrough manuscripts, study shows","author":"Katrin Becker","date":"December 31, 2014","format":false,"excerpt":"Peer review could reject breakthrough manuscripts, study shows. The peer review system serves as a gatekeeping system for scientific research, designed to ensure the publication of only the most well researched studies with the most important findings. Scientists depend on publication of their research in peer reviewed journals for career\u2026","rel":"","context":"In &quot;Academia&quot;","block_context":{"text":"Academia","link":"http:\/\/minkhollow.ca\/beckerblog\/category\/academia\/"},"img":{"alt_text":"My father's Hermes. Bought sometime in the 1950's.","src":"https:\/\/i0.wp.com\/minkhollow.ca\/beckerblog\/wp-content\/uploads\/2011\/03\/IMG_0516b-300x225.jpg?resize=350%2C200","width":350,"height":200},"classes":[]},{"id":3380,"url":"http:\/\/minkhollow.ca\/beckerblog\/2013\/05\/05\/gender-bias-found-in-how-graduate-students-review-scientific-studies-computing-education-blog\/","url_meta":{"origin":4051,"position":2},"title":"Gender Bias Found in How Graduate Students Review Scientific Studies | Computing Education Blog","author":"Katrin Becker","date":"May 5, 2013","format":false,"excerpt":"Gender Bias Found in How Graduate Students Review Scientific Studies | Computing Education Blog. Looks like we still have a ways to go.... From Mark Guzdial's Blog: We\u2019ve heard stories like this before, about the implicit bias in how STEM professionals are judged. \u00a0This one is striking because the participants\u2026","rel":"","context":"In &quot;Educational Technology&quot;","block_context":{"text":"Educational Technology","link":"http:\/\/minkhollow.ca\/beckerblog\/category\/educational-technology\/"},"img":{"alt_text":"2013-02-19 @11-36-04","src":"https:\/\/i0.wp.com\/minkhollow.ca\/beckerblog\/wp-content\/uploads\/2013\/05\/2013-02-19-%4011-36-04-300x225.jpg?resize=350%2C200","width":350,"height":200},"classes":[]},{"id":3873,"url":"http:\/\/minkhollow.ca\/beckerblog\/2014\/05\/31\/where-ive-been-online-may-31-2014\/","url_meta":{"origin":4051,"position":3},"title":"Canine hip dysplasia genes identified","author":"Katrin Becker","date":"May 31, 2014","format":false,"excerpt":"Canine hip dysplasia genes identified \"Canine hip dysplasia (CHD) plays a central role in the selection of breeding animals ever since modern dog breeding began. This inherited condition is common in all dog breeds as well as in mongrels. Researchers at the Institute for Animal Breeding and Genetics at the\u2026","rel":"","context":"In &quot;General&quot;","block_context":{"text":"General","link":"http:\/\/minkhollow.ca\/beckerblog\/category\/general\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":2997,"url":"http:\/\/minkhollow.ca\/beckerblog\/2012\/10\/14\/theories-of-games-and-interaction-for-design-6-3-responses\/","url_meta":{"origin":4051,"position":4},"title":"Theories of Games and Interaction for Design (6: 3 Responses)","author":"Katrin Becker","date":"October 14, 2012","format":false,"excerpt":"These are public postings of my writings for the first course of the Graduate Certificate Program in Serious Game Design and Research at Michigan State University. Each week, we are required to post three responses\/reactions to queries posted by other members of the class in the previous week. These are\u2026","rel":"","context":"In &quot;Educational Technology&quot;","block_context":{"text":"Educational Technology","link":"http:\/\/minkhollow.ca\/beckerblog\/category\/educational-technology\/"},"img":{"alt_text":"","src":"http:\/\/upload.wikimedia.org\/wikipedia\/en\/2\/21\/Metroidprime3_1.png","width":350,"height":200},"classes":[]},{"id":3262,"url":"http:\/\/minkhollow.ca\/beckerblog\/2013\/01\/09\/what-happens-when-professionals-take-on-line-cs-classes-when-life-and-learning-do-not-fit-computing-education-blog\/","url_meta":{"origin":4051,"position":5},"title":"What happens when professionals take on-line CS classes: When Life and Learning Do Not Fit \u00ab Computing Education Blog","author":"Katrin Becker","date":"January 9, 2013","format":false,"excerpt":"Another great bit of info from Mark Guzdial's blog: Home About Computing Education BlogWhat happens when professionals take on-line CS classes: When Life and Learning Do Not FitJanuary 9, 2013 at 9:46 am Leave a comment The journal article on the research that Klara Benda, Amy Bruckman, and I did\u2026","rel":"","context":"In &quot;Computers&quot;","block_context":{"text":"Computers","link":"http:\/\/minkhollow.ca\/beckerblog\/category\/computers-2\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]}],"jetpack_likes_enabled":true,"_links":{"self":[{"href":"http:\/\/minkhollow.ca\/beckerblog\/wp-json\/wp\/v2\/posts\/4051","targetHints":{"allow":["GET"]}}],"collection":[{"href":"http:\/\/minkhollow.ca\/beckerblog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/minkhollow.ca\/beckerblog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/minkhollow.ca\/beckerblog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/minkhollow.ca\/beckerblog\/wp-json\/wp\/v2\/comments?post=4051"}],"version-history":[{"count":3,"href":"http:\/\/minkhollow.ca\/beckerblog\/wp-json\/wp\/v2\/posts\/4051\/revisions"}],"predecessor-version":[{"id":4054,"href":"http:\/\/minkhollow.ca\/beckerblog\/wp-json\/wp\/v2\/posts\/4051\/revisions\/4054"}],"wp:attachment":[{"href":"http:\/\/minkhollow.ca\/beckerblog\/wp-json\/wp\/v2\/media?parent=4051"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/minkhollow.ca\/beckerblog\/wp-json\/wp\/v2\/categories?post=4051"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/minkhollow.ca\/beckerblog\/wp-json\/wp\/v2\/tags?post=4051"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}