Reproducibility and robustness of economics and political science research

• Authors: BRODEUR Abel; MIKOLA Derek; COOK Nikolai; FIALA Lenka; BRAILEY Thomas; BRIGGS Ryan; DE GENDRE Alexandra; DUPRAZ Yannick; GABANI Jacopo; GAURIOT Romain; HADDAD Joanne; LIMA Goncalo; ANKEL-PETERS Jörg; DREBER Anna; CAMPBELL Douglas; KATTAN Lamis; MARINO FAGES Diego; MIERISCH Fabian; SUN Pu; WRIGHT Taylor; CONNOLLY Marie; HOCES DE LA GUARDIA Fernando; JOHANNESSON Magnus; MIGUEL Edward; VILHUBER Lars; ABARCA Alejandro; ACHARYA Mahesh; ADJISSE Sossou Simplice; AKHTAR Ahwaz; RAMIREZ LIZARDI Eduardo Alberto; ALBRECHT Sabina; ANDERSEN Synove Nygaard; ANDLIB Zubaria; ARRORA Falak; ASH Thomas; BACHER Etienne; BACHLER Sebastian; BACON Félix; BAGUES Manuel; BALOGH Timea; BATMANOV Alisher; BARSCHKETT Mara; BASDIL Bariş Kaan; BAXA Jaromír; BECKER Sascha O.; BEEDER Monica; BELAND Louis-Philippe; BELLO Abdel-Hamid; MARKOVITS Daniel Benenson; BENJAMIN Grant; BERGERON Thomas; BLIMPO Moussa P.; BINETTI Marco; BONANDER Carl; BONNEAU Joseph; BORBÁTH Endre; BORGEN Nicolai; BORGEN Solveig Topstad; BOROWSKY Jonathan; BRINI Elisa; BROWN Myriam; BRUN Martin; BRUNS Stephan; BULISKERIA Nino; CALEF Andrea; CAMERON Alistair; CAMPA Pamela; CAMPOS-RODRÍGUEZ Santiago; CANTONE Giulio Giacomo; CARPENA Fenella; CARTER Perry Jess; DOWER Paul Castaneda; ČÁSTEK Ondřej; CAVIGLIA-HARRIS Jill; STRAND Gabriella Chauca; CHEN Shi; CHZHEN Sya In; CHUNG Jong; COLLINS Jason; COPPOCK Alexander; CORDEAU Hugo; COUILLARD Ben; CRECHET Jonathan; CRIPPA Lorenzo; CUI Jing; CZYMARA Christian; DAARSTAD Haley; DAO Danh Chi; DAO Daniel; SCHMANDT Marco David; DE LINDE Astrid; DE MELO Lucas; DEER Lachlan; DE VERA Micole; DIMITROVA Velichka; DOLLBAUM Jan Fabian; DOLLBAUM Jan Matti; DONNELLY Michael; HUYNH Luu Duc Toan; DUMBALSKA Tsvetomira; DUNCAN Jamie; DUONG Kiet Tuan; DUPREY Thibaut; DWORSCHAK Christoph; ELLINGSRUD Sigmund; ELMINEJAD Ali; EISSA Yasmine; ERHART Andrea; ETINGIN-FRATI Giulian; FATEMIPOUR Elaheh; FEDERICE Alexa; FELD Jan; FENIG Guidon; FIROUZJAEIANGALOUGAH Mojtaba; FLEISJE Erlend; FORTIFRITER-CHOUINARD Alexandre; ENGEL Julia Francesca; FRÉCHET Nadjim; FORTIER Reid; FRIES Tilman; FRITH Michael James; GALIPEAU Thomas; GALLEGOS Sebastian; GANGJI Areez; GAO Xiaoying; GARNACHE Cloé; GÁSPÁR Attila; GAVRILOVA Evelina; GHOSH Arijit; GIBNEY Garreth; GIBSON Grant; GODAGER Geir; GOFF Leonard; GONG Da; GONZÁLEZ Javier; GRETTON Jeremy D.; GRIFFA Cristina; GRIGORYEVA Idaliya; GROTTING Maja; GUNTERMANN Eric; GUO Jiaqi; GUGUSHVILI Alexi; HABIBNIA Hooman; HÄFFNER Sonja; HALL Jonathan D.; HAMMAR Olle; KORDT Amund Hanson; HASHIMOTO Barry; HARTLEY Jonathan S.; HAUSLADEN Carina I.; HAVRÁNEK Tomáš; HE Harry; HEPPLEWHITE Matthew; HERRERA-RODRIGUEZ Mario; HEUER Felix; HEYES Anthony; HO Anson T. Y.; HOLMES Jonathan; HOLZKNECHT Armando; HSU Yu-Hsiang Dexter; HU Shiang-Hung; HUANG Yu-Shiuan; HUEBENER Mathias; HUBER Christoph; HUYNH Kim P.; IRSOVA Zuzana; ISLER Ozan; JAKOBSSON Niklas; JANANJI Raphaël; JAYALATH Tharaka A.; JETTER Michael; JOHN Jenny; FORSHAW Rachel Joy; JUAN Felipe; KADRIU Valon; KARIM Sunny; KELLY Edmund; HOANG DANG Duy Khanh; KHUSHBOO Tazia; KIM Jin; KJELLSSON Gustav; KJELSRUD Anders; KOTSADAM Andreas; KORPERSHOEK Jori; KRASHINSKY Lewis; KUNDU Suranjana; KUSTOV Alexander; LALAYEV Nurlan; LANGLOIS Audrée; LAUFER Jill; LEE-WHITING Blake; LEIBING Andreas; LENZ Gabriel; LEVIN Joel; LI Peng; LI Tongzhe; LIN Yuchen; LISTO Ariel; LIU Dan; LU Xuewen; LUKMANOVA Elvina; LUSCOMBE Alex; LUSHER Lester R.; LYU Ke; MA Hai; MÄDER Nicolas; MAKATE Clifton; MALMBERG Alice; MAITRA Adit; MANDAS Marco; MARCUS Jan; MARGARYAN Shushanik; MÁRK Lili; MARTIGNANO Andres; MARSH Abigail; MASETTO Isabella; MCCANNY Anthony; MCMANUS Emma; MCWAY Ryan; METSON Lennard; KINGE Jonas Minet; MISHRA Sumit; MOHNEN Myra; MOELLER Jakob; MONTAMBEAULT Rosalie; MONTPETIT Sébastien; MORIN Louis-Philippe; MORRIS Todd; MOSER Scott; MOTOKI Fabio Yoshio Suguri; MUEHLENBACHS Lucija; MUSULAN Andreea; MUSUMECI Marco; NABIN Munirul; NCHARE Karim; NEUBAUER Florian; NGUYEN Quan M. P.; NGUYEN Tuan; NGUYEN-TIEN Viet; NIAZI Ali; NIKOLAISHVILI Giorgi; NORDSTROM Ardyn; NÜß Patrick; ODERMATT Angela; OLSON Matt; OIEN Henning; ÖLKERS Tim; OLIVER I VERT Miquel; ORAL Emre; OSWALD Christian; OUSMAN Ali; ÖZAK Ömer; PANDEY Shubham; PAVLOV Alexandre; PELLI Martino; PENHEIRO Romeo; PARK RyuGyung; MARTEL Eva Pérez; PETROVIČOVÁ Tereza; PHAN Linh; PRETTYMAN Alexa; PROCHÁZKA Jakub; PUTRI Aqila; QUANDT Julian; QIU Kangyu; THI NGUYEN Loan Quynh; RAHMAN Andaleeb; REA Carson H.; REIREMO Adam; RENÉE Laëtitia; RICHARDSON Joseph; RIVERS Nicholas; RODRIGUES Bruno; ROELOFS William; ROEMER Tobias; ROGEBERG Ole; ROSE Julian; ROSKOS-EWOLDSEN Andrew; ROSMER Paul; SABADA Barbara; SABERIAN Soodeh; SALAMANCA Nicolas; SATOR Georg; SCATES Daniel; SCHLÜTER Elmar; SELLS Cameron; SEN Sharmi; SETHI Ritika; SHCHERBIAK Anna; SOGAOLU Moyosore; SOOSALU Matt; SORENSEN Erik O.; SOVANI Manali; SPENCER Noah; STAUBLI Stefan; STANS Renske; STEWART Anya; STIPS Felix; STOCKLEY Kieran; STROBEL Stephenson; STRUBY Ethan; TANG John P.; TANRISEVER Idil; YANG Thomas Tao; TASTAN Ipek; TATIĆ Dejan; TATLOW Benjamin; SEUYONG Féraud Tchuisseu; THÉRIAULT Rémi; THIVIERGE Vincent; TIAN Wenjie; TOMA Filip-Mihai; TOTARELLI Maddalena; TRAN Van-Anh; TRUONG Hung; TSOY Nikita; TUZCUOGLU Kerem; UBFAL Diego; VILLALOBOS Laura; WALTERSKIRCHEN Julian; WANG Joseph Tao-yi; WATTAL Vasudha; WEBB Matthew D.; WEBER Bryan S.; WEISSER Reinhard; WENG Wei-Chien; WESTHEIDE Christian; WHITE Kimberly; WINTER Jacob; WOCHNER Timo; WOERMAN Matt; WONG Jared; WOODARD Ritchie; WROŃSKI Marcin; YAZBECK Myra; YANG Gustav Chung; YAP Luther; YASSIN Kareman; YE Hao; YOON Jin Young; YURRIS Chris; ZAHRA Tahreen; ZANEVA Mirela; ZAYAT Aline; ZHANG Jonathan; ZHAO Ziwei; ZHONG Yaolang
• Year of publication: 2026
• Type: Article in Periodical
• Magazine / Source: Nature
• MU Faculty or unit: Faculty of Economics and Administration
• web: Full-text
• Doi: https://doi.org/10.1038/s41586-026-10251-x
• Keywords: research reproducibility; research robustness; economics research; political science research; mega-reproduction

Attached files

• Reproducibility_and_robustness_of_economics_and_political_science_research_castek__firouzjaeiangalougah_prochazka_final.pdf

• Description: Science aspires to be cumulative. Reproducibility efforts strengthen science by testing the reliability of published findings, promoting self-correction, and informing policy-making. Computational reproductions, whereby independent researchers reproduce the results of published studies, are an essential diagnostic tool. Such efforts should have greater visibility. However, little social science reproduction and robustness has been conducted at scale. Here we reproduced original analyses and conducted robustness checks of 110 articles that were published in leading economics and political science journals with mandatory data and code sharing policies. We found that more than 85% of published claims were computationally reproducible. In robustness checks, our reanalyses showed that 72% of statistically significant estimates remain significant and in the same direction, and the median reproduced effect size is nearly the same as the originally published effect size (that is, 99% of the published effect size). Additionally, 6 independent research teams examined 12 pre-specified hypotheses about determinants of robustness. Research teams with more experience found lower levels of robustness, and robustness did not correlate with author characteristics or data availability.