Variability in the analysis of a single neuroimaging dataset by many teams

Simple item page
dc.contributor.authorBotvinik-Nezer, R.
dc.contributor.authorHolzmeister, F.
dc.contributor.authorCamerer, C. F.
dc.contributor.authorDreber, A.
dc.contributor.authorHuber, J.
dc.contributor.authorJohannesson, M.
dc.contributor.authorKirchler, M.
dc.contributor.authorIwanir, R.
dc.contributor.authorMumford, J. A.
dc.contributor.authorAdcock, R. A.
dc.contributor.authorAvesani, P.
dc.contributor.authorBaczkowski, B. M.
dc.contributor.authorBajracharya, A.
dc.contributor.authorBakst, L.
dc.contributor.authorBall, S.
dc.contributor.authorBarilari, M.
dc.contributor.authorBault, N.
dc.contributor.authorBeaton, D.
dc.contributor.authorBeitner, J.
dc.contributor.authorBenoit, R. G.
dc.contributor.authorBerkers, R. M. W. J.
dc.contributor.authorBhanji, J. P.
dc.contributor.authorBiswal, B. B.
dc.contributor.authorBobadilla-Suarez, S.
dc.contributor.authorBortolini, T.
dc.contributor.authorBottenhorn, K. L.
dc.contributor.authorBowring, A.
dc.contributor.authorBraem, S.
dc.contributor.authorBrooks, H. R.
dc.contributor.authorBrudner, E. G.
dc.contributor.authorCalderon, C. B.
dc.contributor.authorCamilleri, J. A.
dc.contributor.authorCastrellon, J. J.
dc.contributor.authorCecchetti, L.
dc.contributor.authorCieslik, E. C.
dc.contributor.authorCole, Z. J.
dc.contributor.authorCollignon, O.
dc.contributor.authorCox, R. W.
dc.contributor.authorCunningham, W. A.
dc.contributor.authorCzoschke, S.
dc.contributor.authorDadi, K.
dc.contributor.authorDavis, C. P.
dc.contributor.authorLuca, A. D.
dc.contributor.authorDelgado, M. R.
dc.contributor.authorDemetriou, L.
dc.contributor.authorDennison, J. B.
dc.contributor.authorDi, X.
dc.contributor.authorDickie, E. W.
dc.contributor.authorDobryakova, E.
dc.contributor.authorDonnat, C. L.
dc.contributor.authorDukart, J.
dc.contributor.authorDuncan, N. W.
dc.contributor.authorDurnez, J.
dc.contributor.authorEed, A.
dc.contributor.authorEickhoff, S. B.
dc.contributor.authorErhart, A.
dc.contributor.authorFontanesi, L.
dc.contributor.authorFricke, G. M.
dc.contributor.authorFu, S.
dc.contributor.authorGalván, A.
dc.contributor.authorGau, R.
dc.contributor.authorGenon, S.
dc.contributor.authorGlatard, T.
dc.contributor.authorGlerean, E.
dc.contributor.authorGoeman, J. J.
dc.contributor.authorGolowin, S. A. E.
dc.contributor.authorGonzález-García, C.
dc.contributor.authorGorgolewski, K. J.
dc.contributor.authorGrady, C. L.
dc.contributor.authorGreen, M. A.
dc.contributor.authorGuassi Moreira, J. F.
dc.contributor.authorGuest, O.
dc.contributor.authorHakimi, S.
dc.contributor.authorHamilton, J. P.
dc.contributor.authorHancock, R.
dc.contributor.authorHandjaras, G.
dc.contributor.authorHarry, B.B.
dc.contributor.authorHawco, C.
dc.contributor.authorHerholz, P.
dc.contributor.authorHerman, G.
dc.contributor.authorHeunis, S.
dc.contributor.authorHoffstaedter, F.
dc.contributor.authorHogeveen, J.
dc.contributor.authorHolmes, S.
dc.contributor.authorHu, C. P.
dc.contributor.authorHuettel, S. A.
dc.contributor.authorHughes, M. E.
dc.contributor.authorIacovella, V.
dc.contributor.authorIordan, A. D.
dc.contributor.authorIsager, P. M.
dc.contributor.authorIsik, A. I.
dc.contributor.authorJahn, Andrew
dc.contributor.authorJohnson, Matthew R.
dc.contributor.authorJohnstone, Tom
dc.contributor.authorJoseph, Michael J. E.
dc.contributor.authorJuliano, Anthony C.
dc.contributor.authorKable, Joseph W.
dc.contributor.authorKassinopoulos, Michalis
dc.contributor.authorKoba, Cemal
dc.contributor.authorKong, Xiang-Zhen
dc.contributor.authorKoscik, Timothy R.
dc.contributor.authorKucukboyaci, Nuri Erkut
dc.contributor.authorKuhl, Brice A.
dc.contributor.authorKupek, Sebastian
dc.contributor.authorLaird, Angela R.
dc.contributor.authorLamm, Claus
dc.contributor.authorLangner, Robert
dc.contributor.authorLauharatanahirun, Nina
dc.contributor.authorLee, Hongmi
dc.contributor.authorLee, Sangil
dc.contributor.authorLeemans, Alexander
dc.contributor.authorLeo, Andrea
dc.contributor.authorLesage, Elise
dc.contributor.authorLi, Flora
dc.contributor.authorLi, Monica Y. C.
dc.contributor.authorLim, Cheng Phui
dc.contributor.authorLintz, Evan N.
dc.contributor.authorLiphardt, Schuyler W.
dc.contributor.authorLosecaat Vermeer, Annabel B.
dc.contributor.authorLove, Bradley C.
dc.contributor.authorMack, Michael L.
dc.contributor.authorMalpica, Norberto
dc.contributor.authorMarins, Theo
dc.contributor.authorMaumet, Camille
dc.contributor.authorMcDonald, Kelsey
dc.contributor.authorMcGuire, Joseph T.
dc.contributor.authorMéndez Leal, Adriana S.
dc.contributor.authorMeyer, Benjamin
dc.contributor.authorMeyer, Kristin N.
dc.contributor.authorMihai, Glad
dc.contributor.authorMitsis, Georgios D.
dc.contributor.authorMoll, Jorge
dc.contributor.authorNielson, Dylan M.
dc.contributor.authorNilsonne, Gustav
dc.contributor.authorNotter, Michael P.
dc.contributor.authorOlivetti, Emanuele
dc.contributor.authorOnicas, Adrian I.
dc.contributor.authorPapale, Paolo
dc.contributor.authorPatil, Kaustubh R.
dc.contributor.authorPeelle, Jonathan E.
dc.contributor.authorPérez, Alexandre
dc.contributor.authorPischedda, Doris
dc.contributor.authorPoline, Jean-Baptiste
dc.contributor.authorPrystauka,Yanina
dc.contributor.authorRay, Shruti
dc.contributor.authorReuter-Lorenz, Patricia A.
dc.contributor.authorReynolds, Richard C.
dc.contributor.authorRicciardi, Emiliano
dc.contributor.authorRieck, Jenny R.
dc.contributor.authorRodriguez-Thompson, Anais M.
dc.contributor.authorRomyn, Anthony
dc.contributor.authorSalo, Taylor
dc.contributor.authorSamanez-Larkin, Gregory R.
dc.contributor.authorSanz-Morales, Emilio
dc.contributor.authorSchlichting, Margaret L.
dc.contributor.authorSchultz, Douglas H.
dc.contributor.authorShen, Qiang
dc.contributor.authorSheridan, Margaret A.
dc.contributor.authorSilvers, Jennifer A.
dc.contributor.authorSkagerlund, Kenny
dc.contributor.authorSmith, Alec
dc.contributor.authorSmith, David V.
dc.contributor.authorSokol-Hessner, Peter
dc.contributor.authorSteinkamp, Simon R.
dc.contributor.authorTashjian, Sarah M.
dc.contributor.authorThirion, Bertrand
dc.contributor.authorThorp, John N.
dc.contributor.authorTinghög, Gustav
dc.contributor.authorTisdall, Loreen
dc.contributor.authorTompson, Steven H.
dc.contributor.authorToro-Serey, Claudio
dc.contributor.authorTorre Tresols, Juan Jesus
dc.contributor.authorTozzi, Leonardo
dc.contributor.authorTruong, Vuong
dc.contributor.authorTurella, Luca
dc.contributor.authorvan ‘t Veer, Anna E.
dc.contributor.authorVerguts, Tom
dc.contributor.authorVettel, Jean M.
dc.contributor.authorVijayarajah, Sagana
dc.contributor.authorVo, Khoi
dc.contributor.authorWall, Matthew B.
dc.contributor.authorWeeda, Wouter D.
dc.contributor.authorWeis, Susanne
dc.contributor.authorWhite, David J.
dc.contributor.authorWisniewski, David
dc.contributor.authorXifra-Porxas, Alba
dc.contributor.authorYearling, Emily A.
dc.contributor.authorYoon, Sangsuk
dc.contributor.authorYuan, Rui
dc.contributor.authorYuen, Kenneth S. L.
dc.contributor.authorLei Zhang
dc.contributor.authorZhang, Xu
dc.contributor.authorZosky, Joshua E.
dc.contributor.authorThomas E. Nichols,
dc.contributor.authorPoldrack, Rusell A.
dc.contributor.authorSchonberg, Tom
dc.contributor.authorMelero Carrasco, Helena
dc.date.accessioned2024-02-09T10:47:32Z
dc.date.available2024-02-09T10:47:32Z
dc.date.issued2020-05-20
dc.description.abstractData analysis workflows in many scientific domains have become increasingly complex and flexible. Here we assess the effect of this flexibility on the results of functional magnetic resonance imaging by asking 70 independent teams to analyse the same dataset, testing the same 9 ex-ante hypotheses1. The flexibility of analytical approaches is exemplified by the fact that no two teams chose identical workflows to analyse the data. This flexibility resulted in sizeable variation in the results of hypothesis tests, even for teams whose statistical maps were highly correlated at intermediate stages of the analysis pipeline. Variation in reported results was related to several aspects of analysis methodology. Notably, a meta-analytical approach that aggregated information across teams yielded a significant consensus in activated regions. Furthermore, prediction markets of researchers in the field revealed an overestimation of the likelihood of significant findings, even by researchers with direct knowledge of the dataset2–5. Our findings show that analytical flexibility can have substantial effects on scientific conclusions, and identify factors that may be related to variability in the analysis of functional magnetic resonance imaging. The results emphasize the importance of validating and sharing complex analysis workflows, and demonstrate the need for performing and reporting multiple analyses of the same data. Potential approaches that could be used to mitigate issues related to analytical variability are discussed.
dc.description.departmentDepto. de Psicobiología y Metodología en Ciencias del Comportamiento
dc.description.facultyFac. de Psicología
dc.description.refereedTRUE
dc.description.statuspub
dc.identifier.doi10.1038/s41586-020-2314-9
dc.identifier.issn0028-0836
dc.identifier.issn1476-4687
dc.identifier.officialurlhttps://www.nature.com/articles/s41586-020-2314-9
dc.identifier.urihttps://hdl.handle.net/20.500.14352/100828
dc.journal.titleNature
dc.language.isoeng
dc.rights.accessRightsopen access
dc.subject.ucmPsicología (Psicología)
dc.subject.unesco6106.01 Actividad Cerebral
dc.titleVariability in the analysis of a single neuroimaging dataset by many teams
dc.typejournal article
dspace.entity.typePublication
relation.isAuthorOfPublication17bc1fff-dc5d-4ac3-914e-dd631e6a9ac1
relation.isAuthorOfPublication.latestForDiscovery17bc1fff-dc5d-4ac3-914e-dd631e6a9ac1
Download
Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
2020_Nature.pdf
Size:
2.47 MB
Format:
Adobe Portable Document Format
downoload Download
Collections
Artículos