Quantifying and addressing the prevalence and bias of study designs in the environmental and social sciences

dc.contributor.authorChristie, Alec P.
dc.contributor.authorAbecasis, David
dc.contributor.authorAdjeroud, Mehdi
dc.contributor.authorAlonso, Juan C.
dc.contributor.authorAmano, Tatsuya
dc.contributor.authorAnton, Álvaro
dc.contributor.authorBaldigo, Barry P.
dc.contributor.authorBarrientos Yuste, Rafael
dc.contributor.authorBicknell, Jack E.
dc.contributor.authorBuhl, Deborah A.
dc.contributor.authorCebrian, Just
dc.contributor.authorCeia, Ricardo S.
dc.contributor.authorCibils-Martina, Ricardo
dc.contributor.authorClarke, Sarah
dc.contributor.authorClaudet, Joachim
dc.contributor.authorCraig, Michael D.
dc.contributor.authorDavoult, Dominique
dc.contributor.authorDe Backer, Annelies
dc.contributor.authorDonovan, Mary K.
dc.contributor.authorEddy, Tyler D.
dc.contributor.authorFrança, Filipe M.
dc.contributor.authorGardner, Jonathan P. A.
dc.contributor.authorHarris, Bradley P.
dc.contributor.authorHuusko, Ari
dc.contributor.authorJones, Ian L.
dc.contributor.authorKelaher, Brendan P.
dc.contributor.authorKotiaho, Janne S.
dc.contributor.authorLópez-Baucells, Adrià
dc.contributor.authorMajor, Heather L.
dc.contributor.authorMäki-Petäys, Aki
dc.contributor.authorMartín, Beatriz
dc.contributor.authorMartín De La Calle, Carlos Alfonso
dc.contributor.authorMartin, Philip A.
dc.contributor.authorMateos-Molina, Daniel
dc.contributor.authorMcConnaughey, Robert A.
dc.contributor.authorMeyer, Christoph F. J.
dc.contributor.authorMills, Kade
dc.contributor.authorMontefalcone, Monica
dc.contributor.authorNoreika, Norbertas
dc.contributor.authorPalacín, Carlos
dc.contributor.authorPande, Anjali
dc.contributor.authorPitcher, C. Roland
dc.contributor.authorPonce, Carlos
dc.contributor.authorRinella, Matt
dc.contributor.authorRocha, Ricardo
dc.contributor.authorRuiz-Delgado, María C.
dc.contributor.authorSchmitter-Soto, Juan J.
dc.contributor.authorShaffer, Jill A.
dc.contributor.authorSharma, Shailesh
dc.contributor.authorSher, Anna A.
dc.contributor.authorStagnol, Doriane
dc.contributor.authorStanley, Thomas R.
dc.contributor.authorStokesbury, Kevin D. E.
dc.contributor.authorTorres, Aurora
dc.contributor.authorTully, Oliver
dc.contributor.authorVehanen, Teppo
dc.contributor.authorWatts, Corinne
dc.contributor.authorZhao, Quingyuan
dc.contributor.authorSutherland, William J.
dc.date.accessioned2023-06-17T09:02:22Z
dc.date.available2023-06-17T09:02:22Z
dc.date.issued2020-12-11
dc.description.abstractBuilding trust in science and evidence-based decision-making depends heavily on the credibility of studies and their findings. Researchers employ many different study designs that vary in their risk of bias to evaluate the true effect of interventions or impacts. Here, we empirically quantify, on a large scale, the prevalence of different study designs and the magnitude of bias in their estimates. Randomised designs and controlled observational designs with pre-intervention sampling were used by just 23% of intervention studies in biodiversity conservation, and 36% of intervention studies in social science. We demonstrate, through pairwise within-study comparisons across 49 environmental datasets, that these types of designs usually give less biased estimates than simpler observational designs. We propose a model-based approach to combine study estimates that may suffer from different levels of study design bias, discuss the implications for evidence synthesis, and how to facilitate the use of more credible study designs.
dc.description.departmentDepto. de Biodiversidad, Ecología y Evolución
dc.description.facultyFac. de Ciencias Biológicas
dc.description.refereedTRUE
dc.description.sponsorshipMinisterio de Ciencia, Innovación y Universidades (MCIU)
dc.description.sponsorshipComunidad de Madrid
dc.description.sponsorshipFoundation for Science and Technology (Portugal)
dc.description.sponsorshipMadeira’s Regional Agency for the Development of Research, Technology and Innovation (ARDITI)
dc.description.sponsorshipNatural Environment Research Council via Cambridge Earth System (NERC DTP)
dc.description.sponsorshipKenneth Miller Trust and Australian Research Council
dc.description.sponsorshipArcadia, MAVA, and The David and Claudia Harding Foundation
dc.description.sponsorshipGrantham Foundation for the Protection of the Environment, Kenneth Miller Trust and Australian Research Council Future Fellowship
dc.description.sponsorshipAlabama Department of Conservation and Natural Resources
dc.description.sponsorshipMinistry of Business, Innovation and Employment (New Zealand)
dc.description.sponsorshipBoreal Peatland LIFE/Parks and Wildlife Finland and Kone Foundation
dc.description.sponsorshipMexican National Council on Science and Technology
dc.description.sponsorshipThe Carl Tryggers Foundation (Stockholm, Sweden)
dc.description.sponsorshipNatural Sciences and Engineering Research Council of Canada
dc.description.sponsorshipFrench National Research Agency via the “Investment for the Future” program IDEALG
dc.description.sponsorshipCommonwealth Scientific and Industrial Research Organisation (CSIRO)
dc.description.sponsorshipGreat Barrier Reef Marine Park Authority, the Fisheries Research and Development Corporation, the Australian Fisheries Management Authority, and Queensland Department of Primary Industries (QDPI)
dc.description.sponsorshipHarold L. Castle Foundation (Hawái)
dc.description.sponsorshipClackamas County Water Environment Services River Health Stewardship Program
dc.description.statuspub
dc.eprint.idhttps://eprints.ucm.es/id/eprint/64887
dc.identifier.doi10.1038/s41467-020-20142-y
dc.identifier.issnElectronic: 2041-1723
dc.identifier.officialurlhttps://www.nature.com/articles/s41467-020-20142-y
dc.identifier.urihttps://hdl.handle.net/20.500.14352/8004
dc.issue.number6377
dc.journal.titleNature Communications
dc.language.isoeng
dc.page.final11
dc.page.initial1
dc.publisherNature Research
dc.relation.projectIDMEC(CGL2007-65176)
dc.relation.projectID(PB97-1252, BOS2002-01543, CGL2005-04893/BOS, CGL2008-02567, AP2008-00577)
dc.relation.projectID(2018-T1/AMB-10374)
dc.relation.projectID(SFRH/BD/78813/2011 and UID/MAR/04292/2013, FCT PD/BD/52597/2014, SFRH/BD/80488/2011,PTDC/BIA-BIC/111184/20, UIDB/04326/202009)
dc.relation.projectIDM1420-09-5369-FSE-000002
dc.relation.projectID(NE/L002507/1)
dc.relation.projectID(UIDB/04326/2020)
dc.relation.projectID(LIFE08 NAT/FIN/000596)
dc.relation.projectID(FT180100354)
dc.relation.projectID(CONACYT 242558)
dc.relation.projectID(ANR-10-BTBR-04, ALGMARBIO project)
dc.rightsAtribución 3.0 España
dc.rights.accessRightsopen access
dc.rights.urihttps://creativecommons.org/licenses/by/3.0/es/
dc.subject.cdu504.03
dc.subject.cdu574.3
dc.subject.keywordBias
dc.subject.keywordBiodiversity
dc.subject.keywordEnvironment
dc.subject.keywordSocial sciences
dc.subject.ucmEcología (Biología)
dc.subject.ucmMedio ambiente natural
dc.subject.unesco2401.06 Ecología animal
dc.titleQuantifying and addressing the prevalence and bias of study designs in the environmental and social sciences
dc.typejournal article
dc.volume.number11
dspace.entity.typePublication
relation.isAuthorOfPublication598b089c-04cb-44fe-913e-e82316837c66
relation.isAuthorOfPublication29388d01-a0d2-4933-99e4-b9db91c1c666
relation.isAuthorOfPublication.latestForDiscovery598b089c-04cb-44fe-913e-e82316837c66
Download
Original bundle
Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
Christie, Alec P. et al. 2020. Quantifying and addressing the prevalence....pdf
Size:
7.09 MB
Format:
Adobe Portable Document Format
Collections