Skip to main content
Review article - Peer-reviewed, 2020

Improving scientific rigour in conservation evaluations and a plea deal for transparency on potential biases

Josefsson, Jonas; Hiron, Matthew; Arlt, Debora; Auffret, Alistair G.; Berg, Ake; Chevalier, Mathieu; Glimskar, Anders; Hartman, Goran; Kacergyte, Ineta; Klein, Julian; Knape, Jonas; Laugen, Ane T.; Low, Matthew; Paquet, Matthieu; Pasanen-Mortensen, Marianne; Rosin, Zuzanna M.; Rubene, Diana; Zmihorski, Michal; Part, Tomas

Abstract

The delivery of rigorous and unbiased evidence on the effects of interventions lay at the heart of the scientific method. Here we examine scientific papers evaluating agri-environment schemes, the principal instrument to mitigate farmland biodiversity declines worldwide. Despite previous warnings about rudimentary study designs in this field, we found that the majority of studies published between 2008 and 2017 still lack robust study designs to strictly evaluate intervention effects. Potential sources of bias that arise from the correlative nature are rarely mentioned, and results are still promoted by using a causal language. This lack of robust study designs likely results from poor integration of research and policy, while the erroneous use of causal language and an unwillingness to discuss bias may stem from publication pressures. We conclude that scientific reporting and discussion of study limitations in intervention research must improve and propose some practices toward this goal.

Keywords

agri-environment scheme; before after control impact; biodiversity | causal language; evaluation of conservation interventions; meta-analysis; organic farming; study design; systematic review

Published in

Conservation Letters
2020, volume: 13, number: 5, article number: e12726
Publisher: WILEY

Authors' information

Josefsson, Jonas
Swedish University of Agricultural Sciences, Department of Ecology
Swedish University of Agricultural Sciences, Department of Ecology
Swedish University of Agricultural Sciences, Department of Ecology
Swedish University of Agricultural Sciences, Department of Ecology
Berg, Åke
Swedish University of Agricultural Sciences, Swedish Biodiversity Centre
Chevalier, Mathieu
Swedish University of Agricultural Sciences, Department of Ecology
Chevalier, Mathieu
University of Lausanne
Swedish University of Agricultural Sciences, Department of Ecology
Swedish University of Agricultural Sciences, Department of Ecology
Swedish University of Agricultural Sciences, Department of Ecology
Swedish University of Agricultural Sciences, Department of Ecology
Swedish University of Agricultural Sciences, Department of Ecology
Laugen, Ane
Swedish University of Agricultural Sciences, Department of Ecology
Swedish University of Agricultural Sciences, Department of Ecology
Paquet, Matthieu
Swedish University of Agricultural Sciences, Department of Ecology
Pasanen Mortensen, Marianne
Swedish University of Agricultural Sciences, Department of Ecology
Rosin, Zuzanna
Swedish University of Agricultural Sciences, Department of Ecology
Rosin, Zuzanna M. (Rosin, Zuzanna M.)
Adam Mickiewicz University in Poznan
Swedish University of Agricultural Sciences, Department of Ecology
Swedish University of Agricultural Sciences, Department of Crop Production Ecology

Associated SLU-program

SLUsystematic

Sustainable Development Goals

SDG15 Life on land

UKÄ Subject classification

Ecology

Publication Identifiers

DOI: https://doi.org/10.1111/conl.12726

URI (permanent link to this page)

https://res.slu.se/id/publ/106484