Skip to main content
SLU publication database (SLUpub)
Review article - Peer-reviewed, 2020

Improving scientific rigour in conservation evaluations and a plea deal for transparency on potential biases

Josefsson, Jonas; Hiron, Matthew; Arlt, Debora; Auffret, Alistair G.; Berg, Ake; Chevalier, Mathieu; Glimskar, Anders; Hartman, Goran; Kacergyte, Ineta; Klein, Julian; Knape, Jonas; Laugen, Ane T.; Low, Matthew; Paquet, Matthieu; Pasanen-Mortensen, Marianne; Rosin, Zuzanna M.; Rubene, Diana; Zmihorski, Michal; Part, Tomas

Abstract

The delivery of rigorous and unbiased evidence on the effects of interventions lay at the heart of the scientific method. Here we examine scientific papers evaluating agri-environment schemes, the principal instrument to mitigate farmland biodiversity declines worldwide. Despite previous warnings about rudimentary study designs in this field, we found that the majority of studies published between 2008 and 2017 still lack robust study designs to strictly evaluate intervention effects. Potential sources of bias that arise from the correlative nature are rarely mentioned, and results are still promoted by using a causal language. This lack of robust study designs likely results from poor integration of research and policy, while the erroneous use of causal language and an unwillingness to discuss bias may stem from publication pressures. We conclude that scientific reporting and discussion of study limitations in intervention research must improve and propose some practices toward this goal.

Keywords

agri-environment scheme; before after control impact; biodiversity | causal language; evaluation of conservation interventions; meta-analysis; organic farming; study design; systematic review

Published in

Conservation Letters
2020, Volume: 13, number: 5, article number: e12726
Publisher: WILEY