Multiscale transformer-based network for rangeland plant classification used in pasture scoring

Abstract

Rangeland ecosystems have been sources for pastoral communities. However, traditional seasonal mobility patterns are disrupted by climate change, requiring more dynamic, data-driven plant-based rangeland assessment. In this study, we propose amultiscale transformer-based network to address the challenge of automatically classifying rangeland plant species for livestock pasture scoring in Africa, given the complex environments and limited data. Accurately distinguishing similar plants with varying livestock utility is important for sustainable management. This study investigated Vision Transformers, known for multiscale features important for finegrained visual differentiating. The initial comparative analysis of ViT, DEiT, and Swin Transformer models demonstrated the promise of Swin architecture. Building on this, we introduce a Multiscale Swin Transformer model incorporating multiscale feature fusion and weighting mechanism to enhance plant image classification. The model combines global and fine feature extraction, followed by fusion module. Early features capture local patterns (e.g., leaf), and later layers capture semantic information (e.g., general morphology). The proposed Multiscale approach utilizing a weighted decoder provides better performance improvements over the Swin base model, achieving 89.71 % accuracy compared to 88.0%, demonstrating that fusing features at different scales leads to better recognition. Moreover, analysis of the collected data shows class imbalance, including dominance of invasive species and useful herbs, sparse representation of rare unuseful (e.g., poisonous) and other sparse useful livestock forage species. This highlights an essential need for systematic data collection and optimization strategies, like synthetic image generation, to mitigate limitations and improve model generalization.

Keywords

Machine learning; Vision transformers; Rangeland ecosystem; Multiscale learning

Published in

Smart agricultural technology
2025, volume: 12, article number: 101183
Publisher: ELSEVIER

SLU Authors

• Nasirahmadi, Abozar

  • Department of Energy and Technology, Swedish University of Agricultural Sciences
    
  • University of Kassel

UKÄ Subject classification

Artificial Intelligence
Agricultural Science

Publication identifier

• DOI: https://doi.org/10.1016/j.atech.2025.101183

Permanent link to this page (URI)

https://res.slu.se/id/publ/143291