Linear multi-task learning for predicting soil properties using field spectroscopy

Haijun Qi, Tarin Paz-Kagan, Arnon Karnieli, Shaowen Li

Research output: Contribution to journalArticlepeer-review

12 Scopus citations

Abstract

Field spectroscopy has been suggested to be an efficient method for predicting soil properties using quantitative mathematical models in a rapid and non-destructive manner. Traditional multivariate regression algorithms usually regard the modeling of each soil property as a single task, which means only one response variable is considered as the output during modeling. Therefore, these algorithms are less suitable for the prediction of several key soil properties with low concentrations or unobvious spectral absorption signals. In the current study, we investigated the performance of a linear multi-task learning (LMTL) algorithm based on a regularized dirty model for modeling and predicting several key soil properties using field spectroscopy (350-2500 nm) as an integrated approach. We tested seven key soil properties including available nitrogen (N), phosphorus (P) and potassium (K), pH, water content (WC), organic matter (OM), and electrical conductivity (EC) in drylands. The model performances of LMTL models were compared with the commonly used single-task algorithm of the partial least squares regression (PLS-R). Our results show that the LMTL models outperformed the PLS-R models with the advantage of shared features; the ratio of performance to deviation (RPD) values in the validation set improved by 10.24%, 4.93%, 25.77%, 11.76%, 6.74%, 53.13%, and 3.15% for N, P, K, pH, WC, OM, and EC, respectively. The best prediction was obtained for OM with RPD = 2.29, indicating high accuracy (RPD > 2). The prediction results of N, P, WC, and pH were categorized as of moderate accuracy (1.4 < RPD < 2), while K and EC were categorized as of poor accuracy (RPD < 1.4). However, the explanatory power of the LMTL models was moderate due to fewer features being selected by the regularization algorithm of the LMTL approach, which should be further studied in the soil spectral analysis. Our results highlight the use of LMTL in field spectroscopy analysis that can improve the generalization performance of regression models for predicting soil properties.

Original languageEnglish
Article number1099
JournalRemote Sensing
Volume9
Issue number11
DOIs
StatePublished - 1 Nov 2017

Keywords

  • Dirty model
  • Partial least squares regression (PLS-R)
  • Regularization
  • Shared features
  • Soil measurement
  • Visible-near infrared and shortwave infrared (VNIR/SWIR)

ASJC Scopus subject areas

  • General Earth and Planetary Sciences

Fingerprint

Dive into the research topics of 'Linear multi-task learning for predicting soil properties using field spectroscopy'. Together they form a unique fingerprint.

Cite this