Transfer-Learning-Based Approach for Yield Prediction of Winter Wheat from Planet Data and SAFY Model
Abstract
:1. Introduction
2. Materials and Methods
2.1. Study Location and Field Data Collection
2.2. Data Collection
2.2.1. Satellite Imagery Data Acquisition and Preprocessing
2.2.2. Meteorological Data
2.2.3. Field Measured AGB
2.2.4. Winter Wheat Yield Observations
2.3. Data Analysis
2.3.1. Principle of SAFY Model
2.3.2. Predicted AGB from Planet Imageries Using the CBA-Wheat Model
2.3.3. Transfer Learning Method
- (I).
- SAFY parameter sets construction: 200,000 sets of parameter combinations of SAFY were generated based on Monte Carlo (MC) algorithm.
- (II).
- Construction of possible AGB datasets and yield datasets based on the SAFY model: The parameter set constructed in step I was input into the SAFY model to obtain the possible AGB datasets and yield datasets. The time efficiency test of transfer learning is divided into two types with or without simulated data sets: no simulated datasets and with simulated datasets.
- (III).
- Train DNN model: A four-layer fully-connected network is constructed to train simulated AGB-yield from the SAFY model. The model was pre-trained using the AGB datasets and yield datasets simulated in step II, and fine-tuned by the measured data using transfer learning.
- (IV).
- Forecast yield based on transfer learning method: The AGB predicted from the CBA-Wheat model is utilized as the input layer of the trained DNN to predict winter wheat yield.
2.3.4. Data Assimilation
- (I).
- AGB predicted model construction: the AGB prediction results based on the CBA-Wheat model are chosen as the state variable to estimate the yield in the assimilation system.
- (II).
- Run SAFY: SAFY model is run based on initialized model parameters and meteorological data.
- (III).
- Cost function calculation: The cost function is built on the basis of the relationship between the measured AGB and the model simulated AGB.
- (I).
- Determine iteration termination conditions: When the objective function cannot be improved by 0.01% or the cost function is calculated more than 10,000 times to terminate the cycle.
- (II).
- Test the error between the model measured yield and the simulated yield.
3. Results
3.1. Validation of AGB Retrieved from CBA-Wheat Model and SAFY Model
3.2. AGB Distribution for Different Datasets in Different Stages
3.3. Winter Wheat Yield Prediction
3.4. Farm-Land Verification of Transfer Learning Method
4. Discussion
4.1. Advantage of Applying CBA-Wheat to Predict AGB
4.2. Comparison between Transfer Learning Method and Data Assimilation
4.3. Potential Extension and Limitation
5. Conclusions
Author Contributions
Funding
Data Availability Statement
Acknowledgments
Conflicts of Interest
References
- Lobell, D.B.; Asseng, S. Comparing estimates of climate change impacts from process-based and statistical crop models. Environ. Res. Lett. 2017, 12, 015001. [Google Scholar] [CrossRef]
- Zaks, D.P.M.; Kucharik, C.J. Data and monitoring needs for a more ecological agriculture. Environ. Res. Lett. 2011, 6, 014017. [Google Scholar] [CrossRef]
- Battude, M.; Al Bitar, A.; Morin, D.; Cros, J.; Huc, M.; Marais Sicre, C.; Dantec, V.; Demarez, V. Estimating maize biomass and yield over large areas using high spatial and temporal resolution sentinel-2 like remote sensing data. Remote Sens. Environ. 2016, 184, 668–681. [Google Scholar] [CrossRef]
- Huang, J.; Ma, H.; Sedano, F.; Lewis, P.; Liang, S.; Wu, Q.; Su, W.; Zhang, X.; Zhu, D. Evaluation of regional estimates of winter wheat yield by assimilating three remotely sensed reflectance datasets into the coupled WOFOST–PROSAIL model. Eur. J. Agron. 2019, 102, 1–13. [Google Scholar] [CrossRef]
- Jiang, H.; Hu, H.; Zhong, R.; Xu, J.; Xu, J.; Huang, J.; Wang, S.; Ying, Y.; Lin, T. A deep learning approach to conflating heterogeneous geospatial data for corn yield estimation: A case study of the USA corn belt at the county level. Glob. Chang. Biol. 2019, 26, 1–13. [Google Scholar] [CrossRef]
- Li, Z.; Taylor, J.; Yang, H.; Casa, R.; Jin, X.; Li, Z.; Song, X.; Yang, G. A hierarchical interannual wheat yield and grain protein prediction model using spectral vegetative indices and meteorological data. Field Crop. Res. 2020, 248, 107711. [Google Scholar] [CrossRef]
- Gorelick, N.; Hancher, M.; Dixon, M.; Ilyushchenko, S.; Thau, D.; Moore, R. Google earth engine: Planetary-scale geospatial analysis for everyone. Remote Sens. Environ. 2017, 202, 18–27. [Google Scholar] [CrossRef]
- Li, W.; Ciais, P.; Stehfest, E.; Vuuren, D.; Popp, A.; Arneth, A.; Fulvio, F.; Doelman, J.; Humpenoder, F.; Harper, A.B.; et al. Mapping the yields of lignocellulosic bioenergy crops from observations at the global scale. Earth Syst. Sci. Data 2020, 12, 789–804. [Google Scholar] [CrossRef] [Green Version]
- Huang, H.; Huang, J.; Li, X.; Zhuo, W.; Wu, Y.; Niu, Q.; Su, W.; Yuan, W. A dataset of winter wheat aboveground biomass in China during 2007–2015 based on data assimilation. Sci. Data 2022, 9, 200. [Google Scholar] [CrossRef]
- Descals, A.; Wich, S.; Meijaard, E.; Gaveau, A.L.A.; Pee dell, S.; Zantoi, Z. High-resolution global map of smallholder and industrial closed-canopy oil palm plantations. Earth Syst. Sci. Data 2021, 13, 1211–1231. [Google Scholar] [CrossRef]
- Tennakoon, S.; Murty, V.; Eiumnoh, A. Estimation of cropped area and grain yield of rice using remote sensing data. Int. Remote Sens. 1992, 13, 427–439. [Google Scholar] [CrossRef]
- Rouse, J.W.; Haas, R.H.; Schell, J.A.; Deering, D.W. Monitoring Vegetation Systems in the Great Plains with ERTS; NASA Special Publication: Washington, DC, USA, 1974; Volum 1, pp. 48–62. [Google Scholar]
- Sims, D.A.; Rahman, A.F.; Cordova, V.D.; El-Masri, B.Z.; Baldocchi, D.D.; Bolstad, P.V.; Flanagan, L.B.; Goldstein, A.H.; Hollinger, D.Y.; Misson, L.; et al. A new model of gross primary productivity for North American ecosystems based solely on the enhanced vegetation index and land surface temperature from MODIS. Remote Sens. Environ. 2008, 112, 1633–1646. [Google Scholar] [CrossRef]
- Rondeaux, G.; Steven, M.; Baret, F. Optimization of soil-adjusted vegetation indices. Remote Sens. Environ. 1996, 55, 95–107. [Google Scholar] [CrossRef]
- Jin, X.; Yang, G.; Xu, X.; Yang, H.; Feng, H.; Li, Z.; Shen, J.; Zhao, C. Combined multi-temporal optical and radar parameters for estimating lai and biomass in winter wheat using HJ and RADARSAR-2 data. Remote Sens. 2015, 7, 13251–13272. [Google Scholar] [CrossRef] [Green Version]
- Zhou, X.; Zheng, H.; Xu, X.; He, J.; Ge, X.; Yao, X.; Cheng, T.; Zhu, Y.; Cao, W.; Tian, Y. Predicting grain yield in rice using multi-temporal vegetation indices from UAV-based multispectral and digital imagery. ISPRS J. Photogramm. Remote Sens. 2017, 130, 246–255. [Google Scholar] [CrossRef]
- Zhang, L.; Zhang, Z.; Luo, Y.; Cao, J.; Li, Z. Optimizing genotype-environment-management interactions for maize farmers to adapt to climate change in different agro-ecological zones across China. Sci. Total Environ. 2020, 728, 138614. [Google Scholar] [CrossRef]
- Lobell, D.B.; Asner, G.P. Climate and management contributions to recent trends in US agricultural yields. Science 2003, 299, 1032. [Google Scholar] [CrossRef]
- Bryan, B.; King, D.; Zhao, G. Influence of management and environment on Australian wheat: Information for sustainable intensification and closing yield gaps. Environ. Res. Lett. 2014, 9, 044005. [Google Scholar] [CrossRef]
- Li, L.; Wang, B.; Feng, P.; Wang, H.; He, Q.; Wang, Y.; Liu, D.L.; Li, Y.; He, J.; Feng, H.; et al. Crop yield forecasting and associated optimum lead time analysis based on multi-source environmental data across china. Agric. For. Meteorol. 2021, 308–309, 108558. [Google Scholar] [CrossRef]
- Cao, J.; Zhang, Z.; Tao, F.; Zhang, L.; Luo, Y.; Zhang, J.; Han, J.; Xie, J. Integrating multi-source data for rice yield prediction across china using machine learning and deep learning approaches. Agric. For. Meteorol. 2021, 297, 108275. [Google Scholar] [CrossRef]
- Moulin, S.; Bondeau, A.; Delecolle, R. Combining agricultural crop models and satellite observations: From field to regional scales. Int. J. Remote Sens. 1998, 19, 1021–1036. [Google Scholar] [CrossRef]
- Dorigo, W.A.; Zurita-Milla, R.; Wit, A.; Brazile, J.; Singh, R.; Schaepman, M.E. A review on reflective remote sensing and data assimilation techniques for enhanced agroecosystem modeling. Int. J. Appl. Earth Observ. Geoinform. 2007, 9, 165–193. [Google Scholar] [CrossRef]
- Jin, X.; Kumar, L.; Li, Z.; Feng, H.; Xu, X.; Yang, G.; Wang, J. A review of data assimilation of remote sensing and crop models. Eur. J. Agron. 2018, 92, 141–152. [Google Scholar] [CrossRef]
- Huang, J.; Tian, L.; Liang, S.; Ma, H.; Becker-Reshef, I.; Huang, Y.; Su, W.; Zhang, X.; Zhu, D.; Wu, W. Improving winter wheat yield estimation by assimilation of the leaf area index from Landsat TM and MODIS data into the WOFOST model. Agric. For. Meteorol. 2015, 204, 106–121. [Google Scholar] [CrossRef] [Green Version]
- Ines, A.V.M.; Das, N.N.; Hansen, J.W.; Njoku, E.G. Assimilation of remotely sensed soil moisture and vegetation with a crop simulation model for maize yield prediction. Remote Sens. Environ. 2013, 138, 149–164. [Google Scholar] [CrossRef] [Green Version]
- Hu, S.; Shi, L.; Zha, Y.; Williams, M.; Lin, L. Simultaneous state-parameter estimation supports the evaluation of data assimilation performance and measurement design for soil-water atmosphere-plant system. J. Hydrol. 2017, 555, 812–831. [Google Scholar] [CrossRef]
- Huang, J.; Gómez-Dans, J.L.; Huang, H.; Ma, H.; Wu, Q.; Lewis, P.E.; Liang, S.; Chen, Z.; Xue, J.H.; Wu, Y.; et al. Assimilation of remote sensing into crop growth models: Current status and perspectives. Agric. For. Meteorol. 2019, 276–277, 107609. [Google Scholar] [CrossRef]
- Li, P.; Zhang, X.; Wang, W.; Zheng, H.; Yao, X.; Tian, Y.; Zhu, Y.; Cao, W.; Chen, Q.; Cheng, T. Estimating aboveground and organ biomass of plant canopies across the entire season of rice growth with terrestrial laser scanning. Int. J. Appl. Earth Obs. Geoinf. 2020, 91, 102132. [Google Scholar] [CrossRef]
- Yang, H.; Yang, G.; Gaulton, R.; Zhao, C.; Li, Z.; Taylor, J.; Wicks, D.; Minchella, A.; Chen, E.; Yang, X. In-season biomass estimation of oilseed rape (Brassica napus L.) using fully polarimetric SAR imagery. Precis. Agric. 2019, 20, 630–648. [Google Scholar] [CrossRef] [Green Version]
- Beamish, A.; Raynolds, M.K.; Epstein, H.; Frost, G.V.; Macander, M.J.; Bergstedt, H.; Bartsch, A.; Kruse, S.; Miles, V.; Tanis, C.M.; et al. Recent trends and remaining challenges for optical remote sensing of Arctic tundra vegetation: A review and outlook. Remote Sens. Environ. 2020, 246, 111872. [Google Scholar] [CrossRef]
- Li, Z.; Zhao, Y.; Taylor, J.; Gaulton, R.; Jin, X.; Song, X.; Li, Z.; Meng, Y.; Chen, P.; Feng, H.; et al. Comparison and transferability of thermal, temporal and phenological-based in-season predictions of above-ground biomass in wheat crops from proximal crop reflectance data. Remote Sens. Environ. 2022, 273, 112967. [Google Scholar] [CrossRef]
- Guo, Y.; Fu, Y.; Hao, F.; Zhang, X.; Wu, W.; Jin, X.; Bryant, C.R.; Senthilnath, J. Integrated phenology and climate in rice yields prediction using machine learning methods. Ecol. Indic. 2020, 120, 106935. [Google Scholar] [CrossRef]
- Guo, L.; Wang, J.; Xiao, Z.; Zhou, H.; Song, J. Data-based mechanistic modelling and validation for leaf area index estimation using multi-angular remote-sensing observation time series. Int. J. Remote Sens. 2014, 35, 4655–4672. [Google Scholar] [CrossRef]
- Dhillon, M.S.; Dahms, T.; Kuebert-Flock, C.; Borg, E.; Conrad, C.; Ullmann, T. Modelling crop biomass from synthetic remote sensing time series: Example for the DEMMIN test site, Germany. Remote Sens. 2020, 12, 1819. [Google Scholar] [CrossRef]
- Zadoks, J.C.; Chang, T.T.; Konzak, C.F. A decimal code for the growth stages of cereals. Weed Res. 1974, 14, 415–421. [Google Scholar] [CrossRef]
- Bai, X.; Li, Z.; Li, W.; Zhao, Y.; Li, M.; Chen, H.; Wei, S.; Jiang, Y.; Yang, G.; Zhu, X. Comparison of Machine-Learning and CASA Models for Predicting Apple Fruit Yieldsfrom Time-Series Planet Imageries. Remote Sens. 2021, 13, 3073. [Google Scholar] [CrossRef]
- Jiang, Z.; Huete, A.R.; Didan, K.; Miura, T. Development of a two-band enhanced vegetation index without a blue band. Remote Sens. Environ. 2008, 112, 3833–3845. [Google Scholar] [CrossRef]
- Duchemin, B.; Maisongrande, P.; Boulet, G.; Benhadj, I. A simple algorithm for yield estimates: Evaluation for semi-arid irrigated winter wheat monitored with green leaf area index. Environ. Model. Softw. 2008, 23, 876–892. [Google Scholar] [CrossRef] [Green Version]
- Bengio, Y. Learning Deep Architectures for AI; Now Publishers Inc.: Delft, The Netherlands, 2009. [Google Scholar]
- Duan, Q.Y.; Gupta, V.K.; Sorooshian, S. Shuffled complex evolution approach for effective and efficient global minimization. J. Optim. Theory Appl. 1993, 76, 501–521. [Google Scholar] [CrossRef]
- Duan, Q.; Sorooshian, S.; Gupta, V.K. Optimal use of the SCE-UA global optimization method for calibrating watershed models. J. Hydrol. 1994, 158, 265–284. [Google Scholar] [CrossRef]
- Dong, T.; Liu, J.; Qian, B.; Zhao, T.; Jing, Q.; Geng, X.; Wang, J.; Huffman, T.; Shang, J. Estimating winter wheat biomass by assimilating leaf area index derived from fusion of Landsat-8 and MODIS data. Int. J. Appl. Earth. Obs. 2016, 49, 63–74. [Google Scholar] [CrossRef]
- Kang, Y.; Ozdogan, M. Field-level crop yield mapping with Landsat using a hierarchical data assimilation approach. Remote Sens. Environ. 2019, 228, 144–163. [Google Scholar] [CrossRef]
- Wang, E.; Martres, P.; Zhao, Z.; Ewert, F.; Maiorano, A.; Rötter, R.; Kimball, B.A.; Ottman, M.J.; Wall, G.W.; White, J.W.; et al. The uncertainty of crop yield projections is reduced by improved temperature response functions. Nat. Plants 2017, 3, 17102. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Claverie, M.; Demarez, V.; Duchemin, B.; Hagolle, O.; Keravec, P.; Marciel, B.; Ceschia, E.; Dejoux, J.F.; Dedieu, G. Spatialization of crop leaf area index and biomass by combining a simple crop model SAFY and high spatial and temporal resolutions remote sensing data. In Proceedings of the 2009 IEEE International Geoscience and Remote Sensing Symposium, Cape Town, Africa, 12–17 July 2009. [Google Scholar] [CrossRef]
- Tzeng, E.; Hoffman, J.; Zhang, N.; Saenko, K.; Darrell, T. Deep Domain Confusion: Maximizing for Domain Invariance. arXiv 2014, arXiv:1412.3474. [Google Scholar]
- Yosinski, J.; Clune, J.; Bengio, Y.; Lipson, H. How Transferable Are Features in Deep Neural Networks? In Proceedings of the Advances in Neural Information Processing Systems 27 (NIPS 2014), Montreal, QC, Canada, 8–13 December 2014. [Google Scholar]
- Tan, C.; Sun, F.; Kong, T.; Zhang, W.; Yang, C.; Liu, C. A Survey on Deep Transfer Learning. In Proceedings of the 27th International Conference on Artificial Neural Networks, Rhodes, Greece, 4–7 October 2018. [Google Scholar]
- Chu, W.; Gao, X.; Sorooshian, S. A new evolutionary search strategy for global optimization of high-dimensional problems. Inf. Sci. 2011, 181, 4909–4927. [Google Scholar] [CrossRef] [Green Version]
- Roth, L.; Streit, B. Predicting cover crop biomass by lightweight UAS-based RGB and NIR photography: An applied photogrammetric approach. Precis. Agric. 2018, 19, 93–114. [Google Scholar] [CrossRef] [Green Version]
- Zhao, Y.; Meng, Y.; Feng, H.; Han, S.; Yang, G.; Li, Z. Should phenological information be applied to predict agronomic traits across growth stages of winter wheat? Crop J. 2022, 10, 1346–1352. [Google Scholar] [CrossRef]
- Yue, J.; Yang, G.; Li, C.; Li, Z.; Wang, Y.; Feng, H.; Xu, B. Estimation of winter wheat above-ground biomass using unmanned aerial vehicle-based snapshot hyperspectral sensor and crop height improved models. Remote Sens. 2017, 9, 708. [Google Scholar] [CrossRef] [Green Version]
- Duan, D.; Zhao, C.; Li, Z.; Yang, G. Estimating total leaf nitrogen concentration in winter wheat by canopy hyperspectral data and nitrogen vertical distribution. J. Integr. Agric. 2019, 18, 1562–1570. [Google Scholar] [CrossRef]
- Jones, J.W.; Hoogenboom, G.; Porter, C.H.; Boote, K.J.; Batchelor, W.D.; Hunt, L.A.; Wilkens, P.W.; Singh, U.; Gijsman, A.J.; Ritchie, J.T. The DSSAT cropping system model. Eur. J. Agron. 2003, 18, 235–265. [Google Scholar] [CrossRef]
- Keating, B.A.; Carberry, P.S.; Hammer, G.L.; Probert, M.E.; Robertson, M.J.; Holzworth, D.; Huth, N.I.; Hargreaves, J.N.G.; Meinke, H.; Hochman, Z.; et al. An overview of APSIM, a model designed for farming systems simulation. Eur. J. Agron. 2003, 18, 267–288. [Google Scholar] [CrossRef] [Green Version]
- Dzotsi, K.A.; Jones, J.W.; Adiku, S.G.K.; Naab, J.B.; Singh, U.; Porter, C.H.; Gijsman, A.J. Modeling soil and plant phosphorus within DSSAT. Ecol. Model. 2010, 221, 2839–2849. [Google Scholar] [CrossRef]
- Della Peruta, R.; Keller, A.; Schulin, R. Sensitivity analysis, calibration and validation of EPIC for modelling soil phosphorus dynamics in Swiss agro-ecosystems. Environ. Model. Softw. 2014, 62, 97–111. [Google Scholar] [CrossRef]
- Zhang, Y.; Hui, J.; Qin, Q.; Sun, Y.; Zhang, T.; Sun, H.; Li, M. Transfer-learning-based approach for leaf chlorophyll content estimation of winter wheat from hyperspectral data. Remote Sens. Environ. 2021, 267, 112724. [Google Scholar] [CrossRef]
Bands | Wavelength (nm) | Spatial Resolution (m) |
---|---|---|
Blue | 455–515 | 3 |
Green | 500–590 | 3 |
Red | 560–670 | 3 |
NIR | 780–860 | 3 |
Parameter | Abbreviation | Unit | Value | References | |
---|---|---|---|---|---|
Fixed | Climatic efficiency | - | 0.48 | Duchemin et al. [39] | |
Light-interception coefficient | - | 0.5 | Duchemin et al. [39] | ||
The optimal temperature | Topt | °C | 21 | Wang et al. [45] | |
Minimum temperatur | Tmin | °C | 0 | Wang et al. [45] | |
Maximum temperatur | Tmax | °C | 37 | Wang et al. [45] | |
Specific leaf area | SLA | m2/g | 0.022 | Claverie et al. [46] | |
Initial aboveground biomass | AGB0 | g/m2 | 4.5 | Calibrated | |
Leaf Partitioning Coefficient a | Pla | - | 0.16 | Calibrated | |
Leaf Partitioning Coefficient b | Plb | - | 1.4 | Calibrated | |
Senesce rate | Rs | °C/d | 10.8 | Calibrated | |
Calibrated | Day of emergence | D0 | d | 0–15 | This study |
Sum of temperature | STT | °C | 1200–1600 | This study | |
Effective Light Use Efficiency | ELUE | g/MJ | 1.3–2.5 | This study |
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations. |
© 2022 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Zhao, Y.; Han, S.; Meng, Y.; Feng, H.; Li, Z.; Chen, J.; Song, X.; Zhu, Y.; Yang, G. Transfer-Learning-Based Approach for Yield Prediction of Winter Wheat from Planet Data and SAFY Model. Remote Sens. 2022, 14, 5474. https://doi.org/10.3390/rs14215474
Zhao Y, Han S, Meng Y, Feng H, Li Z, Chen J, Song X, Zhu Y, Yang G. Transfer-Learning-Based Approach for Yield Prediction of Winter Wheat from Planet Data and SAFY Model. Remote Sensing. 2022; 14(21):5474. https://doi.org/10.3390/rs14215474
Chicago/Turabian StyleZhao, Yu, Shaoyu Han, Yang Meng, Haikuan Feng, Zhenhai Li, Jingli Chen, Xiaoyu Song, Yan Zhu, and Guijun Yang. 2022. "Transfer-Learning-Based Approach for Yield Prediction of Winter Wheat from Planet Data and SAFY Model" Remote Sensing 14, no. 21: 5474. https://doi.org/10.3390/rs14215474