Portal de Periódicos da CAPES

Identifying sunlit leaves using Convolutional Neural Networks: An expert system for measuring the crop water stress index of pistachio trees

2022; Elsevier BV; Volume: 209; Linguagem: Inglês

10.1016/j.eswa.2022.118326

1873-6793

Minas Pantelidakis, Athanasios Aris Panagopoulos, Konstantinos Mykoniatis, Shawn Ashkan, Rajeswari Cherupillil Eravi, Vishnu Pamula, Enrique Cruz Verduzco, Oleksandr Babich, Orestis P. Panagopoulos, Georgios Chalkiadakis,

Remote Sensing in Agriculture

Precision irrigation has been proposed as a key means towards a sustainable agriculture future. Many such techniques use infrared and/or visible-spectrum images to measure the canopy temperature. This, in turn, is utilized to calculate the crop water stress index (CWSI). Sunlit leaves are likely to get under stress sooner and to a higher extent compared to non-sunlit ones. As such, using only sunlit leaves for measuring canopy temperature can be beneficial for precision irrigation purposes. However, existing work generally does not separate sunlit from non-sunlit leaves. The works that do attempt to do so generally use empirical techniques and do not come with thorough evaluation results. In this work, we propose a novel generic method to identify sunlit leaves with high accuracy and high precision. The backbone of our approach is a convolutional neural network (CNN) technique for segmenting sunlit leaves in visible-spectrum images. This is the first work to propose a strictly supervised learning technique for sunlit-leaf segmentation. We release the first dataset for sunlit-leaf segmentation for pistachio trees. We evaluate four different CNN architectures for this task, namely FRRN-A, FC-DenseNet103, ResNet101-DeepLabV3, and SegNet. We show that CNNs can improve the accuracy and precision of sunlit-leaf segmentation by over 100% and 350%, respectively, when compared to the state of the art. Furthermore, we propose an expert system for measuring the CWSI of pistachio trees that incorporates CNN-based sunlit-leaf segmentation. We introduce the expert system to the public as a free-of-charge web-based tool.