Abstract
Plants are complex 3D structures that present real challenges for computer vision, due to their self-similarity, the presence of self-occultation, or the low color contrasts between certain organs (particularly leaves). The need for plant imagery is growing for applications in biology and agriculture, where digital technology provides objective repeatability, high-throughput parallelization capability, observations on temporal-spatial scales and spectral ranges that are inaccessible to human eyes. In this context, the use of low-cost RGB-Depth cameras as introduced in 2012 [1], by hijacking the "Kinect" video game sensor at the time, is proving to be a very powerful tool for segmenting leaves, characterizing the 3D shape of plant cover or detecting the effect of biotic and abiotic stresses. This presentation summarizes the work [1-6] carried out by our group on this subject over more than a decade.
References:
[1] Chéné, Y., Rousseau, D., Lucidarme, P., Bertheloot, J., Caffier, V., Morel, P., ... & Chapeau-Blondeau, F. (2012). On the use of depth camera for 3D phenotyping of entire plants. Computers and Electronics in Agriculture, 82, 122-127.
[2] Chéné, Y., Belin, É., Rousseau, D., & Chapeau-Blondeau, F. (2013). Multiscale analysis of depth images from natural scenes: Scaling in the depth of the woods. Chaos, Solitons & Fractals, 54, 135-149.
[3] Chéné, Y., Rousseau, D., Belin, É., Garbez, M., Galopin, G., & Chapeau-Blondeau, F. (2016). Shape descriptors to characterize the shoot of entire plant from multiple side views of a motorized depth sensor. Machine Vision and Applications, 27, 447-461.
[4] Garbouge, H., Rasti, P., & Rousseau, D. (2021). Enhancing the Tracking of Seedling Growth Using RGB-Depth Fusion and Deep Learning. Sensors, 21(24), 8425.
[5] Couasnet, G., Cordier, M., Garbouge, H., Mercier, F., Pierre, D., El Ghaziri, A. Rousseau, D. (2023). Growth Data—An automatic solution for seedling growth analysis via RGB-Depth imaging sensors. SoftwareX, 24, 101572.
[6] Cordier M., Metuarea H., Bencheikh M., Rasti R., Torrez C., Rousseau D. (2023) Leaf segmentation of seedlings using foundation model on RGB-Depth images, ICCV Computer vision for plant phenotyping and agriculture workshop