TY - JOUR
T1 - Direct and accurate feature extraction from 3D point clouds of plants using RANSAC
AU - Ghahremani, Morteza
AU - Williams, Kevin
AU - Corke, Fiona M K
AU - Tiddeman, Bernie
AU - LIU, YONGHUAI
AU - Doonan, John
N1 - Funding Information:
The authors gratefully acknowledge the HPC resources provided by Supercomputing Wales (SCW) and Aberystwyth University. We also thank Katie L. Awty-Carroll for helping to set-up the multi-view cameras and Wanneng Yang for the grapevine datasets. MG acknowledges DCDS and President scholarships from Aberystwyth University. JHD and YL acknowledge funding from the BBSRC (reference number BB/R02118X/1) and JHD is also supported by funding from the BBSRC (reference number BBS/E/W/0012844A and BB/P003095/1) and EU (Grant Agreement 731013).
Funding Information:
The authors gratefully acknowledge the HPC resources provided by Supercomputing Wales (SCW) and Aberystwyth University. We also thank Katie L. Awty-Carroll for helping to set-up the multi-view cameras and Wanneng Yang for the grapevine datasets. MG acknowledges DCDS and President scholarships from Aberystwyth University. JHD and YL acknowledge funding from the BBSRC (reference number BB/R02118X/1) and JHD is also supported by funding from the BBSRC (reference number BBS/E/W/0012844A and BB/P003095/1) and EU (Grant Agreement 731013).
Publisher Copyright:
© 2021 Elsevier B.V.
PY - 2021/8
Y1 - 2021/8
N2 - While point clouds hold promise for measuring the geometrical features of 3D objects, their application to plants remains problematic. Plants are three dimensional (3D) organisms whose morphology is complex, varies from one individual to another and changes over time. Objective measurement of attributes in 3D point cloud domain is increasingly attractive as techniques improve the accuracy and reduce computational time. Analysis of point cloud data, however, is not straightforward, due to its discrete nature, imaging noise and cluttered background. In this paper, we introduce a robust method for the direct analysis of plants of point cloud data. To this end, we generalise the random sample consensus (RANSAC) algorithm for the analysis of 3D point cloud data and then use it to model different plant organs. Since 3D point clouds are obtained from multi-view stereo images, they are often contaminated with a considerable level of noise, distortions and out-of-distribution points. Key to our approach is the use of the RANSAC algorithm on 3D point cloud, making our technique more robust to undesirable outliers. We tested our proposed method on Brassica and grapevine by comparing the estimated measurements extracted from the models with manual ones taken from the actual plants. Our proposed method achieved R
2>0.90 for measured diameters of branches and stems in Brassica while it yielded R
2>0.91 for the measured leaf angles of grapevine and branch angles of Brassica. In all cases, the approach produced stable performance under imaging noise and cluttered background while the conventional methods often failed to work.
AB - While point clouds hold promise for measuring the geometrical features of 3D objects, their application to plants remains problematic. Plants are three dimensional (3D) organisms whose morphology is complex, varies from one individual to another and changes over time. Objective measurement of attributes in 3D point cloud domain is increasingly attractive as techniques improve the accuracy and reduce computational time. Analysis of point cloud data, however, is not straightforward, due to its discrete nature, imaging noise and cluttered background. In this paper, we introduce a robust method for the direct analysis of plants of point cloud data. To this end, we generalise the random sample consensus (RANSAC) algorithm for the analysis of 3D point cloud data and then use it to model different plant organs. Since 3D point clouds are obtained from multi-view stereo images, they are often contaminated with a considerable level of noise, distortions and out-of-distribution points. Key to our approach is the use of the RANSAC algorithm on 3D point cloud, making our technique more robust to undesirable outliers. We tested our proposed method on Brassica and grapevine by comparing the estimated measurements extracted from the models with manual ones taken from the actual plants. Our proposed method achieved R
2>0.90 for measured diameters of branches and stems in Brassica while it yielded R
2>0.91 for the measured leaf angles of grapevine and branch angles of Brassica. In all cases, the approach produced stable performance under imaging noise and cluttered background while the conventional methods often failed to work.
KW - Point cloud
KW - 3D analysis
KW - Random sample consensus (RANSAC)
KW - Brassica
KW - Grapevine
U2 - 10.1016/j.compag.2021.106240
DO - 10.1016/j.compag.2021.106240
M3 - Article (journal)
SN - 0168-1699
VL - 187
JO - Computers and Electronics in Agriculture
JF - Computers and Electronics in Agriculture
M1 - 106240
ER -