Development of a robot with 3D perception for accurate row following in vineyard

Yubin Lan, Lijie Geng, Wenhua Li, WeiXu Ran, Xiang Yin, Lili Yi

Abstract


Abstract: In this paper, a localization and navigation guidance algorithm based on the tree row in orchards for agricultural robots was proposed.  In this algorithm, the tree rows formed by the trunks of parallel planting grape trees were used as auxiliary information.  Together with the relative position provided by IMU, odometer and 3D LiDAR, the proposed algorithm  was used to calculate the position and orientation of the moving robot.  Firstly, the coordinates of the robot were obtained by the vehicle positioning system, and then the orientation of the tree and the posture of the robot relative to the tree row were determined through the 3D LiDAR point cloud, to ensure that the robot can parallel walk along the tree row and maintain a specific distance.  Finally, the odometer, IMU data and LiDAR point cloud image were deeply fused to determine the accurate position and orientation to complete the path planning in the orchards.  Experimental results show that the algorithm can effectively improve the positioning accuracy of the robot walking in the orchard and ensure that the robot can walk along the tree row without hitting the trees.

Keywords: Autonomous robot, tree row navigation, 3D LiDAR, Kalman filter, estimation, detection

DOI: 10.33440/j.ijpaa.20210402.177

 

Citation: Lan Y B, Geng L J, Li W H, Ran W X, Yin X, Yi L L.  Development of a robot with 3D perception for accurate row following in vineyard.  Int J Precis Agric Aviat, 2021; 4(2): 14–21.


Full Text:

PDF

References


Moorehead S, Wellington C, Gilmore B, Vallespi C. Automating Orchards: A System of Autonomous Tractors for Orchard Maintenance. In: Proceedings of International Scientific Conference. 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2012.

Abe Y, Kamiya K, Osaki T, Kawano R, Miki N, Takeuchi S. Proceedings of the IEEE International Conference on Micro Electro Mechanical Systems (MEMS). In: Proceedings of International Scientific Conference “IEEE International Conference on Micro Electro Mechanical Systems”, 2007.

Wendeberg J, Schindelhauer C. Polynomial-time approximation algorithms for anchor-free TDoA localization. Theoretical Computer Science, 2014, 553: 27–36. doi: 10.1016/j.tcs.2014.04.007.

Zhao S, Chen Y M, Jay A F. High-Precision Vehicle Navigation in Urban Environments using a Low-cost Single-frequency RTK GPS Receiver. In: Proceedings of International Scientific Conference “2013 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)”, 2013. doi: 10.1109/TITS.2016.2529000.

Jasurbek K, Park Y, Aamir S M. Survey of NLOS identification and error mitigation problems in UWB-based positioning algorithms for dense environments. annals of telecommunications, 2010, 65(5): 301–311. doi: 10.1007/s12243-009-0124-z.

Yi L L, Sirajudeen G R, Lin Z P, See C M. Target tracking in mixed LOS/NLOS environments based on individual TOA measurement detection. IEEE Transactions on Wireless Communications, 2014, 13(1): 99–111. doi: 10.1109/SAM.2010.5606720.

Andrew B D, Gregory P A. Advances in animal ecology from 3D-LiDAR ecosystem mapping. Trends in Ecology & Evolution, 2014, 29(12): 681–691. doi: 10.1016/j.tree.2014.10.005.

Hu J S, Wang J J, Daniel M H. Design of Sensing System and Anticipative Behavior for Human Following of Mobile Robots. in 2014 IEEE Transactions on Industrial Electronics, 2014, 61(4): 1916–1927. doi: 10.1109/TIE.2013.2262758.

Zhang J, Andrew D C, Silvio M M, Marcel B, Sanjiv S. 3D perception for accurate row following: Methodology and results. In: Proceedings of International Scientific Conference “2013 IEEE/RSJ International Conference on Intelligent Robots and Systems, 2013: 5306-5313. doi: 10.1109/IROS.2013.6697124.

Kong H, Jean Y A, Jean P. General Road Detection From a Single Image. in IEEE Transactions on Image Processing, 2010, 19(8): 2211–2220. doi: 10.1109/TIP.2010.2045715.

Zhang X Y, Liu P B, Zhang C X. An Integration Method of Inertial Navigation System and Three-Beam Lidar for the Precision Landing. Mathematical Problems in Engineering, 2016: 1–13. doi: 10.1155/2016/4892376.

Paul D G. Principles of GNSS, inertial, and multisensor integrated navigation systems. in IEEE Aerospace and Electronic Systems Magazine 2015, 30(2): 26–27. doi: 10.1109/MAES.2014.14110.

Han H Z, Wang J, Wang J J, Tan X L. Performance Analysis on Carrier Phase-Based Tightly-Coupled GPS/BDS/INS Integration in GNSS Degraded and Denied Environments. Sensors, 2015, 15(4): 8685–8711. doi: 10.3390/s150408685.

Liu L, Tao M, Niu R X, Wang J, et al. RBF-Based Monocular Vision Navigation for Small Vehicles in Narrow Space below Maize Canopy. Applied Sciences, 2016; 6(6):182. doi: 10.3390/app6060182.

Neda N, Rene J L, Cheng J H, Denis G. A New Technique for Integrating MEMS-Based Low-Cost IMU and GPS in Vehicular Navigation. Journal of Sensors, 2016, 2016(4): 1–16. doi: 10.1155/2016/5365983.

Beau T, Lee D J, Kirt D L, James K A. Review of stereo vision algorithms and their suitability for resource-limited systems. Journal of Real-Time Image Processing, 2016, 11(1): 5–25. doi: 10.1007/s11554-012-0313-2.

Jaemin B, Beom S S, Lee J H. Toward Accurate Road Detection in Challenging Environments Using 3D Point Clouds. ETRI Journal, 2015, 37(3): 606–616. doi: 10.4218/etrij.15.0113.1131.

Naoum T, Dimitrios B, Dionysis B. AgROS: A Robot Operating System Based Emulation Tool for Agricultural Robotics. Agronomy, 2019, 9(7): 403. doi: 10.3390/agronomy9070403.

Björn Å, Albert J B. A vision based row-following system for agricultural field machinery. Mechatronics, 2006, 15(2): 251–269. doi: 10.1016/j.mechatronics.2004.05.005

Satow T, Matsuda K, Ming S B, Hironaka, K, Tan D. Development of laser crop row sensor for automatic guidance system of implements. In: Proceedings of International Scientific Conference Automation Technology for Off-road Equipment Conference, 2004. doi: 10.13031/2013.17826.

Biber P, Ulrich W, Albert, A. Navigation system of the autonomous agricultural robot bonirob. In: Proceedings of International Scientific Conference 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems, 2012.

Pieter M B, Koen V B, Frits K V E, Joris I, Gook H K. Robot navigation in orchards with localization based on Particle filter and Kalman filter. Computers and Electronics in Agriculture, 2019, 157: 261–269. doi: 10.1016/j.compag.2018.12.046

Zhang S, Guo C Y, Gao Z N, Adilet S, Chen J. Research on 2D Laser Automatic Navigation Control for Standardized Orchard. Applied Sciences, 2020, 10(8): 2763. doi: 10.3390/app10082763.

Li Y W, Wang X J, Liu D X. 3D Autonomous Navigation Line Extraction for Field Roads Based on Binocular Vision. Journal of Sensors, 2019, 2019(8): 1–16. doi: 10.1155/2019/6832109.

Bruna P P, Jose P M. Path errors in sugarcane transshipment trailers. Engenharia Agrícola, 2020, 40(2): 223–231. doi: 10.1590/1809-4430- Eng.Agric.v40n2p223-231/2020.

Lyu H K, Park C H, Han D H, Kwak S, Choi B. Orchard Free Space and Center Line Estimation Using Naive Bayesian Classifier for Unmanned Ground Self-Driving Vehicle. Symmetry, 2018, 10(9): 1–14. doi: 10.3390/sym10090355.

Hao Z, Xiong H L, Liu Y, Tan N D, Chen L. Trajectory Planning Algorithm of UAV Based on System Positioning Accuracy Constraints. Electronics, 2020, 9(2): 250. doi: 10.3390/electronics9020250.

Sebastian T. Fox D. Probabilistic Robotics. Communications of the ACM, 2002, 45(3): 52–57. doi: 10.1145/504729.504754.


Refbacks

  • There are currently no refbacks.


Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.