Farmland human-shape obstacles identification based on Viola-Jones Algorithm

Linlin Wang, Wenwei Xiao, Yuan Qi, Qichao Gao, Lin Li, Kangting Yan, Yali Zhang, Yubin Lan

Abstract


Abstract: When agricultural unmanned aerial vehicle (UAV) is spraying in the field or hovering on the ridge, there is a possibility that obstacles without moving characteristics represented by humans may collide with agricultural UAV.  In order to quickly identify and detect human-shape obstacles, realize the safe operation of agricultural UAV, this paper proposes a new method based on Viola-Jones Algorithm according to the head-shoulder ratio characteristics of Chinese adults and the basic spraying parameters of agricultural UAV.  The cascade object detector is used to detect people’s upper bodies area of all humanoid obstacles in the view field of the agricultural UAV’s flight direction, and the extracted upper body image is binarized to obtain the relevant projection histogram and calculate the width ratio and distance ratio of head-shoulder, then judge whether it is a human-shape obstacle, and combine the depth and position information to avoid the danger of collision.  The test results show that the method is feasible and effective in recognizing human-shape obstacles on the front or back in the farmland within the sight distance of6 meters.

Keywords: agricultural UAV, binocular vision, picture processing, human-shape obstacles, MATLAB

DOI: 10.33440/j.ijpaa.20200303.99

 

Citation: Wang L L, Xiao W W, Qi Y, Gao Q C,Li L, Yan K T, Zhang Y L, Lan Y B.  Farmland human-shape obstacles identification based on Viola-Jones Algorithm.  Int J Precis Agric Aviat, 2020; 3(3): 35–40.


Full Text:

PDF

References


Wang L L, Lan Y B, Zhang Y L, et al. Applications and prospects of agricultural unmanned aerial vehicle obstacle avoidance technology in China. Sensors, 2019; 19(3): 642. doi: 10.3390/s19030642

Ministry of Industry and Information Technology of the People’s Republic

of China. Available online: http://www.miit.gov.cn/n1146285/n1146352/ n3054355/n7697926/n7697940/c7715291/content.html(accessed on 26 1 2018).

Lan Y B, Wang G B. Development Situation and Prospect of Plant Protection UAV Industry in China. Agricultural Engineering Technology, 2018; 38, 17–27. (in Chinese) doi: 10.16815/j.cnki.11-5436/s.2018.09

Lan Y B, Chen S D. Current status and trends of plant protection UAV and its spraying technology in China. Int J Precis Agric Aviat, 2018; 1(1): 1–9. doi: 10.33440 / j.ijpaa.20180101.0002

Dalal N, Triggs B. Histograms of oriented gradients for human detection. 2005 IEEE computer society conference on computer vision and pattern recognition (CVPR'05). IEEE, 2005, 1: 886-893. doi: 10.1109/ CVPR.2005.177

Guo Z, Zhang L, Zhang D. Rotation invariant texture classification using LBP variance (LBPV) with global matching. Pattern recognition, 2010, 43(3): 706–719. doi: 10.1016/j.patcog.2009.08.017

Papageorgiou C P, Oren M, Poggio T. A general framework for object detection. Sixth International Conference on Computer Vision (IEEE Cat. No. 98CH36271). IEEE, 1998: 555-562.doi:10.1109/ICCV.1998.710772

Lienhart R, Maydt J. An extended set of haar-like features for rapid object detection.Proceedings. international conference on image processing. IEEE, 2002, 1: I–I. doi: 10.1109 / ICIP.2002.1038171

Wang X, Han T X, Yan S. An HOG-LBP human detector with partial occlusion handling. 2009 IEEE 12th international conference on computer vision. IEEE, 2009: 32-39. doi: 10.1109/ICCV.2009.5459207

Train a Cascade Object Detector. Available online: https://www.mathworks.com/help/vision/ug/train-a-cascade-object-detector.html.

Viola P, Jones M. Rapid object detection using a boosted cascade of simple features. Proceedings of the 2001 IEEE computer society conference on computer vision and pattern recognition. CVPR 2001. IEEE, 2001, 1: I–I. doi: 10.1109 / CVPR.2001.990517

Yang S H, Zheng Y J, Liu X X. Research status and trends of downwash airflow of spray UAVs in agriculture. Int J Precis Agric Aviat, 2019; 2(1): 1–8. doi: 10.33440 / j.ijpaa.20190201.0023

Kong H, Yi L L, Lan Y B, Kong F X, Han X. Exploring the operation mode of spraying cotton defoliation agent by plant protection UAV. Int J Precis Agric Aviat, 2020; 3(1): 43–48. doi: 10.33440/j.ijpaa.20200301.65

Bux A, Angelov P, Habib Z. Vision based human activity recognition: a review. Advances in Computational Intelligence Systems. Springer, Cham, 2017; 341–371.

Benfold B, Reid I. Stable multi-target tracking in real-time surveillance video. CVPR 2011. IEEE, 2011: 3457–3464. doi: 10.1109 / CVPR.2011.5995667

Ding Y L. Man Machine Engineering (5th edition).Beijing: Beijing Institute of Technology Press (BITP), 2015. (in Chinese)

National Health Commission of the People’s Republic of China. Available online: http://www.nhc.gov.cn/jkj/s5879/201506/ 4505528e65f3460fb88685081ff158a2.shtml (accessed on 30 6 2015).

Hoai M, Zisserman A. Talking heads: Detecting humans and recognizing their interactions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2014: 875–882.

Xiao H J, Zhao S G, Zhang L. Head-shoulder detection HOG-LBP based feature fusion. Microcomputer & its applications, 2015, 34(5): 43–46. (in Chinese) doi: 10.3969/j.issn.1674-7720.2015.05.015

vision.CascadeObjectDetector. Available online: https://www.mathworks.com/help/vision/ref/vision.cascadeobjectdetector-system-object.html.

Otsu N. A Threshold Selection Method from Gray-Level Histograms. IEEE Transactions on Systems, Man, and Cybernetics, 1979, 9(1): 62–66. doi: 10.1109/TSMC.1979.4310076

Chen H W, McGurr M. Moving human full body and body parts detection, tracking, and applications on human activity estimation, walking pattern and face recognition. Automatic Target Recognition XXVI. International Society for Optics and Photonics, 2016, 9844: 98440T. doi: 10.1117/12.2224319

Dollár P, Wojek C, Schiele B, et al. Pedestrian detection: A benchmark. 2009 IEEE Conference on Computer Vision and Pattern Recognition. IEEE, 2009: 304-311. doi: 10.1109 / CVPR.2009.5206631


Refbacks

  • There are currently no refbacks.


Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.