Skip to main content
SpringerLink
Log in

Vanishing point estimation inspired by oblique effect in a field environment

  • Research Article
  • Published:
Cognitive Neurodynamics Aims and scope Submit manuscript

Abstract

Estimating a vanishing point (VP) is a core problem for understanding three-dimensional scenes and autonomous navigation. Existing methods are essential to estimating VPs in indoor and urban environments. However, doing so in diverse, unstructured, changing, and unexpected field environments remains a considerable challenge. Traditional methods of estimating structural VP have some shortcomings as they rely heavily on feature-intensive computation, making them less reliable due to a lack of adequate structures in a field environment due to disorganized disturbances. Inspired by the oblique effect, neurons prefer to respond to horizontal and vertical stimuli more than to diagonal, which can help estimate VPs. This study proposes a methodology to estimate VPs from a monocular camera for a field environment. Local orientation features are assigned to clusters inspired by the oblique effect. By extracting end points of different clusters, virtual local orientation features are reshaped. Based on geometric inferences of orientation, a VP is approximately estimated using optimal estimation and self-selectability. No prior training is needed, and camera calibration and internal parameters are not required. This approach is robust to changes in color and illumination using geometric inference, making it a perfect fit for field environments. Experimental results demonstrated that the method can successfully estimate VPs. This study presents a groundbreaking approach to evaluating VPs using a monocular camera. Inspired by the oblique effect, our method relies on explainable geometric inferences instead of prior training, resulting in a highly robust model that can handle changes in color and illumination. Our proposed approach significantly advances scene understanding and navigation, making it an ideal solution for field environments.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Algorithm 1
Fig. 5
Algorithm 2
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15

Similar content being viewed by others

Data availability

The data are available from the corresponding author upon reasonable request.

References

  • Borji A (2016) Vanishing point detection with convolutional neural networks. arXiv:1609.00967

  • Bui TH, Saitoh T, Nobuyama E (2013) Road area detection based on texture orientations estimation and vanishing point detection. In: The SICE annual conference, pp 1138–1143

  • Chang C, Zhao J, Itti L (2018) DeepVP: deep learning for vanishing point detection on 1 million street view images. In: IEEE international conference on robotics and automation, ICRA , Brisbane, Australia, May 21–25. IEEE, pp 1–8

  • Cheng M, Zhang Y, Su Y, Alvarez JM, Kong H (2018) Curb detection for road and sidewalk detection. IEEE Trans Veh Technol 67(11):10330–10342

    Article  Google Scholar 

  • Coughlan JM, Yuille AL (2003) Manhattan world: orientation and outlier detection by Bayesian inference. Neural Comput 15(5):1063–1088

    Article  PubMed  Google Scholar 

  • Denis P, Elder JH, Estrada FJ (2008) Efficient Edge-Based Methods for Estimating Manhattan Frames in Urban Imagery. In: Forsyth DA, Torr PHS, Zisserman A (eds) 10th European conference on computer vision, Marseille, France, October 12–18, Proceedings, Part II. vol. 5303 of Lecture Notes in Computer Science. Springer, pp 197–210

  • Ding W, Li Y, Liu H (2016) Efficient vanishing point detection method in unstructured road environments based on dark channel prior. IET Comput Vis 10(8):852–860

    Article  Google Scholar 

  • Gibson EJ, Walk RD (1960) The visual cliff. Sci Am 202:64–71

    Article  CAS  PubMed  Google Scholar 

  • Guo Y, Liu F, Ma Y (2023) Vanishing point detection of unstructured road based on two-line exhaustive search. In: Subramanian K (ed) Third international conference on intelligent computing and human-computer interaction (ICHCI 2022). vol 12509. SPIE, p 125090V

  • Han J, Yang Z, Hu G, Zhang T, Song J (2019) Accurate and robust vanishing point detection method in unstructured road scenes. J Intell Robotic Syst 94(1):143–158

    Article  Google Scholar 

  • He ZJ, Nakayama K (1995) Visual attention to surfaces in three-dimensional space. Proc Natl Acad Sci U S A 92(24):11155–11159

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  • Hidayat R, Yanto ITR, Ramli AA, Fudzee MFM, Ahmar AS (2021) Generalized normalized Euclidean distance based fuzzy soft set similarity for data classification. Comput Syst Sci Eng 38(1):119–130

    Article  Google Scholar 

  • Huang L, Shou T, Chen X, Yu H, Sun C, Liang Z (2006) Slab-like functional architecture of higher order cortical area 21a showing oblique effect of orientation preference in the cat. Neuroimage 32(3):1365–1374

    Article  PubMed  Google Scholar 

  • Jang J, Jo Y, Shin M, Paik J (2021) Camera orientation estimation using motion-based vanishing point detection for advanced driver-assistance systems. IEEE Trans Intell Transp Syst 22(10):6286–6296

    Article  Google Scholar 

  • Kamil DA, Wahyono, Harjoko A (2022) Vanishing point detection using angle-based hough transform and RANSAC. In: Seventh international conference on informatics and computing (ICIC), pp 1–5

  • Kloukiniotis A, Moustakas K (2022) Vanishing point detection based on the fusion of lidar and image data. In: 30th Mediterranean conference on control and automation, MED, Vouliagmeni, Greece, June 28–July 1. IEEE, pp 688–692

  • Koenderink JJ, Doorn AJV, Kappers AM (1996) Pictorial surface attitude and local depth comparisons. Percept Psychophys 58(2):163–173

    Article  CAS  PubMed  Google Scholar 

  • Kong H, Audibert J, Ponce J (2010) General road detection from a single image. IEEE Trans Image Process 19(8):2211–2220

    Article  PubMed  Google Scholar 

  • Kong H, Sarma SE, Tang F (2013) Generalizing Laplacian of Gaussian filters for vanishing-point detection. IEEE Trans Intell Transp Syst 14(1):408–418

    Article  Google Scholar 

  • Li Y, Tong G, Sun A, Ding W (2018) Road extraction algorithm based on intrinsic image and vanishing point for unstructured road image. Robot Auton Syst 109:86–96

    Article  Google Scholar 

  • Li H, Zhao J, Bazin J, Liu Y (2022) Quasi-globally optimal and near/true real-time vanishing point estimation in Manhattan world. IEEE Trans Pattern Anal Mach Intell 44(3):1503–1518

    Article  PubMed  Google Scholar 

  • Li H, Kim P, Zhao J, Joo K, Cai Z, Liu Z, et al. (2020) Globally Optimal and Efficient Vanishing Point Estimation in Atlanta World. In: Vedaldi A, Bischof H, Brox T, Frahm J (eds) 16th European Conference, Glasgow, UK, August 23–28, Proceedings, Part XXII. vol. 12367 of Lecture Notes in Computer Science. Springer, pp 153–169

  • Liu Y, Zeng M, Meng Q (2021) Unstructured road vanishing point detection using convolutional neural networks and heatmap regression. IEEE Trans Instrum Meas 70:1–8

    Article  Google Scholar 

  • Moghadam P, Starzyk JA, Wijesoma WS (2012) Fast vanishing-point detection in unstructured environments. IEEE Trans Image Process 21(1):425–430

    Article  PubMed  Google Scholar 

  • Ozcelik YB, Altan A (2023a) Classification of diabetic retinopathy by machine learning algorithm using entropy-based features. In: Cankaya international congress on scientific research, pp 523–535

  • Ozcelik YB, Altan A (2023b) Overcoming nonlinear dynamics in diabetic retinopathy classification: a robust ai-based model with chaotic swarm intelligence optimization and recurrent long short-term memory. Fractal Fract 7(8):598

    Article  Google Scholar 

  • Rasmussen C (2008) RoadCompass: following rural roads with vision + ladar using vanishing point tracking. Auton Robots 25(3):205–229

    Article  Google Scholar 

  • Shuai Y, Tiantian Y, Guodong Y, Zize L (2017) Regression convolutional network for vanishing point detection. In: 32nd youth academic annual conference of chinese association of automation (YAC), pp 634–638

  • Wang L, Wei H (2020) Avoiding non-Manhattan obstacles based on projection of spatial corners in indoor environment. IEEE/CAA J Automatica Sinica 7:1190–1200

    Article  Google Scholar 

  • Wang L, Wei H (2020) Understanding of wheelchair ramp scenes for disabled people with visual impairments. Eng Appl Artif Intell 90:103569

    Article  Google Scholar 

  • Wang L, Wei H (2020) Understanding of curved corridor scenes based on projection of spatial right-angles. IEEE Trans Image Process 29:9345–9359

    Article  Google Scholar 

  • Wang L, Wei H (2022) Curved alleyway understanding based on monocular vision in street scenes. IEEE Trans Intell Transp Syst 23(7):8544–8563

    Article  Google Scholar 

  • Wang L, Wei H (2023) Winding pathway understanding based on angle projections in a field environment. Appl Intell 53:16859–16874

    Article  Google Scholar 

  • Wang E, Sun A, Li Y, Hou X, Zhu Y (2018) Fast vanishing point detection method based on road border region estimation. IET Image Process 12(3):361–373

    Article  Google Scholar 

  • Wei H, Wang L (2018) Understanding of indoor scenes based on projection of spatial rectangles. Pattern Recogn 81:497–514

    Article  Google Scholar 

  • Wei H, Wang L (2018) Visual navigation using projection of spatial right-angle in indoor environment. IEEE Trans Image Process 27(7):3164–3177

    Article  PubMed  Google Scholar 

  • Wigness MB, Eum S, Rogers JG, Han D, Kwon H (2019) A RUGD dataset for autonomous navigation and visual perception in unstructured outdoor environments. In: IEEE/RSJ international conference on intelligent robots and systems, IROS , Macau, SAR, China, pp 5000–5007

  • Yag X, Altan A (2022) Artificial intelligence-based robust hybrid algorithm design and implementation for real-time detection of plant diseases in agricultural environments. Biology 11(12):1732

    Article  PubMed  PubMed Central  Google Scholar 

  • Yang W, Fang B, Tang YY (2018) Fast and accurate vanishing point detection and its application in inverse perspective mapping of structured road. IEEE Trans Syst Man Cybern Syst 48(5):755–766

    Article  Google Scholar 

Download references

Acknowledgements

This work was supported by the NSFC Project (Project Nos. 62003212, 61771146 and 61375122).

Author information

Authors and Affiliations

  1. Laboratory of 3D Scene Understanding and Visual Navigation, School of Mechanical Engineering, University of Shanghai for Science and Technology, Jungong Road 516, Shanghai, 200093, China

    Luping Wang & Yun Hao

  2. Intel Asia-Pacific Research and Development Ltd., Zixing Road 880, Shanghai, 201100, China

    Shanshan Wang

  3. Laboratory of Algorithms for Cognitive Models, School of Computer Science, Fudan University, Zhangheng Road 825, Shanghai, 201203, China

    Hui Wei

Authors
  1. Luping Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yun Hao
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Shanshan Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Hui Wei
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Luping Wang.

Ethics declarations

Conflict of interest

The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wang, L., Hao, Y., Wang, S. et al. Vanishing point estimation inspired by oblique effect in a field environment. Cogn Neurodyn (2024). https://doi.org/10.1007/s11571-024-10102-3

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s11571-024-10102-3

Keywords

Search

Navigation