Skip to main content
EURASIP Journal on Embedded Systems
Download PDF
  • Research Article
  • Open access
  • Published:

Lane Tracking with Omnidirectional Cameras: Algorithms and Evaluation

EURASIP Journal on Embedded Systems volume 2007, Article number: 046972 (2007) Cite this article

Abstract

With a panoramic view of the scene, a single omnidirectional camera can monitor the 360-degree surround of the vehicle or monitor the interior and exterior of the vehicle at the same time. We investigate problems associated with integrating driver assistance functionalities that have been designed for rectilinear cameras with a single omnidirectional camera instead. Specifically, omnidirectional cameras have been shown effective in determining head gaze orientation from within a vehicle. We examine the issues involved in integrating lane tracking functions using the same omnidirectional camera, which provide a view of both the driver and the road ahead of the vehicle. We present analysis on the impact of the omnidirectional camera's reduced image resolution on lane tracking accuracy, as a consequence of gaining the expansive view. And to do so, we present Omni-VioLET, a modified implementation of the vision-based lane estimation and tracking system (VioLET), and conduct a systematic performance evaluation of both lane-trackers operating on monocular rectilinear images and omnidirectional images. We are able to show a performance comparison of the lane tracking from Omni-VioLET and Recti-VioLET with ground truth using images captured along the same freeway road in a specified course. The results are surprising: with 1/10th the number of pixels representing the same space and about 1/3rd the horizontal image resolution as a rectilinear image of the same road, the omnidirectional camera implementation results in only three times the amount the mean absolute error in tracking the left lane boundary position.

[1 2 3 4 5 6 7 8 9 10]

References

  1. Petersson L, Fletcher L, Zelinsky A, Barnes N, Arnell F: Towards safer roads by integration of road scene monitoring and vehicle control. International Journal of Robotics Research 2006,25(1):53-72. 10.1177/0278364906061156

    Article  Google Scholar 

  2. Huang KS, Trivedi MM, Gandhi T: Driver's view and vehicle surround estimation using omnidirectional video stream. Proceedings of IEEE Intelligent Vehicles Symposium (IV '03), June 2003, Columbus, Ohio, USA 444-449.

    Chapter  Google Scholar 

  3. McCall J, Wipf D, Trivedi MM, Rao B: Lane change intent analysis using robust operators and sparse Bayesian learning. to appear in IEEE Transactions on Intelligent Transportation Systems

  4. Cheng SY, Trivedi MM: Turn-intent analysis using body pose for intelligent driver assistance. IEEE Pervasive Computing 2006,5(4):28-37. 10.1109/MPRV.2006.88

    Article  Google Scholar 

  5. Enkelmann W: Video-based driver assistance—from basic functions to applications. International Journal of Computer Vision 2001,45(3):201-221. 10.1023/A:1013658100226

    Article  MATH  Google Scholar 

  6. McCall JC, Trivedi MM: Video-based lane estimation and tracking for driver assistance: survey, system, and evaluation. IEEE Transactions on Intelligent Transportation Systems 2006,7(1):20-37. 10.1109/TITS.2006.869595

    Article  Google Scholar 

  7. Bertozzi M, Broggi A: GOLD: a parallel real-time stereo vision system for generic obstacle and lane detection. IEEE Transactions on Image Processing 1998,7(1):62-81. 10.1109/83.650851

    Article  Google Scholar 

  8. Nedevschi S, Schmidt R, Graf T, et al.: 3D lane detection system based on stereovision. Proceedings of the 7th International IEEE Conference on Intelligent Transportation Systems (ITSC '04), October 2004, Washington, DC, USA 161-166.

    Google Scholar 

  9. Ishikawa K, Kobayashi K, Watanabe K: A lane detection method for intelligent ground vehicle competition. SICE Annual Conference, August 2003, Fukui, Japan 1: 1086-1089.

    Google Scholar 

  10. Scaramuzza D, Martinelli A, Siegwart R: A flexible technique for accurate omnidirectional camera calibration and structure from motion. Proceedings of the 4th IEEE International Conference on Computer Vision Systems (ICVS '06), January 2006, New York, NY, USA 45.

    Chapter  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Laboratory for Intelligent and Safe Automobiles (LISA), University of California, San Diego, La Jolla, CA, 92093-0434, USA

    Shinko Yuanhsien Cheng & Mohan Manubhai Trivedi

Authors
  1. Shinko Yuanhsien Cheng
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Mohan Manubhai Trivedi
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Shinko Yuanhsien Cheng.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 2.0 International License (https://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Cite this article

Cheng, S.Y., Trivedi, M.M. Lane Tracking with Omnidirectional Cameras: Algorithms and Evaluation. J Embedded Systems 2007, 046972 (2007). https://doi.org/10.1155/2007/46972

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1155/2007/46972

Keywords