Skip to main content
EURASIP Journal on Embedded Systems
Download PDF
  • Research Article
  • Open access
  • Published:

Adaptive Probabilistic Tracking Embedded in Smart Cameras for Distributed Surveillance in a 3D Model

EURASIP Journal on Embedded Systems volume 2007, Article number: 029858 (2006) Cite this article

Abstract

Tracking applications based on distributed and embedded sensor networks are emerging today, both in the fields of surveillance and industrial vision. Traditional centralized approaches have several drawbacks, due to limited communication bandwidth, computational requirements, and thus limited spatial camera resolution and frame rate. In this article, we present network-enabled smart cameras for probabilistic tracking. They are capable of tracking objects adaptively in real time and offer a very bandwidthconservative approach, as the whole computation is performed embedded in each smart camera and only the tracking results are transmitted, which are on a higher level of abstraction. Based on this, we present a distributed surveillance system. The smart cameras' tracking results are embedded in an integrated 3D environment as live textures and can be viewed from arbitrary perspectives. Also a georeferenced live visualization embedded in Google Earth is presented.

[1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31]

References

  1. Mullins J: Rings of steel ii, New York city gets set to replicate London's high-security zone. to appear in IEEE Spectrum

  2. What happens in vegas stays on tape http://www.csoonline.com/read/090105/hiddencamera_vegas_3834.html

  3. Google earth http://earth.google.com/

  4. Bramberger M, Doblander A, Maier A, Rinner B, Schwabach H: Distributed embedded smart cameras for surveillance applications. Computer 2006,39(2):68-75. 10.1109/MC.2006.55

    Article  Google Scholar 

  5. Wolf W, Ozer B, Lv T: Smart cameras as embedded systems. Computer 2002,35(9):48-53. 10.1109/MC.2002.1033027

    Article  Google Scholar 

  6. Doucet A, Freitas ND, Gordon N: Sequential Monte Carlo Methods in Practice. Springer, New York, NY, USA; 2001.

    Book  MATH  Google Scholar 

  7. Isard M, Blake A: Condensation—conditional density propagation for visual tracking. International Journal of Computer Vision 1998,29(1):5-28. 10.1023/A:1008078328650

    Article  Google Scholar 

  8. Haykin S, de Freitas N: Special issue on sequential state estimation. Proceedings of the IEEE 2004,92(3):399-400. 10.1109/JPROC.2003.823140

    Article  Google Scholar 

  9. Comaniciu D, Ramesh V, Meer P: Kernel-based object tracking. IEEE Transactions on Pattern Analysis and Machine Intelligence 2003,25(5):564-577. 10.1109/TPAMI.2003.1195991

    Article  Google Scholar 

  10. Okuma K, Taleghani A, de Freitas N, Little JJ, Lowe DG: A boosted particle filter: multitarget detection and tracking. Proceedings of 8th European Conference on Computer Vision (ECCV '04), May 2004, Prague, Czech Republic

    Google Scholar 

  11. Nummiaro K, Koller-Meier E, Gool LV: A color based particle filter. Proceedings of the 1st International Workshop on Generative-Model-Based Vision (GMBV '02), June 2002, Copenhagen, Denmark

    Google Scholar 

  12. Pérez P, Hue C, Vermaak J, Gangnet M: Color-based probabilistic tracking. Proceedings of 7th European Conference on Computer Vision (ECCV '02), June 2002, Copenhaguen, Denmark 661-675.

    Google Scholar 

  13. Pérez P, Vermaak J, Blake A: Data fusion for visual tracking with particles. Proceedings of the IEEE 2004,92(3):495-513. issue on State Estimation 10.1109/JPROC.2003.823147

    Article  Google Scholar 

  14. Spengler M, Schiele B: Towards robust multi-cue integration for visual tracking. Proceedings of the 2nd International Workshop on Computer Vision Systems, July 2001, Vancouver, BC, Canada, Lecture Notes in Computer Science 2095: 93-106.

    Article  Google Scholar 

  15. Surveillance works: look who's watching IEEE Signal Processing Magazine 2005.,22(3):

  16. Boult T, Lakshmikumar A, Gao X: Surveillance methods. Proceedings of IEEE Computer Society International Conference on Computer Vision and Pattern Recognition (CVPR '05), June 2005, San Diego, Calif, USA

    Google Scholar 

  17. Siebel N, Maybank S: The advisor visual surveillance system. Proceedings of the ECCV Workshop on Applications of Computer Vision (ACV '04), May 2004, Prague, Italy

    Google Scholar 

  18. Trivedi MM, Gandhi TL, Huang KS: Distributed interactive video arrays for event capture and enhanced situational awareness. IEEE Intelligent Systems 2005,20(5):58-65. special issue on Homeland Security, 2005 10.1109/MIS.2005.86

    Article  Google Scholar 

  19. Yang DB, González-Baños HH, Guibas LJ: Counting people in crowds with a real-time network of simple image sensors. Proceedings of the 9th IEEE International Conference on Computer Vision (ICCV '03), October 2003, Nice, France 1: 122-129.

    Article  Google Scholar 

  20. Sawhney HS, Arpa A, Kumar R, et al.: Video flashlights—real time rendering of multiple videos for immersive model visualization. Proceedings of the 13th Eurographics Workshop on Rendering (EGRW '02), June 2002, Pisa, Italy 157-168.

    Google Scholar 

  21. Fleck S, Straßer W: Adaptive probabilistic tracking embedded in a smart camera. Proceedings of the IEEE CVPR Embedded Computer Vision Workshop (ECV '05), June 2005, San Diego, Calif, USA 3: 134.

    Google Scholar 

  22. Matrix vision http://www.matrix-vision.com/

  23. Project's website http://www.gris.uni-tuebingen.de/~sfleck/smartsurv3d/

  24. Fleck S, Busch F, Biber P, Straßer W: 3d surveillance—a distributed network of smart cameras for real-time tracking and its visualization in 3d. Proceedings of IEEE CVPR Embedded Computer Vision Workshop (ECV '06), 2006

  25. Fleck S, Busch F, Biber P, Straßer W: 3d surveillance—a distributed network of smart cameras for real-time tracking and its visualization in 3d. Proceedings of Conference on Computer Vision and Pattern Recognition Workshop (CVPRW '06), June 2006 118.

    Google Scholar 

  26. Elgammal A, Duraiswami R, Harwood D, Davis LS: Background and foreground modeling using nonparametric kernel density estimation for visual surveillance. Proceedings of the IEEE 2002,90(7):1151-1162. 10.1109/JPROC.2002.801448

    Article  Google Scholar 

  27. Torr PHS, Szeliski R, Anandan P: An integrated Bayesian approach to layer extraction from image sequences. IEEE Transactions on Pattern Analysis and Machine Intelligence 2001,23(3):297-303. 10.1109/34.910882

    Article  Google Scholar 

  28. Xiao J, Shah M: Motion layer extraction in the presence of occlusion using graph cuts. IEEE Transactions on Pattern Analysis and Machine Intelligence 2005,27(10):1644-1659. 10.1109/TPAMI.2005.202

    Article  Google Scholar 

  29. Biber P, Fleck S, Wand M, Staneker D, Straßer W: First experiences with a mobile platform for flexible 3d model acquisition in indoor and outdoor environments—the wägele. Proceedings of the ISPRS Working Group V/4 Workshop 3D-ARCH 2005: Virtual Reconstruction and Visualization of Complex Architectures (ISPRS '05), August 2005, Mestre-Venice, Italy

    Google Scholar 

  30. Biber P, Straßer W: The normal distributions transform: a new approach to laser scan matching. Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS '03), October 2003, Las Vegas, Nev, USA 3: 2743-2748.

    Google Scholar 

  31. Fleck S, Busch F, Biber P, Andreasson H, Straßer W: Omnidirectional 3d modeling on a mobile robot using graph cuts. Proceedings of the IEEE International Conference on Robotics and Automation (ICRA '05), April 2005, Barcelona, Spain 1748-1754.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Wilhelm Schickard Institute for Computer Science, Graphical-Interactive Systems (WSI/GRIS), University of Tübingen, Sand 14, Tübingen, 72076, Germany

    Sven Fleck, Florian Busch & Wolfgang Straßer

Authors
  1. Sven Fleck
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Florian Busch
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Wolfgang Straßer
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Sven Fleck.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 2.0 International License (https://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Cite this article

Fleck, S., Busch, F. & Straßer, W. Adaptive Probabilistic Tracking Embedded in Smart Cameras for Distributed Surveillance in a 3D Model. J Embedded Systems 2007, 029858 (2006). https://doi.org/10.1155/2007/29858

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1155/2007/29858

Keywords