Adaptive Probabilistic Tracking Embedded in Smart Cameras for Distributed Surveillance in a 3D Model
EURASIP Journal on Embedded Systems volume 2007, Article number: 029858 (2006)
Tracking applications based on distributed and embedded sensor networks are emerging today, both in the fields of surveillance and industrial vision. Traditional centralized approaches have several drawbacks, due to limited communication bandwidth, computational requirements, and thus limited spatial camera resolution and frame rate. In this article, we present network-enabled smart cameras for probabilistic tracking. They are capable of tracking objects adaptively in real time and offer a very bandwidthconservative approach, as the whole computation is performed embedded in each smart camera and only the tracking results are transmitted, which are on a higher level of abstraction. Based on this, we present a distributed surveillance system. The smart cameras' tracking results are embedded in an integrated 3D environment as live textures and can be viewed from arbitrary perspectives. Also a georeferenced live visualization embedded in Google Earth is presented.
Mullins J: Rings of steel ii, New York city gets set to replicate London's high-security zone. to appear in IEEE Spectrum
What happens in vegas stays on tape http://www.csoonline.com/read/090105/hiddencamera_vegas_3834.html
Google earth http://earth.google.com/
Bramberger M, Doblander A, Maier A, Rinner B, Schwabach H: Distributed embedded smart cameras for surveillance applications. Computer 2006,39(2):68-75. 10.1109/MC.2006.55
Wolf W, Ozer B, Lv T: Smart cameras as embedded systems. Computer 2002,35(9):48-53. 10.1109/MC.2002.1033027
Doucet A, Freitas ND, Gordon N: Sequential Monte Carlo Methods in Practice. Springer, New York, NY, USA; 2001.
Isard M, Blake A: Condensation—conditional density propagation for visual tracking. International Journal of Computer Vision 1998,29(1):5-28. 10.1023/A:1008078328650
Haykin S, de Freitas N: Special issue on sequential state estimation. Proceedings of the IEEE 2004,92(3):399-400. 10.1109/JPROC.2003.823140
Comaniciu D, Ramesh V, Meer P: Kernel-based object tracking. IEEE Transactions on Pattern Analysis and Machine Intelligence 2003,25(5):564-577. 10.1109/TPAMI.2003.1195991
Okuma K, Taleghani A, de Freitas N, Little JJ, Lowe DG: A boosted particle filter: multitarget detection and tracking. Proceedings of 8th European Conference on Computer Vision (ECCV '04), May 2004, Prague, Czech Republic
Nummiaro K, Koller-Meier E, Gool LV: A color based particle filter. Proceedings of the 1st International Workshop on Generative-Model-Based Vision (GMBV '02), June 2002, Copenhagen, Denmark
Pérez P, Hue C, Vermaak J, Gangnet M: Color-based probabilistic tracking. Proceedings of 7th European Conference on Computer Vision (ECCV '02), June 2002, Copenhaguen, Denmark 661-675.
Pérez P, Vermaak J, Blake A: Data fusion for visual tracking with particles. Proceedings of the IEEE 2004,92(3):495-513. issue on State Estimation 10.1109/JPROC.2003.823147
Spengler M, Schiele B: Towards robust multi-cue integration for visual tracking. Proceedings of the 2nd International Workshop on Computer Vision Systems, July 2001, Vancouver, BC, Canada, Lecture Notes in Computer Science 2095: 93-106.
Surveillance works: look who's watching IEEE Signal Processing Magazine 2005.,22(3):
Boult T, Lakshmikumar A, Gao X: Surveillance methods. Proceedings of IEEE Computer Society International Conference on Computer Vision and Pattern Recognition (CVPR '05), June 2005, San Diego, Calif, USA
Siebel N, Maybank S: The advisor visual surveillance system. Proceedings of the ECCV Workshop on Applications of Computer Vision (ACV '04), May 2004, Prague, Italy
Trivedi MM, Gandhi TL, Huang KS: Distributed interactive video arrays for event capture and enhanced situational awareness. IEEE Intelligent Systems 2005,20(5):58-65. special issue on Homeland Security, 2005 10.1109/MIS.2005.86
Yang DB, González-Baños HH, Guibas LJ: Counting people in crowds with a real-time network of simple image sensors. Proceedings of the 9th IEEE International Conference on Computer Vision (ICCV '03), October 2003, Nice, France 1: 122-129.
Sawhney HS, Arpa A, Kumar R, et al.: Video flashlights—real time rendering of multiple videos for immersive model visualization. Proceedings of the 13th Eurographics Workshop on Rendering (EGRW '02), June 2002, Pisa, Italy 157-168.
Fleck S, Straßer W: Adaptive probabilistic tracking embedded in a smart camera. Proceedings of the IEEE CVPR Embedded Computer Vision Workshop (ECV '05), June 2005, San Diego, Calif, USA 3: 134.
Matrix vision http://www.matrix-vision.com/
Project's website http://www.gris.uni-tuebingen.de/~sfleck/smartsurv3d/
Fleck S, Busch F, Biber P, Straßer W: 3d surveillance—a distributed network of smart cameras for real-time tracking and its visualization in 3d. Proceedings of IEEE CVPR Embedded Computer Vision Workshop (ECV '06), 2006
Fleck S, Busch F, Biber P, Straßer W: 3d surveillance—a distributed network of smart cameras for real-time tracking and its visualization in 3d. Proceedings of Conference on Computer Vision and Pattern Recognition Workshop (CVPRW '06), June 2006 118.
Elgammal A, Duraiswami R, Harwood D, Davis LS: Background and foreground modeling using nonparametric kernel density estimation for visual surveillance. Proceedings of the IEEE 2002,90(7):1151-1162. 10.1109/JPROC.2002.801448
Torr PHS, Szeliski R, Anandan P: An integrated Bayesian approach to layer extraction from image sequences. IEEE Transactions on Pattern Analysis and Machine Intelligence 2001,23(3):297-303. 10.1109/34.910882
Xiao J, Shah M: Motion layer extraction in the presence of occlusion using graph cuts. IEEE Transactions on Pattern Analysis and Machine Intelligence 2005,27(10):1644-1659. 10.1109/TPAMI.2005.202
Biber P, Fleck S, Wand M, Staneker D, Straßer W: First experiences with a mobile platform for flexible 3d model acquisition in indoor and outdoor environments—the wägele. Proceedings of the ISPRS Working Group V/4 Workshop 3D-ARCH 2005: Virtual Reconstruction and Visualization of Complex Architectures (ISPRS '05), August 2005, Mestre-Venice, Italy
Biber P, Straßer W: The normal distributions transform: a new approach to laser scan matching. Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS '03), October 2003, Las Vegas, Nev, USA 3: 2743-2748.
Fleck S, Busch F, Biber P, Andreasson H, Straßer W: Omnidirectional 3d modeling on a mobile robot using graph cuts. Proceedings of the IEEE International Conference on Robotics and Automation (ICRA '05), April 2005, Barcelona, Spain 1748-1754.
About this article
Cite this article
Fleck, S., Busch, F. & Straßer, W. Adaptive Probabilistic Tracking Embedded in Smart Cameras for Distributed Surveillance in a 3D Model. J Embedded Systems 2007, 029858 (2006). https://doi.org/10.1155/2007/29858