Skip to main content


Customizing Multiprocessor Implementation of an Automated Video Surveillance System

Article metrics


This paper reports on the development of an automated embedded video surveillance system using two customized embedded RISC processors. The application is partitioned into object tracking and video stream encoding subsystems. The real-time object tracker is able to detect and track moving objects by video images of scenes taken by stationary cameras. It is based on the block-matching algorithm. The video stream encoding involves the optimization of an international telecommunications union (ITU)-T H.263 baseline video encoder for quarter common intermediate format (QCIF) and common intermediate format (CIF) resolution images. The two subsystems running on two processor cores were integrated and a simple protocol was added to realize the automated video surveillance system. The experimental results show that the system is capable of detecting, tracking, and encoding QCIF and CIF resolution images with object movements in them in real-time. With low cycle-count, low-transistor count, and low-power consumption requirements, the system is ideal for deployment in remote locations.

[1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33]


  1. 1.

    El-Azim SA, Ismail I, El-Latiff HA: An efficient object tracking technique using block-matching algorithm. Proceedings of the 9th National Radio Science Conference (NRSC '02), March 2002, Alexandria, Egypt 427-433.

  2. 2.

    Mahmoud II, Abd El-Halym HA, Habib SE-D: Hardware development and implementation of an object tracking algorithm. Proceedings of the 15th International Conference on Microelectronics (ICM '03), December 2003, Cairo, Egypt 330-334.

  3. 3.

    Lehtoranta O, Hämäläinen T, Saarinen J: Parallel implementation of H.263 encoder for CIF-sized images on quad DSP system. Proceedings of IEEE International Symposium on Circuits and Systems (ISCAS '01), May 2001, Sydney, Australia 2: 209-212.

  4. 4.

    Chang Y-C, Chao W-M, Chen L-G: LSI design for MPEG-4 coding system. Proceedings of 47th Midwest Symposium on Circuits and Systems (MWSCAS '04), July 2004, Hiroshima, Japan 2: 453-456.

  5. 5.

    Garrido MJ, Sanz C, Jiménez M, Meneses JM: A flexible architecture for H.263 video coding. Journal of Systems Architecture 2003,49(12–15):641-661. 10.1016/S1383-7621(03)00094-8

  6. 6.

    Kim J-G, Jay Kuo C-C: MPEG-4 video codec IP design with a configurable embedded processor. Proceedings of IEEE International Symposium on Circuits and Systems (ISCAS '03), May 2003, Bangkok, Thailand 2: 776-779.

  7. 7.

    Cheung S-CS, Kamath C: Robust techniques for background subtraction in urban traffic video. Visual Communications and Image Processing, January 2004, San Jose, Calif, USA, Proceedings of SPIE 5308: 881-892.

  8. 8.

    Cucchiara R, Grana C, Piccardi M, Prati A: Detecting moving objects, ghosts, and shadows in video streams. IEEE Transactions on Pattern Analysis and Machine Intelligence 2003,25(10):1337-1342. 10.1109/TPAMI.2003.1233909

  9. 9.

    Cutler R, Davis LS: View-based detection and analysis of periodic motion. In Proceedings of the 14th International Conference on Pattern Recognition (ICPR '98) , August 1998, Brisbane, Queensland, Australia. Volume 1. IEEE Computer Society Press; 495-500.

  10. 10.

    Elgammal A, Duraiswami R, Harwood D, Davis LS: Background and foreground modeling using nonparametric kernel density estimation for visual surveillance. Proceedings of the IEEE 2002,90(7):1151-1163. 10.1109/JPROC.2002.801448

  11. 11.

    McFarlane NJB, Schofield CP: Segmentation and tracking of piglets in images. Machine Vision and Applications 1995,8(3):187-193. 10.1007/BF01215814

  12. 12.

    Wren CR, Azarbayejani A, Darrell T, Pentland AP: Pfinder: real-time tracking of the human body. IEEE Transactions on Pattern Analysis and Machine Intelligence 1997,19(7):780-785. 10.1109/34.598236

  13. 13.

    Heikkila J, Silven O: A real-time system for monitoring of cyclists and pedestrians. Proceedings of the 2nd IEEE Workshop on Visual Surveillance (VS '99), July 1999, Collins, Colo, USA 74-81.

  14. 14.

    Stauffer C, Grimson WEL: Learning patterns of activity using real-time tracking. IEEE Transactions on Pattern Analysis and Machine Intelligence 2000,22(8):747-757. 10.1109/34.868677

  15. 15.

    Stauffer C, Grimson WEL: Adaptive background mixture models for real-time tracking. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR '99), June 1999, Fort Collins, Colo, USA 2: 246-252.

  16. 16.

    Hariharakrishnan K, Schonfeld D, Raffy P, Yassa F: Video tracking using block matching. Proceedings of IEEE International Conference on Image Processing (ICIP '03), September 2003, Barcelona, Spain 3: 945-948.

  17. 17.

    Hariharakrishnan K, Schonfeld D, Raffy P, Yassa F: Object tracking using adaptive block matching. Proceedings of the International Conference on Multimedia and Expo (ICME '03), July 2003, Baltimore, Md, USA 3: 65-68.

  18. 18.

    ITU-T experts group on very bitrate visual telephony, ITU-T Recommendation H.263 version 2: video coding for low bitrate communication, January 1998

  19. 19.

    Yu N, Kim K, Salcic Z: A new motion estimation algorithm for mobile real-time video and its FPGA implementation. Proceedings of IEEE Region 10 International Conference on Electrical and Electronic Technology (TENCON '04), November 2004, Chiang Mai, Thailand A: 383-386.

  20. 20.

    Gonzalez RE: Xtensa: a configurable and extensible processor. IEEE Micro 2000,20(2):60-70. 10.1109/40.848473

  21. 21.

    Aalmoes R: Roalt's H.263 Page. October 2003,

  22. 22.

    Arizona State University : YUV 4:2:0 video sequences. nd;

  23. 23.

    Massimino P: Implementing a Fast DCT/IDCT with SIMD Instructions. July 2002

  24. 24.

    Loeffer C, Ligtenberg A, Moschytz GS: Practical fast 1-D DCT algorithms with 11 multiplications. Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP '89), May 1989, Glasgow, Scotland 2: 988-991.

  25. 25.

    Arai Y, Agui T, Nakajima M: A fast DCT-SQ scheme for images. Transactions of the Institute of Electronics, Information and Communication Engineers E 1988,E71(11):1095-1097.

  26. 26.

    Wang G: Real-time multiprocessor implementation of an automated video surveillance application, ME thesis. The University of Auckland, Auckland, New Zealand; 2005.

  27. 27.

    Wren CR, Azarbayejani A, Darrell T, Pentland AP: Pfinder: real-time tracking of the human body. IEEE Transactions on Pattern Analysis and Machine Intelligence 1997,19(7):780-785. 10.1109/34.598236

  28. 28.

    Fisher B, Perkins S, Walker A, Wolfart E: Adaptive Thresholding. 1994,

  29. 29.

    Rosenfeld A, Pfaltz JL: Sequential operations in digital picture processing. Journal of the ACM 1966,13(4):471-494. 10.1145/321356.321357

  30. 30.

    Bramberger M, Brunner J, Rinner B, Schwabach H: Real-time video analysis on an embedded smart camera for traffic surveillance. Proceedings of 10th IEEE Real-Time and Embedded Technology and Applications Symposium (RTAS '04), May 2004, Toronto, Canada 10: 174-181.

  31. 31.

    Tensilica Inc Xtensa Instruction Set Simulator (ISS) User's Guide (For Xtensa T1050.2 Processor Cores), 2003

  32. 32.

    Nagel HH: Institut für Algorithmen und Kognitive Systeme. nd;

  33. 33.

    Lee A: nd;

Download references

Author information

Correspondence to Gary Wang.

Rights and permissions

Reprints and Permissions

About this article


  • Video Stream
  • Video Encoder
  • Stationary Camera
  • Video Surveillance System
  • International Telecommunication Union