Skip to main content
Log in

Real-time velocity measurement to linear motion of a rigid object with monocular image sequence analyses

  • Special Issue Paper
  • Published:
Journal of Real-Time Image Processing Aims and scope Submit manuscript

Abstract

This paper presents a methodology and all procedures used to validate it, which were executed in a physics laboratory under controlled and known conditions. The validation was based on the analyses of registered data in an image sequence and the measurements acquired by high precision sensors. This methodology intended to measure the velocity of a rigid object in linear motion with the use of an image sequence acquired by commercial digital video camera. The proposed methodology does not need a stereo pair of images to calculate the object position in the 3D space: it needs only images sequence acquired for one, only one, angle view (monocular vision). To do so, these objects need to be detected while in movement, which is conducted by the application of a segmentation technique based on the temporal average values of each pixel registered in N consecutive image frames. After detecting and framing these objects, specific points belonging to the object (pixels), on the plane image (2D coordinates or space image), are automatically chosen, which are then transformed into corresponding points in the space object (3D coordinates) by the application of collinearity equations or rational functions (proposed in this work). After obtaining the coordinates of these points in the space object that are registered in the sequence of images, the distance, in meters, covered by the object in a particular time interval may be measured and, consequently, its velocity can be calculated. The system is low cost, use only a computer (architecture Intel I3), and a webcam used to acquire the images (640 × 480, 30 fps). The complexity of the algorithm is linear, fact that allows the system to operate in real time. The results of the analyses are discussed and the advantages and disadvantages of the method are presented.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

References

  1. Aguilar, M.A., Aguilar, F.J., Agüera, F., Sánchez, J.A.: Geometric accuracy assessment of quickbird basic imagery using different operational approaches. Photogramm. Eng. Remote Sens. 73(12), 1321–1332 (2007)

    Article  Google Scholar 

  2. Atkociunas, E., Blake, R., Juozapavicius, A., Kazimianec, M.: Image processing in road. Traffic Anal., Nonlinear Anal. Model. Control 10(4), 315–332 (2005)

    MATH  Google Scholar 

  3. Avidan, S., Shashua, A.: Trajectory triangulation: 3D reconstruction of moving points from a monocular image sequence. IEEE Trans. Pattern Anal. Mach. Intell. 22(4), 348–357 (2000). doi:10.1109/34.845377

    Article  Google Scholar 

  4. Barranco, F., Tomasi, M., Diaz, J., Vanegas, M., Ros, E.: Parallel architecture for hierarchical optical flow estimation based on FPGA. IEEE Trans. Very Large Scale Integration (VLSI) Syst. 20(6), 1058–1067 (2012)

    Article  Google Scholar 

  5. Bonneval, H.: Levés topographiques par photogrammétrie aérienne. In Photogrammétrie Générale: Tome 3, Collection scientifique de l’Institut Géographique National. Paris, France: Eyrolles Editeur 1972

  6. Botella, G., Garcia, A., Rodriguez, M., Ros, E., Baese, U., Molina, M.: Robust bioinspired architecture for optical flow computation. IEEE Trans. Very Large Scale Integration (VLSI) Syst. 18(4), 616–629 (2010)

    Article  Google Scholar 

  7. Botella, G., Ros, E., Rodriguez, M., Garcia, A., Romero, S.: Pre-processor for bioinspired optical flow models: a customizable hardware implementation. Proceedings of the IEEE Mediterranean Electrotechnical Conference (MELECON), Málaga, Spain, 93–96 (2006). doi:10.1109/MELCON.2006.1653044

  8. Bruhn, A., Weickert, J., Schnörr, C.: Lucas/Kanade meets Horn/Schunck: combining local and global optic flow methods. Int. J. Comput. Vision 61(3), 211–231 (2005). doi:10.1023/B:VISI.0000045324.43199.43

    Article  Google Scholar 

  9. Davis, J., Bobick, A.: The representation and recognition of human movement using temporal templates. IEEE Computer Soc Conf Computer Vision Pattern Recognit (CVPR’97), 928–934 (1997). doi:10.1109/CVPR.1997.609439

  10. Davis, J., Bradiski, G.: Real-time motion template gradients using Intel CVLib. In: proceedings of the ICCV Workshop on Frame-rate Vision, 1–20 (1999)

  11. Ghilani, C.D.: General Least Squares Method and Its Application to Curve Fitting and Coordinate Transformations, in Adjustment Computations: Spatial Data Analysis (Fifth Edition). Hoboken, NJ, USA: Wiley, Inc. (2010). doi:10.1002/9780470586266.ch22

  12. Gupte, S., Masoud, O., Martin, R.F.K., Apanikolopoulos, N.P.: Detection and classification of vehicles. IEEE Trans. Intell. Transp. Syst. 3(1), 37–47 (2002). doi:10.1109/6979.994794

    Article  Google Scholar 

  13. Habib, Ayman F., Morgan, Michel F.: Automatic calibration of low-cost digital cameras. Opt. Eng. 42(4), 948–955 (2003). doi:10.1117/1.1555732

    Article  Google Scholar 

  14. Hamid, N.F.A., Ahmad, A.: Calibration of high resolution digital camera based on different photogrammetric methods. Proceedings of the 8th International Symposium of the Digital Earth (ISDE8), IOP Publishing on IOP Conf. Series. Earth Environ Sci 18, 1–6 (2014). doi:10.1088/1755-1315/18/1/012030

    Google Scholar 

  15. Kim, K., Chalidabhongse, T.H., Harwood, D., Davis, L.: Real-time foreground-background segmentation using codebook model. Real-Time Imaging 11(3), 167–256 (2005). doi:10.1016/j.rti.2004.12.004

    Article  Google Scholar 

  16. Kraus K.: Photogrammetry Vol. 1. Fundamentals and Standard Processes (4th edition). Bonn, Germany: Ferdinand Dummlers (1993)

  17. Li, R., Niu, X., Liu, C., Wu, B., Deshpande, S.: Impact of imaging geometry on 3d geopositioning accuracy of stereo ikonos imagery. Photogramm. Eng. & Remote Sens. 75(9), 1119–1125 (2009)

    Article  Google Scholar 

  18. Lucas, B., Kanade, T.: An iterative image registration technique with an application to stereo vision. In: Proceedings of the Seventh International Joint Conference on Artificial Intelligence, vol.2, pp. 674–679. Vancouver (1981)

  19. Novak, K.: Rectification of digital imagery. Photogramm. Eng. and Remote Sens. 58(3), 339–344 (1992)

    Google Scholar 

  20. Petrie, G., El Niweri, A.E.H.: The applicability of space imagery to the small scale topographic mapping of developing countries: a case study—the Sudan. ISPRS J. Photogramm. Remote Sens. 47(1), 1–42 (1992). doi:10.1016/0924-2716(92)90002-Q

    Article  Google Scholar 

  21. Soh, J., Chun, B.T., Wang, M.: Analysis of road image sequences for vehicle counting. IEEE Trans. Intell. Transp. Syst. 1, 679–683 (1995). doi:10.1109/ICSMC.1995.537842

    Google Scholar 

  22. Toutin, T.: Review article: Geometric processing of remote sensing images: models, algorithms and methods. Int. J. Remote Sens. 25(10), 1893–1924 (2004). doi:10.1080/0143116031000101611

    Article  Google Scholar 

  23. Tsai, R.Y.: A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses. IEEE J. Robot. Autom. 3(4), 323–344 (1987). doi:10.1109/JRA.1987.1087109

    Article  Google Scholar 

  24. Weng, J., Cohen, P., Herniou, M.: Camera calibration with distortion models and accuracy evaluation. IEEE Trans. Pattern Anal. Mach. Intell. 14(10), 965–980 (1992). doi:10.1109/34.159901

    Article  Google Scholar 

  25. Wolberg, J.: Data analysis using the method of least squares: extracting the most information from experiments. Berlin and Heidelberg GmbH & Co. KG, Germany: Springer (2005)

  26. Wong, K.W.: Basic mathematics of photogrammetry. In: Slama, C.C. (ed.) Manual of Photogrammetry (4th edition), pp. 37–101. ASP Publishers, Falls Church (1980)

    Google Scholar 

  27. Yan, Y., Yancong, S., Zengqiang, M.: Research on vehicle speed measurement by video image based on Tsai’s two stage method. In: proceedings of the 5th International Conference on Computer Science and Education, 502–506 (2010). doi:10.1109/ICCSE.2010.5593565

  28. Zhiwei, H., Yuanyuan, L., Xueyi, Y.: Models of vehicle speeds measurement with a single camera. Proceedings of the International Conference on Computational Intelligence and Security Workshops, 283–286 (2007). doi:10.1109/CISW.2007.4425492

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Nardênio Almeida Martins.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Filitto, D., Hasegawa, J.K., Polidório, A.M. et al. Real-time velocity measurement to linear motion of a rigid object with monocular image sequence analyses. J Real-Time Image Proc 11, 829–846 (2016). https://doi.org/10.1007/s11554-014-0472-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11554-014-0472-4

Keywords

Navigation