Skip to main content
SpringerLink
Log in

Pakistani traffic-sign recognition using transfer learning

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Initially, the traffic-sign recognition was done using the conventional image processing techniques which are sluggish and can cause fatal delays in real-world implementations. Majority of the state-of-the-art detectors are based on a Convolutional Neural Network (CNN) which is a de-facto leader in computer vision research over the past decade. Easy availability of datasets is the main reason for the interest of researchers in CNNs. These datasets are needed to be organized and maintained as the CNN requires colossal amounts of data to work well. Unfortunately, no traffic-sign dataset exists in Pakistan to enable any detection based on the CNN. Therefore, in our work, we have collected and annotated a dataset to help foray into this research area. We propose an approach revolving around the deep learning where a model is pre-trained on the German traffic-sign dataset. This model is then fine-tuned using the Pakistani dataset (of 359 different images) collected across Pakistan. Preprocessing and regularization are used to improve the overall performance of the model. Through results, we show that our fine-tuned model reaches to a training accuracy of nearly 55% outperforming the other related techniques. The results are encouraging as we have achieved a high accuracy keeping in mind the small size of the available Pakistani dataset.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16

Similar content being viewed by others

References

  1. Alam A, Jaffery ZA (2020) Indian traffic sign detection and recognition. Int J Intell Transp Syst Res 18:98–112. https://doi.org/10.1007/s13177-019-00178-1

    Article  Google Scholar 

  2. Bayoudh K, Hamdaoui F, Mtibaa A (2021) Transfer learning based hybrid 2D-3D CNN for traffic sign recognition and semantic road detection applied in advanced driver assistance systems. Appl Intell 51:124–142. https://doi.org/10.1007/s10489-020-01801-5

    Article  Google Scholar 

  3. Belaroussi R, Foucher P, Tarel J-P, Soheilian B, Charbonnier P, Paparoditis N (2010) Road sign detection in images: a case study. In: Pattern Recognit. (ICPR), 2010 20th Int. Conf, pp 484–488. https://doi.org/10.1109/ICPR.2010.1125

    Chapter  Google Scholar 

  4. Greenhalgh J, Mirmehdi M (2012) Real-Time Detection and Recognition of Road Traffic Signs. https://doi.org/10.1109/tits.2012.2208909

  5. Grigorescu C, Petkov N (2003) Distance sets for shape filters and shape recognition. IEEE Trans Image Process 12:1274–1286. https://doi.org/10.1109/TIP.2003.816010

    Article  MathSciNet  MATH  Google Scholar 

  6. He K, Zhang X, Ren S, Sun J (2015) Deep residual learning for image recognition. In: Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit. 2016-December, pp 770–778

    Google Scholar 

  7. Jochem T, Pomerleau D, Armstrong J, Kumar B (2014) PANS : A portable navigation platform. https://doi.org/10.1109/IVS.1995.528266

  8. keras-team/keras (n.d.) Deep Learning for humans. https://github.com/keras-team/keras, last accessed 2020/06/16.

  9. Khurshid A, Sohail A, Khurshid M, Shah MU, Jaffry AA (2021) Analysis of road traffic accident fatalities in Karachi. Pakistan: An Autopsy-Based Study Cureus 13. https://doi.org/10.7759/CUREUS.14459

  10. Kingma DP, Ba J (2014) Adam: a method for stochastic optimization:1–13. https://doi.org/10.1145/1830483.1830503

  11. Kiranyaz S, Ince T, Abdeljaber O, Avci O, Gabbouj M (2019) 1-D Convolutional Neural Networks for Signal Processing Applications. In: ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings. pp. 8360–8364. Institute of Electrical and Electronics Engineers Inc. https://doi.org/10.1109/ICASSP.2019.8682194

    Chapter  Google Scholar 

  12. Larsson F, Felsberg M (2011) Using Fourier descriptors and spatial models for traffic sign recognition. In: Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), pp 238–249. https://doi.org/10.1007/978-3-642-21227-7_23

    Chapter  Google Scholar 

  13. Lawler R Riding shotgun in Tesla’s fastest car ever, https://www.engadget.com/2014-10-09-tesla-d-awd-driver-assist.html

  14. Lecun Y, Bottou L, Bengio Y, Ha P (1998) Gradient-Based Learning Applied to Document Recognition. https://doi.org/10.1109/5.726791

  15. LeCun Y, Kavukcuoglu K, Farabet C (2010) Convolutional networks and applications in vision. IEEE Int. Symp. Circuits Syst:253–256. https://doi.org/10.1109/ISCAS.2010.5537907

  16. Li Y, Mogelmose A, Trivedi MM (2016) Pushing the “speed limit”: high-accuracy US traffic sign recognition with convolutional neural networks. IEEE Trans Intell Veh 1:167–176. https://doi.org/10.1109/tiv.2016.2615523

    Article  Google Scholar 

  17. Lin C, Li L, Luo W, Wang KCP, Guo J (2019) Transfer learning based traffic sign recognition using inception-v3 model. Period Polytech Transp Eng 47:242–250. https://doi.org/10.3311/PPtr.11480

    Article  Google Scholar 

  18. Lodhi A, Singhal S, Massoudi M (2021) Car Traffic Sign Recognizer Using Convolutional Neural Network CNN. In: Proceedings of the 6th International Conference on Inventive Computation Technologies, ICICT 2021. Institute of Electrical and Electronics Engineers Inc, pp 577–582. https://doi.org/10.1109/ICICT50816.2021.9358594

    Chapter  Google Scholar 

  19. Mahmoud MAB, Guo P (2019) A novel method for traffic sign recognition based on DCGAN and MLP with PILAE algorithm. IEEE Access 7:74602–74611. https://doi.org/10.1109/ACCESS.2019.2919125

    Article  Google Scholar 

  20. Malik Z, Siddiqi I (2014) Detection and recognition of traffic signs from road scene images. In: Proc. - 12th Int. Conf. Front. Inf. Technol. FIT 2014, pp 330–335. https://doi.org/10.1109/FIT.2014.68

    Chapter  Google Scholar 

  21. Malik R, Khurshid J, Ahmad SN (2007) Road sign detection and recognition using colour segmentation, shape analysis and template matching. In: 2007 Int. Conf. Mach. Learn. Cybern, vol 6, pp 19–22. https://doi.org/10.1109/ICMLC.2007.4370763

    Chapter  Google Scholar 

  22. Manikandan R (2018) Sign recognition - how well does single shot multibox detector sum up? A Quantitative Study. In: Proceedings - Applied Imagery Pattern Recognition Workshop Institute of Electrical and Electronics Engineers Inc. https://doi.org/10.1109/AIPR.2018.8707409

    Chapter  Google Scholar 

  23. Mateen M, Wen J, Nasrullah, Song S, Huang Z (2019) Fundus image classification using VGG-19 architecture with PCA and SVD. Symmetry (Basel) 11:1. https://doi.org/10.3390/sym11010001

    Article  Google Scholar 

  24. Mathias M, Timofte R, Benenson R, Van Gool L (2013) Traffic sign recognition—How far are we from the solution? Neural Networks (IJCNN), 2013. In: Int. Jt. Conf, pp 1–8. https://doi.org/10.1109/IJCNN.2013.6707049

    Chapter  Google Scholar 

  25. Minhas RA, Javed A, Irtaza A, Mahmood MT, Joo YB (2019) Shot classification of field sports videos using AlexNet convolutional neural network. Appl Sci 9:483. https://doi.org/10.3390/app9030483

    Article  Google Scholar 

  26. Møgelmose A, Trivedi MM, Moeslund TB (2012) Vision-based traffic sign detection and analysis for intelligent driver assistance systems: perspectives and survey. IEEE Trans Intell Transp Syst 13:1484–1497. https://doi.org/10.1109/TITS.2012.2209421

    Article  Google Scholar 

  27. Møgelmose A, Liu D, Trivedi MM Detection of US Traffic Signs. IEEE Trans Intell Transp Syst 1

  28. Moiseev B, Konev A, Chigorin A, Konushin A (2013) Evaluation of traffic sign recognition methods trained on synthetically generated data. In: Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Springer Verlag, pp 576–583. https://doi.org/10.1007/978-3-319-02895-8_52

    Chapter  Google Scholar 

  29. Nadeem Z, Samad A, Abbas Z, Massod J (2018) A transfer learning based approach for pakistani traffic-sign recognition using ConvNets. In: 2018 International Conference on Computing, Electronic and Electrical Engineering, ICE Cube 2018. IEEE, Quetta, pp 1–6. https://doi.org/10.1109/ICECUBE.2018.8610979

    Chapter  Google Scholar 

  30. NN SVG (n.d.) https://alexlenail.me/NN-SVG/LeNet.html, last accessed 2020/06/12

  31. Obulesh A, Sri Sahithi P, Deepesh Kumar M, Pavitra M (n.d.) Traffic-Sign Classification Using Machine Learning Concepts | Tathapi with ISSN 2320–0693 is an UGC CARE Journal, http://tathapi.com/index.php/2320-0693/article/view/317, last accessed 2020/06/12

  32. Pakistan Bureau of Statistics: Annual Traffic Accidents in Pakistan, https://www.pbs.gov.pk/sites/default/files//tables/rename-as-per-table-type/tarffic_accidents_annaul__09_02_2021.pdf, last accessed 2021/10/13

  33. Sedik A, Hammad M, Abd El-Samie FE, Gupta BB, Abd El-Latif AA (2021) Efficient deep learning approach for augmented detection of Coronavirus disease. Neural Comput Appl:1–18. https://doi.org/10.1007/s00521-020-05410-8

  34. Shakhuro VI (2016) A.S.K.: Russian traffic sign images dataset. Comput Opt 40:294–300. https://doi.org/10.18287/2412-6179-2016-40-2-294-300

    Article  Google Scholar 

  35. Shustanov A, Yakimov P (2017) CNN design for real-time traffic sign recognition. Procedia Eng 201:718–725. https://doi.org/10.1016/j.proeng.2017.09.594

    Article  Google Scholar 

  36. Singh NS, Hariharan S, Gupta M (2020) Facial recognition using deep learning. In: Lecture Notes in Electrical Engineering. Springer, pp 375–382. https://doi.org/10.1007/978-981-15-0372-6_30

    Chapter  Google Scholar 

  37. Srivastava N, Hinton G, Krizhevsky A, Sutskever I, Salakhutdinov R (2014) Dropout: a simple way to prevent neural networks from overfitting. J Mach Learn Res 15:1929–1958. https://doi.org/10.1214/12-AOS1000

    Article  MathSciNet  MATH  Google Scholar 

  38. Stallkamp J, Schlipsing M, Salmen J (n.d.) German Dataset, http://benchmark.ini.rub.de/?section=gtsrb&subsection=dataset.

  39. Stallkamp J, Schlipsing M, Salmen J, Igel C (2011) The German Traffic Sign Recognition Benchmark: A multi-class classification competition. In: Proc. Int. Jt. Conf. Neural Networks, pp 1453–1460. https://doi.org/10.1109/IJCNN.2011.6033395

    Chapter  Google Scholar 

  40. Stallkamp J, Schlipsing M, Salmen J, Igel C (2012) Man vs computer: Benchmarking machine learning algorithms for traffic sign recognition. https://doi.org/10.1016/j.neunet.2012.02.016

  41. Tan C, Sun F, Kong T, Zhang W, Yang C, Liu C (2018) A survey on deep transfer learning. In: Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Springer Verlag, pp 270–279. https://doi.org/10.1007/978-3-030-01424-7_27

    Chapter  Google Scholar 

  42. Valiente R, Zaman M, Ozer S, Fallah YP (2019) Controlling steering angle for cooperative self-driving vehicles utilizing CNN and LSTM-based deep networks. In: IEEE Intelligent Vehicles Symposium, Proceedings. Institute of Electrical and Electronics Engineers Inc, pp 2423–2428. https://doi.org/10.1109/IVS.2019.8814260

    Chapter  Google Scholar 

  43. Vidushi AM (2021) A study on image analysis and recognition using learning methods: CNN as the best image learner. In: Lecture Notes on Data Engineering and Communications Technologies. Springer Science and Business Media Deutschland GmbH, pp 23–30. https://doi.org/10.1007/978-981-15-8335-3_3

    Chapter  Google Scholar 

  44. Wali SB, Hannan MA, Hussain A, Samad SA (2015) An automatic traffic sign detection and recognition system based on colour segmentation, shape matching, and SVM. Math Probl Eng 2015:1–11. https://doi.org/10.1155/2015/250461

    Article  Google Scholar 

  45. WHO: Road Traffic Accidents in Pakistan, https://www.worldlifeexpectancy.com/pakistan-road-traffic-accidents, last accessed 2021/10/13

  46. Wigness, M., Eum, S., Rogers Iii, J.G., Han, D., Kwon, H. (n.d.) A RUGD Dataset for Autonomous Navigation and Visual Perception in Unstructured Outdoor Environments.

  47. Xia Z, Yue G, Xu Y, Feng C, Yang M, Wang T, Lei B (2020) A Novel End-to-End Hybrid Network for Alzheimer’s Disease Detection Using 3D CNN and 3D CLSTM. In: Proceedings - International Symposium on Biomedical Imaging. IEEE Computer Society, pp 416–419. https://doi.org/10.1109/ISBI45749.2020.9098621

    Chapter  Google Scholar 

  48. Zhao J, Liang B, Chen Q (2018) The key technology toward the self-driving car. Int J Intell Unmanned Syst 6:2–20. https://doi.org/10.1108/IJIUS-08-2017-0008

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Engineering and Management Sciences, Balochistan University of Information Technology, Quetta, Pakistan

    Zain Nadeem, Zainullah Khan, Umer Iftikhar Mir, Shahnawaz Khan, Hamza Nadeem & Junaid Sultan

  2. University of Windsor, Windsor, Canada

    Usama Mir

  3. University College of Bahrain, Saar, Bahrain

    Shahnawaz Khan

Authors
  1. Zain Nadeem
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Zainullah Khan
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Usama Mir
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Umer Iftikhar Mir
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Shahnawaz Khan
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Hamza Nadeem
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Junaid Sultan
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Usama Mir.

Ethics declarations

The authors have no competing interests to declare that are relevant to the content of this article.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Nadeem, Z., Khan, Z., Mir, U. et al. Pakistani traffic-sign recognition using transfer learning. Multimed Tools Appl 81, 8429–8449 (2022). https://doi.org/10.1007/s11042-022-12177-8

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-022-12177-8

Keywords

Search

Navigation