Skip to main content
SpringerLink
Log in

Generating Jigsaw Puzzles and an AI Powered Solver

  • Conference paper
  • First Online:
Modelling and Development of Intelligent Systems (MDIS 2022)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 1761))

  • 364 Accesses

Abstract

This paper tackles the problem of assembling a jigsaw puzzle, starting only from a picture of the scrambled jigsaw puzzle pieces on a random, textured background. This manuscript discusses previous approaches in dealing with the jigsaw puzzle problem and brings two contributions: an open source tool for creating realistic scrambled jigsaw puzzles meant to serve as a foundation for further research in the field; and an end to end AI based solution taking advantage of the convolutional neural network architecture, capable of solving a scrambled jigsaw puzzle of unknown pictorial and with an unknown, uniformly textured, background. The lessons and techniques learned in engaging with the jigsaw puzzle problem can be further used in approaching the more general and complex problem of Protein-Protein interaction prediction.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 69.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 89.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Bacanin, N., Stoean, R., Zivkovic, M., Petrovic, A., Rashid, T.A., Bezdan, T.: Performance of a novel chaotic firefly algorithm with enhanced exploration for tackling global optimization problems: application for dropout regularization. Mathematics 9(21) (2021). https://doi.org/10.3390/math9212705, https://www.mdpi.com/2227-7390/9/21/2705

  2. Cho, T.S., Avidan, S., Freeman, W.T.: A probabilistic image jigsaw puzzle solver. In: 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 183–190. IEEE (2010). https://doi.org/10.1109/CVPR.2010.5540212

  3. Demaine, E.D., Demaine, M.L.: Jigsaw puzzles, edge matching, and polyomino packing: connections and complexity. Graphs Comb. 23(S1), 195–208 (2007). https://doi.org/10.1007/s00373-007-0713-4

    Article  MathSciNet  MATH  Google Scholar 

  4. Developers, T.: Tensorflow (2022). https://www.tensorflow.org

  5. Doherty, M.J., Wimmer, M.C., Gollek, C., Stone, C., Robinson, E.J.: Piecing together the puzzle of pictorial representation: how jigsaw puzzles index metacognitive development. Child Dev. 92(1), 205–221 (2021)

    Article  Google Scholar 

  6. Freeman, H., Garder, L.: Apictorial jigsaw puzzles: the computer solution of a problem in pattern recognition. IEEE Trans. Electron. Comput. EC-13(2), pp. 118–127 (1964). https://doi.org/10.1109/PGEC.1964.263781

  7. Gallagher, A.C.: Jigsaw puzzles with pieces of unknown orientation. In: 2012 IEEE Conference on Computer Vision and Pattern Recognition, pp. 382–389. IEEE (2012). https://doi.org/10.1109/CVPR.2012.6247699

  8. Goldberg, D., Malon, C., Bern, M.: A global approach to automatic solution of jigsaw puzzles. In: Proceedings of the Eighteenth Annual Symposium on Computational Geometry, SCG 2002, pp. 82–87. Association for Computing Machinery, New York (2002). https://doi.org/10.1145/513400.513410

  9. Gur, S., Ben-Shahar, O.: From square pieces to brick walls: the next challenge in solving jigsaw puzzles. In: 2017 IEEE International Conference on Computer Vision (ICCV), pp. 4049–4057. IEEE (2017). https://doi.org/10.1109/ICCV.2017.434

  10. Khoroshiltseva, M., Vardi, B., Torcinovich, A., Traviglia, A., Ben-Shahar, O., Pelillo, M.: Jigsaw puzzle solving as a consistent labeling problem. In: Tsapatsoulis, N., Panayides, A., Theocharides, T., Lanitis, A., Pattichis, C., Vento, M. (eds.) CAIP 2021. LNCS, vol. 13053, pp. 392–402. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-89131-2_36

    Chapter  Google Scholar 

  11. Kosiba, D., Devaux, P., Balasubramanian, S., Gandhi, T., Kasturi, K.: An automatic jigsaw puzzle solver. In: Proceedings of 12th International Conference on Pattern Recognition, vol. 1, pp. 616–618. IEEE Computer Society Press (1994). https://doi.org/10.1109/ICPR.1994.576377

  12. Krasin, I., et al.: OpenImages: a public dataset for large-scale multi-label and multi-class image classification (2017). https://github.com/openimages

  13. LeNail, A.: NN-SVG: publication-ready neural network architecture schematics. J. Open Sour. Softw. 4(33), 747 (2019). https://doi.org/10.21105/joss.00747

  14. Li, R., Liu, S., Wang, G., Liu, G., Zeng, B.: JigsawGAN: auxiliary learning for solving jigsaw puzzles with generative adversarial networks. IEEE Trans. Image Process. 31, 513–524 (2022). https://doi.org/10.1109/TIP.2021.3120052

    Article  Google Scholar 

  15. Malakar, S., Ghosh, M., Bhowmik, S., Sarkar, R., Nasipuri, M.: A GA based hierarchical feature selection approach for handwritten word recognition. Neural Comput. Appl. 32(7), 2533–2552 (2019). https://doi.org/10.1007/s00521-018-3937-8

    Article  Google Scholar 

  16. Minaee, S., Boykov, Y., Porikli, F., Plaza, A., Kehtarnavaz, N., Terzopoulos, D.: Image segmentation using deep learning: a survey. IEEE Trans. Pattern Anal. Mach. Intell. 44(7), 3523–3542 (2022). https://doi.org/10.1109/TPAMI.2021.3059968

    Article  Google Scholar 

  17. Paikin, G., Tal, A.: Solving multiple square jigsaw puzzles with missing pieces. In: 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 4832–4839. IEEE (2015). https://doi.org/10.1109/CVPR.2015.7299116

  18. Paumard, M.M., Picard, D., Tabia, H.: Deepzzle: solving visual jigsaw puzzles with deep learning and shortest path optimization. IEEE Trans. Image Process. 29, 3569–3581 (2020). https://doi.org/10.1109/TIP.2019.2963378

    Article  MATH  Google Scholar 

  19. PDB, R.: RCSB PDB. https://www.rcsb.org/

  20. Pomeranz, D., Shemesh, M., Ben-Shahar, O.: A fully automated greedy square jigsaw puzzle solver. In: CVPR 2011, pp. 9–16. IEEE (2011). https://doi.org/10.1109/CVPR.2011.5995331

  21. Prasad, L., Waygood, E.B., Lee, J.S., Delbaere, L.T.J.: The 2.5 å resolution structure of the jel42 fab fragment/HPr complex. J. Mol. Biol. 280(5), pp. 829–845 (1998). https://doi.org/10.1006/jmbi.1998.1888

  22. Priatama, A.R., Setiawan, Y., Mansur, I., Masyhuri, M.: Regression models for estimating aboveground biomass and stand volume using landsat-based indices in post-mining area. J. Manajemen Hutan Tropika 28(1), 1–14 (2022). https://doi.org/10.7226/jtfm.28.1.1

    Article  Google Scholar 

  23. Sagiroglu, M., Ercil, A.: A texture based matching approach for automated assembly of puzzles. In: 18th International Conference on Pattern Recognition (ICPR 2006), vol. 3, pp. 1036–1041. IEEE (2006). https://doi.org/10.1109/ICPR.2006.184

  24. Sahu, E., Mishra, G., Singh, H., Kumar, V.: A review on the evolution of jigsaw puzzle algorithms and the way forward. In: 2022 9th International Conference on Computing for Sustainable Global Development (INDIACom), pp. 281–287. Institute of Electrical and Electronics Engineers (IEEE) (2022). https://doi.org/10.23919/INDIACom54597.2022.9763234

  25. Sehnal, D., et al.: Mol* viewer: modern web app for 3D visualization and analysis of large biomolecular structures. Nucleic Acids Res. 49(W1), W431–W437 (2021). https://doi.org/10.1093/nar/gkab314

  26. Sholomon, D., David, O., Netanyahu, N.S.: A genetic algorithm-based solver for very large jigsaw puzzles. In: 2013 IEEE Conference on Computer Vision and Pattern Recognition, pp. 1767–1774. Institute of Electrical and Electronics Engineers (IEEE) (2013). https://doi.org/10.1109/CVPR.2013.231

  27. Son, K., Moreno, D., Hays, J., Cooper, D.B.: Solving small-piece jigsaw puzzles by growing consensus. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1193–1201. IEEE (2016). https://doi.org/10.1109/CVPR.2016.134

Download references

Author information

Authors and Affiliations

  1. School of Computer Science and Informational Technology, University College Cork, Cork, Ireland

    Stefan-Bogdan Marcu, Yanlin Mi & Sabin Tabirca

  2. Faculty of Mathematics and Informatics, Transilvania University of Braşov, Braşov, Romania

    Sabin Tabirca

  3. Cancer Research@UCC, APC Microbiome Ireland, SynBioCentre, iEd Hub, University College Cork, Cork, Ireland

    Mark Tangney

  4. Centre for Advanced Photonics and Process Analytics, Munster Technological University, Cork, Ireland

    Venkata V. B. Yallapragada

Authors
  1. Stefan-Bogdan Marcu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yanlin Mi
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Venkata V. B. Yallapragada
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Mark Tangney
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Sabin Tabirca
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Stefan-Bogdan Marcu .

Editor information

Editors and Affiliations

  1. Lucian Blaga University of Sibiu, Sibiu, Romania

    Dana Simian

  2. Lucian Blaga University of Sibiu, Sibiu, Romania

    Laura Florentina Stoica

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Marcu, SB., Mi, Y., Yallapragada, V.V.B., Tangney, M., Tabirca, S. (2023). Generating Jigsaw Puzzles and an AI Powered Solver. In: Simian, D., Stoica, L.F. (eds) Modelling and Development of Intelligent Systems. MDIS 2022. Communications in Computer and Information Science, vol 1761. Springer, Cham. https://doi.org/10.1007/978-3-031-27034-5_10

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-27034-5_10

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-27033-8

  • Online ISBN: 978-3-031-27034-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation