Genetic Programming and Evolvable Machines

, Volume 17, Issue 3, pp 291–313 | Cite as

An automatic solver for very large jigsaw puzzles using genetic algorithms

  • Dror Sholomon
  • Omid E. David
  • Nathan S. Netanyahu
Article

Abstract

In this paper we propose the first effective genetic algorithm (GA)-based jigsaw puzzle solver. We introduce a novel crossover procedure that merges two “parent” solutions to an improved “child” configuration by detecting, extracting, and combining correctly assembled puzzle segments. The solver proposed exhibits state-of-the-art performance, as far as handling previously attempted puzzles more accurately and efficiently, as well puzzle sizes that have not been attempted before. The extended experimental results provided in this paper include, among others, a thorough inspection of up to 30,745-piece puzzles (compared to previous attempts on 22,755-piece puzzles), using a considerably faster concurrent implementation of the algorithm. Furthermore, we explore the impact of different phases of the novel crossover operator by experimenting with several variants of the GA. Finally, we compare different fitness functions and their effect on the overall results of the GA-based solver.

Keywords

Computer vision Genetic algorithms Jigsaw puzzle 

References

  1. 1.
    T. Altman, Solving the jigsaw puzzle problem in linear time. Appl. Artif. Intell. Int. J. 3(4), 453–462 (1989)CrossRefGoogle Scholar
  2. 2.
    B. Brown, C. Toler-Franklin, D. Nehab, M. Burns, D. Dobkin, A. Vlachopoulos, C. Doumas, S. Rusinkiewicz, T. Weyrich, A system for high-volume acquisition and matching of fresco fragments: Reassembling Theran wall paintings. ACM Trans. Graph. 27(3), 84 (2008)CrossRefGoogle Scholar
  3. 3.
    S. Cao, H. Liu, S. Yan, Automated assembly of shredded pieces from multiple photos, in IEEE International Conference on Multimedia and Expo (2010), pp. 358–363Google Scholar
  4. 4.
    T. Cho, S. Avidan, W. Freeman, A probabilistic image jigsaw puzzle solver, in IEEE Conference on Computer Vision and Pattern Recognition (2010), pp. 183–190Google Scholar
  5. 5.
    T. Cho, M. Butman, S. Avidan, W. Freeman, The patch transform and its applications to image editing, in IEEE Conference on Computer Vision and Pattern Recognition (2008), pp. 1–8Google Scholar
  6. 6.
    A. Deever, A. Gallagher, Semi-automatic assembly of real cross-cut shredded documents, in IEEE International Conference on Image Processing (2012), pp. 233–236Google Scholar
  7. 7.
    E. Demaine, M. Demaine, Jigsaw puzzles, edge matching, and polyomino packing: connections and complexity. Graphs Comb. 23, 195–208 (2007)MathSciNetCrossRefMATHGoogle Scholar
  8. 8.
    H. Freeman, L. Garder, Apictorial jigsaw puzzles: the computer solution of a problem in pattern recognition. IEEE Trans. Electron. Comput. EC–13(2), 118–127 (1964)CrossRefGoogle Scholar
  9. 9.
    A. Gallagher, Jigsaw puzzles with pieces of unknown orientation, in IEEE Conference on Computer Vision and Pattern Recognition (2012), pp. 382–389Google Scholar
  10. 10.
    D. Goldberg, C. Malon, M. Bern, A global approach to automatic solution of jigsaw puzzles. Comput. Geom. Theory Appl. 28(2–3), 165–174 (2004)MathSciNetCrossRefGoogle Scholar
  11. 11.
    E. Justino, L. Oliveira, C. Freitas, Reconstructing shredded documents through feature matching. Forensic Sci. Int. 160(2), 140–147 (2006)CrossRefGoogle Scholar
  12. 12.
    D . Koller, M. Levoy, Computer-aided reconstruction and new matches in the forma urbis romae. Bullettino della Commissione Archeologica Comunale di Roma. Supplementi. 15, 103–125 (2006)Google Scholar
  13. 13.
    W. Marande, G. Burger, Mitochondrial DNA as a genomic jigsaw puzzle. Science 318(5849), 415–415 (2007)CrossRefGoogle Scholar
  14. 14.
    M. Marques, C. Freitas, Reconstructing strip-shredded documents using color as feature matching, in ACM Symposium on Applied Computing (2009), pp. 893–894Google Scholar
  15. 15.
    A.Q. Morton, M. Levison, The computer in literary studies, in IFIP Congress (1968), pp. 1072–1081Google Scholar
  16. 16.
    D. Pomeranz, M. Shemesh, O. Ben-Shahar, A fully automated greedy square jigsaw puzzle solver, in IEEE Conference on Computer Vision and Pattern Recognition (2011), pp. 9–16Google Scholar
  17. 17.
    D. Pomeranz, M. Shemesh, O. Ben-Shahar, A fully automated greedy square jigsaw puzzle solver MATLAB code and images (2011). https://sites.google.com/site/greedyjigsawsolver/home
  18. 18.
    D. Sholomon, O.E. David, N.S. Netanyahu, Datasets of larger images and GA-based solver’s results on these and other sets. http://www.cs.biu.ac.il/~nathan/Jigsaw
  19. 19.
    D. Sholomon, O.E. David, N.S. Netanyahu, A genetic algorithm-based solver for very large jigsaw puzzles, in IEEE Conference on Computer Vision and Pattern Recognition (2013), pp. 1767–1774Google Scholar
  20. 20.
    D. Sholomon, O.E. David, N.S. Netanyahu, Genetic algorithm-based solver for very large multiple jigsaw puzzles of unknown dimensions and piece orientation, in ACM Conference on Genetic and Evolutionary Computation (2014), pp. 1191–1198Google Scholar
  21. 21.
    D. Sholomon, O.E. David, N.S. Netanyahu, A generalized genetic algorithm-based solver for very large jigsaw puzzles of complex types, in AAAI Conference on Artificial Intelligence (2014), pp. 2839–2845Google Scholar
  22. 22.
    K. Son, J. Hays, D.B. Cooper, Solving square jigsaw puzzles with loop constraints, in European Conference on Computer Vision 2014 (Springer, 2014), LNCS 8694, pp. 32–46Google Scholar
  23. 23.
    F. Toyama, Y. Fujiki, K. Shoji, J. Miyamichi, Assembly of puzzles using a genetic algorithm, in International Conference on Pattern Recognition (2002) (Vol. 4), pp. 389–392Google Scholar
  24. 24.
    C.S.E. Wang, Determining molecular conformation from distance or density data, Ph.D. thesis, Massachusetts Institute of Technology, Department of Electrical Engineering and Computer Science (2000). http://theses.mit.edu/Dienst/UI/2.0/Describe/0018.mit.etheses/2000-2. Also available online at the MIT theses online homepage http://thesis.mit.edu/
  25. 25.
    X. Yang, N. Adluru, L.J. Latecki, Particle filter with state permutations for solving image jigsaw puzzles, in IEEE Conference on Computer Vision and Pattern Recognition (2011), pp. 2873–2880Google Scholar
  26. 26.
    Y. Zhao, M. Su, Z. Chou, J. Lee, A puzzle solver and its application in speech descrambling, in WSEAS International Conference Computer Engineering and Applications (2007), pp. 171–176Google Scholar

Copyright information

© Springer Science+Business Media New York 2016

Authors and Affiliations

  • Dror Sholomon
    • 1
  • Omid E. David
    • 1
  • Nathan S. Netanyahu
    • 1
    • 2
  1. 1.Department of Computer ScienceBar-Ilan UniversityRamat GanIsrael
  2. 2.Center for Automation ResearchUniversity of MarylandCollege ParkUSA

Personalised recommendations