Skip to main content
SpringerLink
Log in

Classification of fragments: recognition of artistic style

  • Original Research
  • Published:
Journal of Ambient Intelligence and Humanized Computing Aims and scope Submit manuscript

Abstract

Disruptive phenomena are known for damaging the original appearance of artworks, even when the pieces are carefully and meticulously put together. Machine Learning and Computer vision techniques may be effective support tools during the works in an excavation site to resolve the issues of reconstructing frescoes, painting or sculptures. Not infrequently happens that multiple and different pictorial styles may be found in the same historical ruins. Classifying the fragments into the right pictorial style plays a significant role as a prior step for reconstruction. Determining the pictorial style or the painter from the full artwork is feasible, but it is distant from the real working conditions in the excavations. In this work a dataset called CLEOPATRA is proposed. It collects frescoes of eleven painting styles, from Prehistory to Surrealism, and simulate the effects of collapsing events that turn them into pieces. The fragmentation strategies applied are varied in terms of size (each work is divided into 10, 20, 40 and 80 pieces respectively) and the modus operandi for obtaining the pieces (one approach exploits the salient features of the work while another is random). For each of the fragments obtained, two different Machine Learning approaches were involved to solve the classification problem, discussing the advantages and critical aspect that make it a challenging but also relevant problem for archaeologists. The approach that exploits information on colour, shape and texture features is the one that gives the best results. A further study in which starting with the three most disparate artistic periods and progressively adding two more shows clearly that when the problem is significantly simpler, i.e. with fewer classes, the overall performance of the system improves.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

Notes

  1. The datasets generated during the current study are available from the corresponding author on reasonable request.

References

  • Achanta R, Shaji A, Smith K, Lucchi A, Fua P, Süsstrunk S (2012) Slic superpixels compared to state-of-the-art superpixel methods. IEEE Trans Pattern Anal Mach Intell 34(11):2274–2282

    Article  Google Scholar 

  • Achanta R, Shaji A, Smith K, Lucchi A, Fua P, Süsstrunk S (2010) Slic superpixels. Technical report, EPFL, 06

  • Anzalone L, Barra P, Barra S, Narducci F, Nappi M (2019) Transfer learning for facial attributes prediction and clustering. Commun Comput Inf Sci 1122 CCIS:105–117

  • Bae S, Durand F (2004) Statistical analysis and transfer of pictorial styles. 01

  • Bragantini, I (2008) Tra ercolano e pompei: il sistema decorativo della casa. L. Chioffi (a cura di), Il Mediterraneo e la Storia. Epigrafia e archeologia in Campania: letture storiche. Atti dell’Incontro Internazionale di Studio, Napoli, pp 4–5

  • Brandi C (1963) Teoria del restauro. Edizioni di storia e letterature

  • Brown BJ, Toler-Franklin C, Nehab D, Burns M, Dobkin D, Vlachopoulos A, Doumas C, Rusinkiewicz S, Weyrich T (2008) A system for high-volume acquisition and matching of fresco fragments: Reassembling theran wall paintings. ACM Trans Graph 27(3):1–9. ISSN 0730-0301

  • Cascone L, Dondi P, Lombardi L, Narducci F (2022) Automatic classification of fresco fragments: a machine and deep learning study. In: Image analysis and processing—ICIAP 2022. Springer International Publishing, pp 701–712

  • Dell’Unto N, Ferdani D, Leander Touati A-M, Dellepiane M, Callieri M (2013) Digital reconstruction and visualization in archaeology Case-study drawn from the work of the Swedish Pompeii Project, pp 621–628. 10. ISBN 978-1-4799-3168-2. https://doi.org/10.1109/DigitalHeritage.2013.6743804

  • Demetrescu E (2015) Archaeological stratigraphy as a formal language for virtual reconstruction. theory and practice. J Archaeol Sci 57:42–55. ISSN 0305-4403. https://doi.org/10.1016/j.jas.2015.02.004

  • Díaz-Marín C, Vendrell-Vidal E, Aura-Castro E, Abate AF, Sánchez- Belenguer C, Narducci F (2015) Virtual reconstruction and representation of an archaeological terracotta statue. In: 2015 Digital heritage, vol 2, pp 699–702. https://doi.org/10.1109/DigitalHeritage.2015.7419602

  • Dimov DT (2020) Rotation-invariant ncc for 2d color matching of arbitrary shaped fragments of a fresco. Pattern Recogn Lett 138:431–438

    Article  Google Scholar 

  • Dondi P, Lombardi L, Setti A (2020) Dafne: a dataset of fresco fragments for digital anastlylosis. Pattern Recogn Lett 138:631–637

    Article  Google Scholar 

  • Dondi P, Lombardi L, Malagodi M, Licchelli M (2021) Stylistic classification of historical violins: a deep learning approach. pp 112–125, 02. ISBN 978-3-030-68786-1. https://doi.org/10.1007/978-3-030-68787-8_8

  • Doumas C (1992) The wall-paintings of Thera. Thera Foundation, Petros M. Nomikos, Athens. ISBN 9602202742

  • Du G, Zhou M, Yin C, Wu Z, Shui W (2016) Classification and reassembly of archaeological fragments, pp 67–70, 12. https://doi.org/10.1145/3014027.3014031

  • Funkhouser T, Shin H, Toler-Franklin C, Castañeda AG, Brown B, Dobkin D, Rusinkiewicz S, Weyrich T (2011) Learning how to match fresco fragments. 4(2). ISSN 1556-4673

  • Lepore G (2019) Agrigento 1: quartiere ellenistico-romano : Insula III : relazione degli scavi e delle ricerche 2016-2018. Studi Agrigentini. Edizioni Quasar. ISBN 9788871409887

  • Lermé N, Le Hégarat-Mascle S, Zhang B, Aldea E (2020) Fast and efficient reconstruction of digitized frescoes. Pattern Recogn Lett 138:417–423

    Article  Google Scholar 

  • Limoncelli M (2012) Il restauro virtuale in archeologia. Biblioteca di testi e studi Carocci. Archeologia. Carocci. ISBN 9788843062225

  • Li J, Wang J (2004) Studying digital imagery of ancient paintings by mixtures of stochastic models. IEEE transactions on image processing: a publication of the IEEE Signal Processing Society, vol 13, pp 340–53, 04. https://doi.org/10.1109/TIP.2003.821349

  • Nunez-Garcia I, Lizarraga-Morales R, Hernandez-Gomez G (2018) Classification of paintings by artistic genre integrating color and texture descriptors. pp 66–70, 08. ISBN 978-1-4503-6524-6. https://doi.org/10.1145/3268866.3268885

  • Peng K-C, Chen T (2015) Cross-layer features in convolutional neural networks for generic classification tasks. pp 3057–3061. https://doi.org/10.1109/ICIP.2015.7351365

  • Purandare V, Talele KT (2014) Efficient heterogeneous face recognition using scale invariant feature transform. In: 2014 international conference on circuits, systems, communication and information technology applications (CSCITA), pp 305–310. https://doi.org/10.1109/CSCITA.2014.6839277

  • Rojas DJB, Fernandes BJT, Fernandes SMM (2020) A review on image inpainting techniques and datasets. In: 2020 33rd SIBGRAPI conference on graphics, patterns and images (SIBGRAPI), pp 240–247. IEEE

  • Saffo: A sift based approach for digital anastylosis for fresco reconstruction. Pattern Recogn Lett 138:123–129 (2020). ISSN 0167-8655. https://doi.org/10.1016/j.patrec.2020.07.008

  • Sandoval C, Pirogova E, Lech M (2019) Two-stage deep learning approach to the classification of fine-art paintings. IEEE Access 7:41770–41781. https://doi.org/10.1109/ACCESS.2019.2907986

    Article  Google Scholar 

  • Sandoval C, Pirogova E, Lech M (2020) Classification of fine-art paintings with simulated partial damages. In: 2020 14th international conference on signal processing and communication systems (ICSPCS), pp 1–8. https://doi.org/10.1109/ICSPCS50536.2020.9310010

  • Sethi R, Buell C, Seeley W, Krothapalli S (2018) An open access platform for analyzing artistic style using semantic workflows, pp 166–180. 06. ISBN 978-3-319-94288-9. https://doi.org/10.1007/978-3-319-94289-6_11

  • Sewan AFH, Altaei MSM (2021) Copy move forgery detection using forensic images. Iraqi J Sci 3167–3181

  • Silva JM, Pratas D, Antunes R, Matos S, Pinho AJ (2021) Automatic analysis of artistic paintings using information-based measures. Pattern Recogn 114:107864

    Article  Google Scholar 

  • Sizyakin R, Voronin V, Pizurica A (2022) Virtual restoration of paintings based on deep learning, pp 60, 03. https://doi.org/10.1117/12.2624371

  • Tammisto A, Danielli C, Häyhä H (2008) Poster: Developing the digital puzzling and reconstruction system for second style fresco fragments from the house of marcus lucretius (ix, 3, 5.24) in pompeii. In: Guidobaldi M, Guzzo P (eds) Nuove ricerche archeologiche nell’area Vesuviana (scavi 2003-2006), Studi della Soprintendenza archeologica di Pompei, pp 544–545

  • Unser M (1986) Sum and difference histograms for texture classification. IEEE Trans Pattern Anal Mach Intell PAMI–8(1):118–125. https://doi.org/10.1109/TPAMI.1986.4767760

    Article  Google Scholar 

  • Willats J, Durand F (2005) Defining pictorial style: lessons from linguistics and computer graphics. Axiomathes 15:319–351, 09. https://doi.org/10.1007/s10516-004-5449-7

    Article  Google Scholar 

  • Wu D, Luo X, Shang M, He Y, Wang G, Wu X (jun 2022) A data-characteristic-aware latent factor model for web services qos prediction. IEEE Transactions on Knowledge & Data Engineering, 34(06):2525–2538. ISSN 1558-2191. https://doi.org/10.1109/TKDE.2020.3014302

  • Yang K, Cao X, Li K, Geng G, Zhou M (2020) Classification of 3d terracotta warriors fragments based on geospatial and texture information. J Vis. https://doi.org/10.1007/s12650-020-00710-6

    Article  Google Scholar 

  • Yuan Y, He Q, Luo X, Shang M (2022) A multilayered-and-randomized latent factor model for high-dimensional and sparse matrices. IEEE Trans Big Data 8(3):784–794. https://doi.org/10.1109/TBDATA.2020.2988778

    Article  Google Scholar 

Download references

Author information

Author notes

  1. Lucia Cascone, Michele Nappi, and Sara Linda Russo are contributing authors.

Authors and Affiliations

  1. Department of Computer Sciences, University of Salerno, via Giovanni Paolo II, 132, Fisciano, 84084, Salerno, Italy

    Lucia Cascone, Michele Nappi, Fabio Narducci & Sara Linda Russo

Authors
  1. Lucia Cascone
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Michele Nappi
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Fabio Narducci
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Sara Linda Russo
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Fabio Narducci.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Cascone, L., Nappi, M., Narducci, F. et al. Classification of fragments: recognition of artistic style. J Ambient Intell Human Comput 14, 4087–4097 (2023). https://doi.org/10.1007/s12652-022-04472-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12652-022-04472-x

Keywords

Search

Navigation