1 Introduction

The comparative studies, available in literature and addressed to the modelling of unreinforced (URM) buildings, document a large scattering of achievable results, especially when used to finalize the seismic assessment through nonlinear analyses. This is mostly due to the too many possible choices in defining the numerical model and in interpreting the results. As evidence of this, the challenging topic is highlighted by both: research works specifically addressed to test different modelling strategies (e.g. Salonikios et al. 2003; Giamundo et al. 2014; Betti et al. 2014), considering also commercial software packages (e.g. Marques and Lourenco 2011; 2014; Calderoni et al. 2015; De Falco et al. 2017; Siano et al. 2018; Aşıkoğlu et al. 2020); or blind predictions involving a large number of research teams called to predict the seismic response of the same benchmark prototype (e.g. in Mendes et al. 2017; Esposito et al. 2019; Bartoli et al. 2017; Parisse et al. 2021).

Although unanimous in highlighting the huge potential scattering of achievable results, these comparative studies are not conclusive in quantifying the uncertainty associated to the software-to-software variability neither when used under the same hypotheses nor when the latter are kept free. Moreover, in most cases the aforementioned studies have been carried out on very simple structures (usually two-story single-unit or even single walls), using a quite limited number of software packages (SWs) (apart in the case of blind predictions) and focusing the comparison just on the pushover curves and the damage pattern. Actually, the comparison has been extended to local parameters—such as the evolution of internal generalized forces in specific structural elements—in very few cases, as in Marques and Lourenco (2014).

With the attempt to fill these gaps, a wide research program was carried out, starting in 2014, by several Italian Universities involved in the ReLUIS projects (Rete dei Laboratori Universitari di Ingegneria Sismica—Italian Network of University Seismic Laboratories), synthetically named in the following as "URM nonlinear modelling—Benchmark project” and described more in details in Cattari and Magenes (2021). In such a project, different benchmark examples of increasing complexity—ranging from the single panel to 3D existing buildings—have been specifically designed and analysed by a large set of SWs belonging to various modelling strategies. Moreover, detailed input data for all of the considered case studies, allowing them to be replicated also by other researchers and analysts, are provided in Cattari and Magenes (2021) as supplementary electronic material.

Within this context, the paper presents the comparative study carried out on the benchmark structure named BS5, inspired by the geometry and typological-constructive data of the "P. Capuzi" school in Visso (MC, Italy). This building was built in the 30 s and strengthened following the Umbria-Marche 1997 earthquake. It was severely damaged by the seismic sequence that affected Central Italy in 2016/2017, mainly exhibiting a global box-type behavior with cracks concentrated in piers and spandrels. The structure, now demolished because of the serious damage suffered, was the subject of a permanent seismic monitoring system by the DPC through the OSS (acronym of the Italian name “Osservatorio Sismico delle Strutture”) (Dolce et al. 2017) and was analyzed in other literature works with the aim of an accurate numerical simulation of its actual response (Cattari et al. 2019; Graziotti et al. 2019; Ferrero et al. 2020; Brunelli et al. 2021).

Although this paper investigates this structure from a different perspective (i.e. a comparative rather than a validation study), nonetheless the availability of an accurate survey of the damage occurred provides very interesting data to support some modelling assumptions, such as the criteria adopted for the equivalent frame idealization of walls (as illustrated in Sect. 2.1), and to carry out a comparison with the actual response in qualitative terms (e.g. damage pattern, as discussed in Sect. 3.4).

The paper focuses the attention on the results achieved by performing nonlinear static analyses through six SWs which work in the field of the equivalent frame (EF) modeling, also available at professional level, while the companion paper made by Castellazzi et al. (2021) investigates the same topic by adopting three additional SWs belonging to continuum and discrete-macroelement models (synthetically called as “refined models” in the following).

While other literature works already provided an in-depth state-of-the-art of the different options involved in the equivalent frame modelling process (Quagliarini et al. 2017) or a discussion on the repercussions of some of them in the seismic assessment (Rota et al. 2014; Bracchi et al. 2015; Cattari et al. 2021a; Manzini et al. 2021), in this paper the main objective is to quantify the dispersion of achievable results when using different SWs: firstly, by setting the models with shared and consistent modelling assumptions (Sect. 3); secondly, by investigating the sensitivity of the seismic response to some common epistemic and modelling uncertainties (Sect. 4). In particular, in Sect. 3 the comparison is made in terms of total masses, dynamic parameters (periods and modal shapes obtained from the execution of a modal analysis) and results from nonlinear static analyses (e.g. pushover curve, parameters of the equivalent bilinear curve and damage occurred in structural elements). In Sect. 4, the effect of alternative equivalent frame idealization criteria adopted for masonry walls, the role of the out-of-plane contribution of piers and different assumptions for the effectiveness of wall-to-wall connections are investigated by analyzing the abovementioned parameters representative of the global structural response.

Finally, in Sect. 5, passing to an engineering practice-oriented perspective, the repercussions of the dispersion of results on the seismic verification are discussed by computing the maximum peak ground acceleration (PGA) compatible with the attainment of the ultimate displacement capacity of the structure as estimated through the pushover curves.

2 Brief description of the benchmark case study and modelling hypotheses adopted

With respect to the original configuration of the “P. Capuzi” school, some simplifications have been introduced in the “URM nonlinear modelling—Benchmark project”, as accurately described in the Annex I-Benchmark Structures Input Data included as supplementary electronic material in Cattari and Magenes (2021). The latter contains also the complete set of input data necessary to reproduce the BS5 by other researchers, while in the following only the essential features are recalled.

In particular, the structure is on two levels plus an attic floor, this latter having been simulated in the analysis only in terms of equivalent mass; conversely, the underground part visible in Figs. 3, 4 and 5 has not been modelled, according to the simplifications introduced in the project. The BS has an irregular shape, assimilable to a T (Fig. 1),and is characterized by load-bearing unreinforced masonry and rigid floors. The walls are mainly made of cut stone masonry with good bonding (Cut stone in Fig. 1.a). Some walls have undergone strengthen interventions with mortar injections (Cut stone—S in Fig. 1a). Moreover, pillars and limited portions composed by a solid brick and mortar joints masonry (Brick in Fig. 1a) are present in a more sporadic way.

Fig. 1
figure 1

a Identification of masonry types at the ground floor; b identification of wall thickness of the ground floor and numbering of the walls

In order to investigate the dispersion of the results achievable from different SWs also varying some structural details common in existing buildings, two different parametric configurations have been analyzed, namely:

  • BS5/A—masonry spandrels not coupled to any tensile resistant horizontal element at floor level. In this case, only the presence of an effective lintel is assumed, while the contribution of other factors that can produce an equivalent tensile strength on spandrels (such as the interlocking with the adjacent masonry region, as discussed in Beyer and Mangalathu 2013) is neglected. This configuration aims to promote the so-called “weak spandrels” behavior.

  • BS5/C—masonry spandrels coupled to reinforced concrete (r.c.) tie beams.

The analysis of cases BS5/A and BS5/C allows to extend to a complex building some considerations on the coupling role provided by spandrels to piers already emerged from the analysis of other simpler benchmark structures, like that analyzed in Manzini et al. (2021). The BS5/C case is the most consistent with the actual configuration of the building. In particular, since in-situ investigations detected the presence of a full thickness r.c. tie beam, the modelling hypothesis consisting of spandrels broken up at the level of the r.c. tie beam has been assumed. For simplicity, the same spandrels geometry has been adopted also in the case BS5/A.

To reduce the dispersion in the results, the following assumptions were shared among the Research Teams (RTs) involved in the "URM nonlinear modelling—Benchmark project”:

  • The geometrical data (such as the wall thicknesses, as synthetically reported in Fig. 1b for the ground floor).

  • The distribution and values of the floor loads, including that of the roof, considered only as an equivalent additional mass and not through the explicit modelling of each single structural element. Figure 1a depicts the main spanning orientation of diaphragms.

  • The mechanical properties of all materials.

With regard to the materials properties, Table 1 summarizes the values adopted for the masonry types that characterize the building. The values are compatible with the reference range of variation proposed in the Instructions of the Italian Technical Standards (MIT 2019) for the corresponding analogous masonry types; the reliability of these values is confirmed also by other experimental literature data (e.g. Krzan et al. 2015; Vanin et al. 2017). Consistently with what usually recommended by Codes (e.g.: NTC (2018), EC8-3 (CEN 2005)), in order to reproduce the effects of progressing cracking, a reduction factor conventionally equal to 0.50 has been applied to the gross stiffness of each element. In this respect, it is noted that the values of the elastic moduli of masonry summarized in Table 1 refer to the initial elastic condition.

Table 1 Mechanical parameters adopted for BS5

The parameters summarized in Table 1 have been adopted as target for a twofold aim: in the EF models discussed in this paper, to evaluate the shear strength associated to masonry elements according to the common criteria proposed in literature (Calderini et al. 2009); in the more refined models presented in the companion paper by Castellazzi et al. (2021), to calibrate the more complex set of parameters which the constitutive laws adopted by the refined models are based on. The latter process is essential to guarantee a cross-consistency among models belonging to different modelling approaches working at different scales (as discussed in-depth also in D’Altri et al. 2021 and in Cattari et al. 2021b).

In particular, in the equivalent frame models, the strength associated with the flexural failure mode of piers is evaluated by neglecting the tensile strength of the material and assuming at the compressed toe an equivalent rectangular stress block of normal stresses of height 0.85 fm (where fm is the compressive strength of masonry and 0.85 is the stress-block equivalence coefficient, as proposed in NTC (2018) and EC8-3 (CEN 2005). In the case of the spandrels, the flexural behavior is differently interpreted in cases BS5/A and BS5/C. For the BS5/C case, the development of a strut mechanism was assumed likely to occur due to the presence of r.c. tie beams and it was interpreted according to the criterion proposed in NTC (2018), considering the maximum normal stress transmissible by the tensile resistant element coupled to the spandrel. Conversely, in the BS5/A case, among the different options (see Beyer and Manalaghu 2013; Betti et al. 2008), the same criterion adopted for piers has been assumed that, on the safe side, presupposes to neglect any possible contribution of an equivalent tensile strength of spandrel generated at the end section by the interlocking effects with the adjacent masonry portions. Such an assumption produces in the BS5/A case an almost negligible flexural strength of spandrel, that in fact has been directly considered null by the RT that used SW7, by modelling the spandrels as axially rigid rod elements, coupling piers only for the horizontal displacements.

For the computation of the strength associated to the shear failure mode of both piers and spandrels, the criterion proposed by Turnšek and Cačovic (1971), aimed to interpret the diagonal shear failure mode, has been assumed with the modification introduced in Turnšek and Sheppard (1980).

In the following sections, the comparison of the results of the non-linear static analyses performed by six different SWs belonging to the EF approach are presented and commented. All of them describe the response of the structural elements through non-linear frame elements with “zero-length” lumped plasticity. For masonry elements, a bi-linear elastic perfectly plastic constitutive law with a limitation of the maximum (ultimate) displacement in terms of drift threshold is assumed. The strength is computed as the minimum between the shear and flexural strength criteria afore described, while, for the drift, the limit values equal to 0.4% and 0.6% have been assumed for the shear and the flexural failure modes, respectively. In particular, the following SWs, available also at professional and commercial level, have been used (see Fig. 2 for a 3D view of corresponding numerical models):

  • 3Muri (2016, release 10.0.1), based on the solver developed by Lagomarsino et al. 2013 and distributed by S.T.A. DATA.

  • Aedes.PCM (2017), based on the hinge formulation proposed in Spacone and Camata (2007) and distributed by Aedes.

  • 2Si (2020) PRO_SAM Program (release 20.7.0), based on the SAM-II solver developed by Magenes et al. 2006 and distributed by 2Si. Actually, in the first years of the project the software ANDILWall (release 3.1.0.0, Manzini et al. 2006) was used that, nowadays no longer distributed, has then been replaced by Pro_SAM.

  • CDSWin OpenSees (2016), distributed by STS.

  • MIDAS Gen (2017), distributed by MIDAS Information Technology Co.

  • SAP 2000 (2016, release 18), distributed by Computers and Structures Inc.

Fig. 2
figure 2

3D views of the numerical models adopted in the research set through the following SWs: a 3Muri; b AEDES; c MIDAS Gen; d ANDILWALL (now 2Si); e CDSWin; f SAP 2000

The results of the SWs are presented in the paper in anonymous way, tagging each software package through a number assigned in a random way in the “URM nonlinear modelling—Benchmark project”. A subset of the adopted SWs is compared in this paper; in particular, they are named as follows: SW1, SW2, SW3, SW5, SW6 and SW7. The choice to adopt an anonymous format is consistent with the overall scope of the project, that was not to express a judgment on the reliability of each specific software package but to provide a critical examination of the achievable results and the obtained differences.

In Sect. 3, in addition to the shared criteria previously discussed on the strength criteria and mechanical parameters, the following common assumptions have been adopted:

  • Idealization in equivalent frame of the walls according to the criterion proposed in Lagomarsino et al. (2013).

  • Full effective wall-to-wall connection.

  • Neglected contribution of the out-of-plane stiffness and strength of piers.

  • Rigid diaphragms.

2.1 Equivalent frame idealization criteria adopted for the URM walls

In the following (from Figs. 3, 4 and 5) the equivalent frame idealization compatible to the application of the most common criteria proposed in the literature and adopted in the professional practice is reported as an example for some of the façades (W6, W8 and W10, as numbered in Fig. 1b). In particular, the investigated criteria are: (a) Lagomarsino et al. (2013), (b) Augenti (2006), (c) Dolce (1991) and (d) Moon et al. (2006). The criteria proposed in Dolce (1991) and Lagomarsino et al. (2013) start from the evidence of the observed damage integrated by numerical studies and comparisons with more accurate finite element simulations. The other two are derived empirically from the observation of experimental results (Moon et al. 2006) or from the past earthquakes damage (Augenti 2006). An important difference to recall is that, according to these two latter criteria, the pier effective height is a function of the direction of the seismic action; therefore, in these cases two different structural models have to be considered, depending on the direction of the performed analysis (positive or negative).

Fig. 3
figure 3

Damage survey and wall equivalent frame idealization of W10: a Lagomarsino et al. (2013); b Augenti (2006); c Dolce (1991); d Moon et al. (2006)

Fig. 4
figure 4

Damage survey and wall equivalent frame idealization of W8: a Lagomarsino et al. (2013); b Augenti (2006); c Dolce (1991); d Moon et al. (2006)

Fig. 5
figure 5

Damage survey and wall equivalent frame idealization of W6: a Lagomarsino et al. (2013); b Augenti (2006); c Dolce (1991); d Moon et al. (2006)

In the following Figures (from Figs. 3, 4 and 5) the pier effective height resulting from the different criteria (marked in red, for the positive direction, and yellow, for the negative direction) is overlapped to the actual damage survey (in black); the dashed lines define the average floor height. The represented façades refer to the actual configuration of the structure. Yet, it is worthy observing that for the purposes of the research activity of the “URM nonlinear modelling—Benchmark project” some simplifications in the considered structural configuration have been made, including that of neglecting the explicit modeling of both the basement floor (in grey in Figs. 3, 4 and 5), which involved only a minor part of the floor plan, and the roof. The ground level conventionally adopted in the modelling of the structure is represented in these Figures through a horizontal black line.

As it clearly results, the main difference between the four criteria is found in the external piers, whereas in almost all the cases, the inner elements are characterized by effective heights that follow the aligned openings; only for the criterion by Dolce (1991) the resulting height for the internal piers is a bit higher. The comparison with the actual damage of these elements shows how the cracks (both in the case of diagonal cracking and of flexural failure) spread typically in a height equal to that of the adjacent openings. In the case of the external piers, the criteria proposed by Moon et al. (2006) and Augenti (2006), which are mostly based on considerations related to the development of an equivalent strut in the considered direction of analysis, seem to alternatively well capture the cracks at the upper or lower end of the elements. The adoption of such criteria requires alternative models for monotonous analysis in X and Y directions, with a significant increase in the computational effort. The criteria proposed by Lagomarsino et al. (2013) and Dolce (1991) appear therefore a reasonable compromise which, however, allow a very good match with the actual damage, considering also the cyclical nature of the seismic action and the simplification intrinsically made by EF models of neglecting the nonlinearity of node regions. Between these two criteria, that of Lagomarsino et al. (2013) finds greater agreement for external piers and this is the reason why the analyses discussed in Sect. 3 adopt this choice in a unified way across the SWs. Moreover, in Sects. 4.3 and 5.2 the effects resulting from the adoption of alternative criteria are discussed in terms of pushover curves and safety verification.

Regarding the spandrels, in the literature the alternative proposals are very limited (Lagomarsino et al. 2013). In the case of regular pattern of the openings, that corresponds also to the configuration of the “P. Capuzi” school, the criterion commonly adopted is to assume the size of the spandrels equal to the masonry portion between the vertically aligned openings. This rule is confirmed by the observation of the damage occurred in the school and is the one adopted in all the analyses discussed in the following sections. Of course, more critical and debated is the case of not aligned openings which some recent literature works are addressed to (e.g. Parisi and Augenti 2013, Berti et al. 2017, Siano et al. 2018) but that is out of the scope of paper and not representative of the BS under examination. Finally, Figs. 3, 4 and 5 also introduce some useful data for checking the reliability of the SWs, at least in a qualitative way, in terms of comparison with the damage pattern (as later discussed in Sect. 3.4).

To make more direct and effective such a comparison:

  • First of all, the damage level (DLE) attained in each panel has been attributed, roughly classified as: DLE ≤ DLE2 corresponding to hairline or slight cracks; DLE2 < DLE ≤ DL E3 corresponding to large and extensive cracks; DLE ≥ DL E4 corresponding to a serios failure, close to the complete loss of sustaining horizontal loads and possibly even the vertical ones.

  • Then, tags consistent with those adopted in Sect. 3.4 to anonymously illustrate the damage pattern simulated by the software have been added over each panel. In particular, the main failure mode activated in the panel has been identified as F-flexural or DC-diagonal cracking. When no visible cracks were observed the tag E-elastic has been assigned; of course, that is a bit conventional, since the full “elastic phase” is purely ideal in a building so severely damaged. Concerning the attribution of the tags “F” and “DC”, it is evident that in some cases a mixed mode occurred, that is characterized by cracks associated to both a partialization of the end sections and diagonal cracks: in those cases, the damage mode has been associated on the basis of the highest gravity of the cracks. This choice – although conventional—was made to make clearer and easier the damage interpretation.

3 Sensitivity of results to different software packages with standardized modelling assumptions

This section describes the results of the analysis carried out on BS5 through the SWs set as much as possible under similar modeling hypotheses, as introduced in Sect. 2.

The following parameters, obtained from the performed analyses, are here compared:

  • The total mass of the building.

  • The periods, participant masses and modal shapes obtained from the modal analysis (Sect. 3.1).

  • The global pushover curves (Sect. 3.2) and the synthetic parameters that univocally define the equivalent bilinear curves (i.e. the stiffness Ks, the base shear Vy and the ultimate displacement du) (Sect. 3.3).

  • The damage pattern (Sect. 3.4). Only for the case BS5/C, the damage corresponding to the ultimate displacement capacity (du) evaluated on the pushover curves has been also compared with the actual one occurred in the “P. Capuzi” school.

The conversion of the pushover curve into a bilinear equivalent curve is particularly useful: firstly, to more effectively quantify the dispersion on results; secondly, because it represents a functional step in order to apply most of nonlinear static procedures adopted in the literature (e.g. the N2 Method originally proposed in Fajfar 2000) and in the Codes [e.g. in EC8-3 (CEN 2005); NTC 2018; ASCE 41–13 (2017)]. The second aim allows thus to make a comparison also on parameters that have a direct impact on the seismic safety assessment.

3.1 Comparison of masses and dynamic parameters estimated by the modal analysis

Table 2 summarizes the total mass estimated by the six SWs and the percentage variation with respect to the reference value obtained from the hand calculation. In the legend of Table 2 the contributions associated to the gravity loads transmitted by the floors, those of the load-bearing walls, those of the r.c. tie beams, etc. are also distinguished in order to more easily identify potential discrepancies between the reference value and the estimate obtained by the SWs, if any. In the Table, the item “attic masonry” refers to the contribution offered by the portions of masonry pertaining to the attic on which the roofing elements lie on; this is consistent with the simplification of modelling the roof just as an equivalent mass. This preliminary comparison allows to avoid gross errors deriving from inconsistent input data insertion: in all cases the percentage variation is lower than 5% (in most cases even significantly lower).

Table 2 Total masses estimated by the SWs and reference value obtained by the hand calculation

In the following, the comparison of the dynamic parameters estimated by the SWs through the execution of the modal analysis is presented. Conventionally, the modal analysis was carried out by adopting the cracked stiffness values (i.e. the same values then adopted in the non-linear static analyses).

In particular, the first three modes are analyzed in terms of periods, participating masses and modal shapes. The comparison is made referring “to the same vibration mode”, that is having selected for each SW the consistent modes through an equivalence criterion based on the comparison of the participating masses. To this aim, for all the SWs the results of up to the first ten vibration modes have been considered, checking that the significant modes for such a comparison (i.e. those characterized by the highest participating mass) were within the first three. This assumption is justified by the fact that the BS is characterized by rigid floors, able to couple the walls in a significant way.

Table 3 summarizes for each SW the modal participating masses in the X and Y directions (as illustrated in Fig. 1) of the selected modes. Instead, Table 4 illustrates the identification of the selected reference modes for both the considered cases (BS5/A and BS5/C); it also reports the reference values Ti,av of the periods obtained for each of the three considered modes, evaluated as the average of the values obtained by the six SWs.

Table 3 Comparison of the participating masses obtained from different software
Table 4 Identification of the three main modes of the structure among those evaluated by the SW based on the comparison of the participating masses

The results of the modal analysis show in most cases a flexural–torsional vibration mode (named as "X–Y"), characterized by percentages of activated participating mass along both the X and the Y directions, and two more translational modes (named as "X" and "Y", respectively). Of course, these definitions have to be considered “conventional” since, due to the in-plan irregularity, “pure” (i.e. in the sense of “ideal”) torsional and translation modes were not detected. Considering all these three modes, the participating mass activated is equal to or greater than 80% in both directions. Moreover, from the Ti,av values in Table 4, it may be observed that the periods of the "Y" and "X–Y" modes are quite close in this structure, while the periods of the two translational modes "X" and "Y" are more distinct.

The two SWs that exhibited the highest differences are SW6 and SW7, as it results from Table 3. However, in the case of SW6, it has to be observed from Table 4 that the type of the first two predicted modes (“X–Y” and “Y”) is reversed with respected to the other SWs. As afore mentioned, the periods of the first two modes are very close one to each other; thus, it appears reasonable that small differences in the distribution of masses and stiffness may justify this reversal. Having that in mind, the differences in the participant masses are not so huge when compared to the other SWs. Conversely, the different behavior obtained by SW7 is much more appreciable. In fact, SW7 exhibits two almost purely flexural modes and a purely torsional third mode. This may be ascribed to the different way adopted in this SW to simulate the flange effect. This issue will be more in depth investigated in Sect. 4.1.

Figure 6 illustrates the percentage variation of the periods calculated by the six SWs with respect to the reference values of BS5/C, together with the modal shape of the three reference modes selected by the SWs according to Table 4. It emerges that, for all the SWs, the differences are lower than 5% and, in most cases, even lower than 2.5%. Moreover, the components of the eigenvectors have been obtained only for some few points of the structure, in order to reconstruct, even if in a simplified way, a plan-view of the modal shapes. As expected in a linear analysis, there are no significant differences in terms of modal shapes (neither in terms of periods) passing from cases BS5/A to BS5/C (being the coupling offered to piers by the spandrels exactly the same and independent from the strength proprieties). For this reason, Fig. 6 reports only the modal shapes with reference to the case BS5/C, assuming the modes listed in Table 4.

Fig. 6
figure 6

Percentage variation from the reference value of modes in X, Y and X − Y and Modal shapes and undeformed configuration (the dashed black line) for the first floor: Case BS5/C

3.2 Comparison in terms of global pushover curves

Nonlinear static analyses were carried out in the two main directions of the structure (X and Y), neglecting the effect of any additional eccentricity and considering both positive and negative directions of the seismic action. In addition, two different load patterns were applied, respectively proportional to the mass distribution (named "uniform" in the following) and to the product of the masses and the height of the structural nodes (named "inverse triangular", and synthetically called “triangular” in the Figures). Although the irregular plan of the building would suggest further interesting investigations on the use of other horizontal load patterns or more refined nonlinear static procedures, able to better account for the higher and torsional modes (e.g. as discussed in Azizi-Bondarabadi et al. 2019 or Aşıkoğlu et al. 2021), these issues were out of the scopes of the research activity, mainly focused on comparing the results provided by EF models when adopted by using the same modelling and analysis method assumptions. Thus, also in performing the nonlinear static analyses and representing the results, the RTs adopted common hypotheses on the load pattern, the displacement plotted in the pushover curves and the choice of the control node (as much as possible close to the centre of masses).

A total of eight different analyses were considered for each case (BS5/A and BS5/C). Figure 7 shows the obtained pushover curves for both the load patterns and, by way of example, for the positive direction of analysis.

Fig. 7
figure 7

Comparison of the global pushovers obtained for Case BS5/A and BS5/C for both directions and load patterns

Passing from case BS5/A to BS5/C, a trend similar to that observed in other benchmark structures (e.g. Manzini et al. 2021 for BS4 and Degli Abbati et al. 2021 for BS6, respectively) can be observed, characterized by an increase of the initial stiffness and of the overall base shear and a reduction of the ultimate displacement capacity.

3.3 Percentage variation of the three parameters defining the equivalent bilinear curves

The pushover curves reported in Sect. 3.2 have been converted into equivalent bilinear curves. Table 5 shows the average and dispersion values conventionally adopted as reference for the comparisons discussed in the following; they refer to the three parameters that describe the bilinear curves (namely Vy, Ks and du as introduced in Sect. 3).

Table 5 Average and dispersion of the three parameters defining the equivalent bilinear curves obtained for both directions and load patterns (U stands for "uniform" and T for "inverse triangular”): cases BS5/A and BS5/C

Figure 8 shows the percentage variation of the results obtained by the SWs with respect to the reference (i.e. “average”) values of Table 5. It can be observed that:

  • Stiffness (Ks): the percentage variation with respect to the reference value is limited to a maximum of 22% and 11%, respectively, for BS5/A and BS5/C.

  • Overall base shear (Vy): the percentage variation is limited to a maximum of 19% and 11% for BS5/A and BS5/C, respectively.

  • Ultimate displacement (du): the percentage variation reaches a maximum of 42% for BS5/A and BS5/C.

Fig. 8
figure 8

Percentage variations of the three parameters that define the bilinear curves for both directions and distributions: cases BS5/A and BS5/C

Considering the obtained results, also compared with what emerged from the results of BS4 in Manzini et al. (2021) and BS6 in Degli Abbati et al. (2021), it can be observed that:

  • The reduction of the percentage variation in the transition from case BS5/A to BS5/C is less appreciable in this structure, much more complex than BS4 (2-storey single unit URM building) and more irregular in the plan configuration than BS6 (complex URM building inspired to the Pizzoli’s town hall, characterized by an elongated rectangular shape).

  • A greater variation of the ultimate displacement, with respect to the other considered parameters, is confirmed.

This latter result is imputable to a lower standardization of the drift calculation criteria adopted by the SWs, despite the fact that in all the SWs the same ultimate drift thresholds at element scale have been adopted (see Sect. 2). In fact, as discussed in Cattari and Magenes (2021) and Cattari et al. (2021a), different approaches are usually adopted for the drift computation in the SWs, such as: the simple ratio between the difference between the horizontal displacements at the end sections and the panel effective height; the chord rotation; its equivalence with the plastic component of the rotation. This is a consequence of the fact that most seismic Codes recommend thresholds for the “drift” to check the attainment of the collapse at element scale without clarifying the criteria to compute it. Since these criteria are autonomously defined by the software package without usually giving the possibility to users to change them, it results in a potentially high scatter of the ultimate displacement capacity on pushover curves.

3.4 Comparison of the damage failure modes predicted by the software packages at the ultimate displacement

The results shown below refer to the analysis step corresponding to the achievement of the ultimate displacement (du), as obtained from the nonlinear static analyses performed with the different SWs considering the “uniform” load pattern, both the X and the Y directions and the positive direction of the lateral forces. The data on the damage (failure mode and severity) has been post-processed for each structural element, according to the general criteria adopted in the “URM nonlinear modelling—Benchmark project” and introduced in Cattari and Magenes (2021). In particular, two types of comparison have been adopted: one able to exhaustively show the damage localization in each element and to interpret the global failure mode activated at the scale of each wall; another addressed to provide in an aggregate way a synthetic overview of the consistency on the simulated damage across the SWs. This second type of damage representation (Figs. 9, 10, 11, 13 and 15) reports, for each element, the number of SWs that predicted the same failure mode; thus, obviously, in the case of perfect agreement among the SWs, the number in the ordinate axis exactly corresponds to that of the software package. In both cases, an anonymous format of comparison has been adopted. For sake of brevity, the attention is mainly focused on the results related to the perimeter walls; moreover, depending on the direction of analysis, only the walls more involved in equilibrating the seismic actions and more affected by the damage (unless significant torsional phenomena) have been selected. The numbering of the walls refers to Fig. 1; the complete numbering of the structural elements is listed in the Annex I made by Cattari and Magenes (2021).

Fig. 9
figure 9

Comparison of the damage predicted by software for the spandrels of Wall 1 at the Ground and First Floor BS5/A and BS5/C: + X analysis

Fig. 10
figure 10

Comparison of the damage predicted by software for the piers of Wall 1 at the Ground Floor BS5/A and BS5/C: + X analysis

Fig. 11
figure 11

Comparison of the damage predicted by software for the spandrels and piers of W3 and W9 at the ground floor BS5/A and BS5/C: + X analysis

In general, the comparisons show a good agreement among the predictions obtained by the different SWs, as well as between the numerical results and the actual response of the building (see also Fig. 3, 4 and 5); obviously the latter consideration only concerns to BS5/C, which is the case more consistent with the actual building configuration.

First of all, the consistency on the damage failure modes predicted by the SWs is discussed.

The considered damage states of the structural elements, reported in the caption of the following Figures, are: E: Elastic; F-p: Flexural-plastic; F–c: Flexural-collapse; DC-p: Diagonal Cracking-plastic; DC-c: Diagonal Cracking-collapse; T: Tension; C–c: Compression-collapse; Mixed-p: Mixed shear and flexural-plastic; Mixed-c: Mixed shear and flexural-collapse.

With reference to the X-direction of analysis, it is observed that:

  • Spandrels. Starting from wall W1 (Fig. 9), almost all of the SWs estimate the flexural plasticization (or collapse) in case BS5/A (“weak spandrel” behavior), whereas, moving to case BS5/C, more differentiated failure modes can be observed, even if the most recurring one is the diagonal cracking shear failure mode (justified by the presence of the coupled r.c. tie beams). This trend has also been found for walls W3, W7 and W9. Figure 12 reports, by way of example, the extended damage pattern representation for wall W8, oriented in Y direction and discussed hereinafter. The passage from a prevailing flexural damage in case BS5/A to the diagonal cracking in case BS5/C is consistent with the strength criteria adopted for the interpretation of the response of the spandrel elements, which rely on the activation of the strut mechanism only in the case of the presence of a coupled tensile resistant element, a condition guaranteed in case BS5/C by the presence of the r.c. tie beams.

  • Piers. Starting again from wall W1 (Fig. 9), almost all of the SWs estimate a prevailing flexural damage in case BS5/A, more localized in the piers at the ground floor (indeed, most SWs predict an elastic response for the piers at the first floor). For some inner piers (i.e. P08 and P09, see Fig. 9 for the elements numbering), in case of BS5/C, the majority of the SWs predict a prevailing diagonal shear cracking, while only two SWs predict a flexural response. This discrepancy can be ascribable to the range of the axial load acting on the panels, which corresponds to the region of the strength domains in which the predictions of two failure modes are very close. Thus, small differences in the variation of the axial load on the elements can lead to differences in the failure mode predicted, as also discussed in detail in Manzini et al. (2021). Apart from this aspect, also in case BS5/C an overall consistency among the SWs in predicting the concentration of the damage at the ground floor can be observed. As regards walls W3 and W9 (Fig. 11), case BS5/A shows more scattered predictions, with a clear tendency, in the transition to BS5/C, to pass to a prevalence of diagonal cracking shear failure of the piers at the ground floor. The fact that the trend in this transition from BS5/A to BS5/C is less marked for wall W1 is justified by the geometry of the piers of this particular wall, which are much slenderer than those of the other ones, and for which (all other factors being equal) a greater propensity to a flexural failure is therefore reasonable.

Fig. 12
figure 12

Comparison of the damage predicted by SW1 for the spandrels and piers of W8: BS5/A and BS5/C, + Y analysis

With reference to the Y-direction of analysis, it is observed that:

  • Spandrels. Starting from walls W6 and W8 (characterized by a more significant number of spandrels and therefore more representative), almost all of the SWs estimate the flexure plasticization (or collapse) for case BS5/A, passing in most cases to the diagonal cracking shear failure mode or to the elastic phase in case BS5/C (Figs. 12, 13 and 14). The general behavior is therefore the same observed in the X direction.

  • Piers. Starting from W6 and W8 (Figs. 12, 13 and 14), in case BS5/A, almost all of the SWs estimate a prevailing flexural response of the elements, localized at the ground floor (most of the SWs predict an elastic response of the piers at the first floor). In case BS5/C, most of the SWs estimate a shear behavior concentrated at the ground floor, predicting for the piers of the first floor a still elastic behavior or a flexural plasticization. The same applies also for W10, as depicted in Fig. 15.

Fig. 13
figure 13

Comparison of damage predicted by software for the spandrels and piers of W6 for the BS5/A and BS5/C: + Y analysis

Fig. 14
figure 14

Wall 8: comparison between the actual and simulated damage for the spandrels and piers (BS5/C: + Y analysis)

Fig. 15
figure 15

Comparison of damage predicted by software for the spandrels and piers of W10 ( BS5/C, + Y analysis)

Finally, in the following some preliminary considerations are discussed on the reliability of the damage predicted by the SWs in case BS5/C against the structural response actually exhibited by the building inspiring the BS (see also Figs. 3, 4 and 5).

It is worth recalling that the school has been closed following the event of August 24, 2016, after which the building had already shown widespread damage in several walls. The structure subsequently suffered considerable and progressive worsening of the damage, that in the second shock of October 26, 2016 also led to the collapse of a portion of the external façade W7 (see Fig. 1). Overall, the damage reached by the building following the October 30 event can be classified as incipient collapse, with extremely limited residual capacity to withstand horizontal actions. Considering the serious damage level suffered by the structure and the intensity of the seismic event (discussed in more detail in Brunelli et al. 2021), it appears reasonable to compare it with the damage predicted at the last step of the pushover analyses.

It is obvious that the analyses performed have not the ambition to accurately simulate the actual seismic response of this structure; thus, the comparison can be made only in qualitative terms. Moreover, it has to be highlighted that the severity of the actual damage in specific elements is also the result of damage accumulation phenomena, due to the complex seismic sequence that affected the area of the school, which the nonlinear monotonic static analyses presented in this document cannot describe. Nevertheless, the comparison is useful to check whether the damage pattern foreseen by the SWs is consistent or not with the one actually occurred; in fact, the overall global failure mode occurred can be considered not altered by the phenomena of damage accumulation.

In general, a good agreement can be observed (see respectively Figs. 4 and 14 for W8, Figs. 3 and 15 for W10 and Figs. 5 and 13 for W6). In fact, as previously highlighted, in case BS5/C the SWs predict for the piers an overall response in general characterized by a more severe concentration of damage at the ground floor, with a prevalence of the diagonal cracking shear damage and with the flexural response limited to some elements at the first floor, whereas for the spandrels a shear response due to diagonal cracking or an elastic condition are predicted.

More precisely, Fig. 14 shows the detailed comparison between the simulated and the actual damage for wall W8 (for the results of SW1 please refer to Fig. 12). The numerical results refer to the analysis carried out in Y direction on the BS5/C configuration. Some pictures of the actual damage occurred in some piers and spandrels (dated to December 8, 2016) are included, too. In agreement with the actual response, it emerges that:

  • The piers of the ground floor are more damaged than those of the first floor (having reached in most cases the collapse condition (C), i.e. the exceeding of the drift limit).

  • The piers of the ground floor are affected by a prevailing diagonal cracking shear failure mode.

  • The over-window spandrels of the ground floor are affected by a prevailing shear response (having in most cases reached only the plasticization condition, therefore a lower level of damage compared to the piers).

  • The under-window spandrels of the first floor are affected by a lower level of damage than those on the ground floor.

In addition, according to the aggregate damage format, Figs. 13 and 15 allow to confirm the good match of results for W6 and W10, respectively; for the actual damage, please refer to Figs. 5 and 3. In particular:

  • Concerning W6, the SWs are almost unanimous in predicting a diagonal cracking failure mode for the internal piers at the ground floor and a prevailing flexural damage mode for all the other piers. In the case of spandrels, the SWs estimate an almost elastic response at the top level, in agreement with the elements not damaged in reality, while they overestimated the damage of the spandrels at the intermediate level.

  • Concerning W10, first of all it is useful highlighting that it is characterized at each floor level by a very squat pier (responsible for balancing most of the external seismic forces) coupled to a very slender one. In most cases (4 over 6) the SWs predicted a diagonal cracking shear failure mode for the squat element, while they are unanimous in estimating a flexural failure mode for the slender one. Moreover, further in agreement with the actual damage, a concentration of the damage at the ground floor is observed.

4 Sensitivity to different modelling assumptions on the global response

4.1 Effectiveness of the wall-to-wall connection

This section aims to highlight the sensitivity of the seismic response evaluated by the EF models to alternative assumptions on the effectiveness of the coupling among incident walls (such as cantonal or T-intersection at the internal walls). When the coupling is perfect, as assumed in the results discussed in Sect. 3, the so-called "flange effect" (in the following synthetically named as FE) is achieved. The FE consists in the possibility of axial loads redistribution between the incident piers and in the stiffness increase of a pier lying in one direction due to the contribution of the connected pier lying in the orthogonal direction. In other words, the wall panels, assumed to have a rectangular section in the wall plane for the computation of the shear strength, can work as a T or L flanged section. As described in Cattari et al. (2021a), the topic has not yet been exhaustively investigated in the literature; therefore, at the present state of the research, there are no universally recognized rules either on the definition of the collaborative width of the orthogonal piers or on the consequent interaction effects (if limited to an alteration of forces redistribution or also to that of gross area to be considered in the computation of shear strength).

The SWs adopted in the research implement different strategies to manage the wall-to-wall connections. As depicted in Fig. 16, the condition of perfect coupling among walls is managed by the SWs by means of: a perfect kinematic coupling between the vertical displacement of the piers (Fig. 16a); equivalent connection beams characterized by very high bending and axial stiffness (Fig. 16b) or rigid links (Fig. 16c). Conversely, the RT that used SW7 managed this assumption through a modification of the cross-section typology of each pier, that is considered "T" or "L" shaped instead of rectangular, taking into account the collaborative contribution of the incident element and appropriately defining the size of the flange (Fig. 16d). More specifically, in the SW7 model, in the case of perfect coupling the length of the flange of the cross-section of each pier element at the intersection between two walls is assumed up to a maximum of half of the length of the orthogonal element.

Fig. 16
figure 16

Solutions adopted in SWs based on equivalent frame models for simulating the wall-to-wall connection: fully kinematic coupling by a degrees of freedom condensation (a) or a kinematic constraints (b); c use of equivalent calibrated beams; d definition of the collaborating flange (from Cattari and Magenes 2021)

The additional parametric analyses carried out in order to simulate different degrees of the effectiveness of the connection of the walls have been performed, by way of example, with three of the SWs adopted in this research (i.e. SW1, SW2 and SW7). To this aim, in cases SW1 and SW2, the default solution adopted by the software packages to model the condition of perfect coupling has been converted in the one depicted in Fig. 16b introducing equivalent beam elements, whose stiffness was suitably calibrated, between the upper nodes of the pier elements constituting the flanged wall.

The results obtained for BS5 and presented in the following cannot be assumed as exhaustive and general in absolutely quantitative terms. In fact, the coupling effect can be more or less significant due to the specific configuration of the walls of the building under examination. For instance, the presence of openings in proximity of the corner or of the internal wall intersection can significantly limit the role of the actual effectiveness of coupling, being limited by “geometrical” factors. In general, the effect is more pronounced in presence of squat panels intersecting. Actually, BS5 offers the occasion to discuss these issues by comparing the different results achieved in the X and in the Y directions, due to a different geometrical configuration of the structural scheme. Finally, it is worth noting that the flange effect and the contribution given by the out-of-plane flexural response of piers are not decoupled. Thus, a complete overview on the issue is provided by considering all the possible alternative on the two modelling hypotheses. In the following, the results of analyses carried out neglecting the contribution of the out-of-plane flexural response of piers, analogously to what assumed for the results discussed in Sect. 3, are presented. Then, additional comments on the combined effect of such aspects are discussed in Sect. 4.2.

4.1.1 Criteria adopted to simulate alternative modelling options on the wall-to-wall connection

The parametric analyses have been carried out considering:

  • Two additional hypotheses on the effectiveness of the wall-to-wall connection, namely: an “intermediate” and an almost negligible (“poor”) degree of effectiveness (please note that the results presented in Sect. 3 refer to the case of full perfect coupling).

  • Two alternative hypotheses on the quality of the connection between the walls oriented along the X and the Y directions: in particular, in one case the same hypothesis on the effectiveness of the wall-to-wall connection has been consistently adopted in the whole model, while in the other the quality of the connection has been altered only in some of the internal walls oriented in the Y direction (see Fig. 18a).

The calibration of the equivalent beams adopted to simulate different degrees of effectiveness of the wall-to-wall connection represents a quite tricky issue, since it would account for the geometry and properties of the incident piers and the masonry type (i.e. dimensions of block and bond type). However, in absence of an analytical formulation univocally recognized in literature, in this research such calibration is carried out reducing progressively of an order of magnitude the value of the moments of inertia J of the connecting beams and assuming such value equal for all the incident piers. The “starting reference value” for the stiffness of the equivalent beams (from which the reduction has been applied) has been calibrated in order to reproduce the same solution obtained in the case of perfect coupling (i.e. that corresponding to the solution obtained by the modelling option represented in Fig. 16a–b).

Table 6 summarizes the values assumed in the three SWs adopted to perform these parametric analyses varying the hypothesis on the quality of the connection. In the case of the “poor” connection it has been verified that a further reduction of the stiffness doesn’t change the results (i.e. the solution obtained actually correspond to the lower bound).

Table 6 Hypothesis assumed in the examples aimed to simulate the different degrees of connection

4.1.2 Results in terms of effects on the pushover curves

The following figures (Figs. 17 and 18) illustrate the results obtained with the three SWs used for the analyses in the limit conditions of perfect (continuous line) and poor (dashed line) coupling quality. The results refer to both the configurations, BS5/A (with “weak spandrels”) and BS5/C (with r.c. tie beams), when the same hypothesis is extended to the whole building. It is worth recalling that in the case of BS5/A the spandrels in SW7 have been directly modelled through axially rigid rods, without imposing any control on the ultimate drift. The results show a not-negligible sensitivity on all parameters characterizing the pushover curve: initial stiffness, yielding base shear and ultimate displacement capacity.

Fig. 17
figure 17

Sensitivity of the pushover curve to the effectiveness of the wall-to-wall connection among incident walls in the BS5/A and BS5/ C (same hypothesis adopted on the whole building)

Fig. 18
figure 18

a Identification of the piers oriented in Y direction for which the quality coupling among walls has been altered; b Sensitivity of the pushover curve to the effectiveness of the wall-to-wall connection among incident walls in case BS5/C—the coupling is altered only for piers marked in red in Fig. 18a

In the case of BS5/C, the differences in the response of the models, passing from the perfect to the poor connection, are also accompanied by changes, in some masonry panels, of the prevailing damage mode activated (in particular, from shear to flexural response); this aspect, evident from the different obtained pushover curves, is justified by the variation of the normal force distribution in the panels due to the different degree of coupling. The effects are more pronounced in the Y direction, although appreciable also in the X one; this is due to a different geometrical configuration of the piers in the two directions, as already discussed in Sect. 4.1.1.

The results show how the degree of effective connection between the incident walls represents an important epistemic uncertainty to be analyzed, in the knowledge phase of the structure, not only in relation to the vulnerability of the structure to the activation of possible local mechanisms but also for a more reliable evaluation of the in-plane global response. The sensitivity analysis adopted to calibrate the equivalent beams, which can be monitored through the variations of the results on the pushover curves and on the dynamic properties estimated by the modal analysis, is therefore effective to define a plausible range of variation of stiffness to be assigned to the beams and can be replicated for all structures under examination also to address the relevance of this epistemic uncertainty (and, as a consequence, also the plan of investigation techniques to be applied in the knowledge phase).

As an example, Fig. 18b illustrates the results obtained in the case in which the degree of coupling is altered (reduced) only in some of the internal piers oriented in Y the direction (as identified in Fig. 18a).

4.2 Contribution of the out-of-plane capacity of piers

The objective of this section is to study the contribution offered by the out-of-plane behavior of piers (OP in the following). The results reported below have been obtained using four SWs among those adopted (SW2, SW3, SW5 and SW6) that allow to consider in the analysis the flexural out-of-plane contribution of the panels both in terms of stiffness and strength. It is important to specify that the out-of-plane contribution still refers to the repercussion on the “global” in-plane response and should not be confused with the possible activation of “local” mechanisms.

4.2.1 Criteria adopted to simulate alternative modelling options on the out-of-plane piers contribution

In order to investigate the potential incidence on the overall base shear offered by the out-of-plane contribution of piers, the flexural strength domains associated to both the in-plane and the out-of-plane response of a masonry pier characterized by 2.50 m length, 0.40 m thickness and 2.50 m height are reported in Fig. 19a; in both cases, the calculation has been made by adopting the compressive strength of masonry reported in Table 1 for the cut stone.

Fig. 19
figure 19

a In-plane and out-of-plane flexural strength domains (assuming for the pier a thickness equal to 0.40 m); b Out-of-plane strength domain of the pier varying the thickness t, the values corresponding to a wall of 0.40 m has a thicker line

Analogously to the in-plane flexural response, the bending out-of-plane contribution is computed according to the following expression:

$${M}_{pl}={t}^{2}l\frac{{\sigma }_{0}}{2}\left(1-\frac{{\sigma }_{0}}{\kappa {f}_{m}}\right)$$
(1)

where σ0 is the mean vertical compressive stress acting on the full section and, under the hypothesis of an equivalent rectangular stress block of normal stresses of height kfm, κ is the stress-block equivalence coefficient, assumed equal to 0.85. Figure 19b illustrates the strength domains of the pier varying the thickness t.

As far the possible interaction domain due to the bi-axial bending, most of software packages used (i.e. three of the four) consider in a simplified way the two domains as independent; only one software introduces a simplified interaction domain.

As it is obvious from Eq. (1), increasing the thickness the strength grows more than proportionally, being the bending moment proportional to the square of the thickness. However, it can be considered that, at least in traditional buildings, for wall thickness lower than 0.40 m (whose corresponding domain is represented with the thickest line in Fig. 19), the incidence of the out-of-plane contribution is not particularly significant and neglecting it is anyhow in favor of safety, whereas, for thickness greater than 0.40 m, this contribution becomes progressively more significant and neglecting it could lead to appreciable underestimations of the overall base shear of the building.

In the following section, the quantification of such a contribution on the pushover curves obtained for BS5 is illustrated; it is of interest recalling that in BS5 structural walls have thickness ranging from 0.53 m (longitudinal walls of the first floor) up to 0.70 cm (transversal walls of the ground floor) (see also Fig. 1).

4.2.2 Results in terms of effects on the pushover curves

Figure 20 illustrates the pushover curves obtained by the analyses in which also the out-of-plane contribution of piers have been accounted for; the results also refer to the hypothesis of perfect wall-to-wall connection.

Fig. 20
figure 20

Pushover curves resulting from the analyses in which the out-of-plane contribution is accounted for

In order to make more evident the effect of such a contribution, for two of the SWs, Fig. 21 directly compares the pushover curves obtained considering and neglecting the out-of-plane contribution (continuous and dashed lines, respectively). It is possible to observe an increase in the maximum strength and in the initial stiffness (although quite limited), as well as in the ultimate displacement capacity.

Fig. 21
figure 21

Comparison of the capacity curves obtained with SW 2 and SW5 with (w OP) and without (w/o OP) the flexural out-of-plane contribution

As introduced in Sect. 4.1, the flange (FE) and the out-of-plane (OP) effects are not completely decoupled, since both produce a variation in the acting axial load in the piers (altering the redistribution phenomena of the generalized forces). Thus, in order to understand such an interaction, the results associated to all the alternative combinations of possible hypotheses on these two modelling assumptions (namely: “w OP” or “w/o OP” and “w FE” or “w/o FE”, i.e. perfect or poor wall-to-wall connection) are reported in Fig. 22. As an example, the analyses were carried out only with SW2. Generally, the transition from "perfect" to "poor" wall-to-wall connection induces a reduction in the stiffness and overall base shear strength of the structure. Furthermore, it may be noted that, in the case of poor connection among the walls, a significant increase in the ultimate displacement capacity of the structure is observed.

Fig. 22
figure 22

Comparison of the pushover curves obtained with SW2 considering different combinations of the out-of-plane contribution (OP) and the flange effect (FE)

It is worthy highlighting that in the general purpose software packages, where equivalent coupling beams with stiffness much greater than that of other structural elements have to be used to simulate the coupling effects, the execution of the pushover analyses requires particular attention and a  proper refinement in convergence other than additional calibration of the beams to correctly reproduce realistic failure mechanism and stable pushover curves.

4.3 Sensitivity to the adoption of alternative equivalent frame idealization criteria for URM walls

This section presents the results of some further investigations conducted with SW1 in order to evaluate the influence on the assessment of the seismic response of different possible assumptions for the pier effective height heff. To this aim, the possible alternative criteria already discussed in Sect. 2.1 have been adopted. Non-linear static analyses have been performed both in the positive and in the negative X and Y directions, assuming both the “uniform” and the “inverse triangular” load patterns. Figure 23 shows the comparison of the obtained results in terms of global pushover curves. As it can be seen, the different adopted hypotheses produce appreciable differences, in particular in terms of displacement capacity.

Fig. 23
figure 23

Global pushover curves corresponding to the different adopted criteria for the EF idealization

In order to quantify the dispersion associated to the obtained results, as already presented in Sect. 3.3, the percentage variation of the three parameters defining the equivalent bilinear curves has been computed. In particular:

  • In Fig. 24 the percentage variation is computed assuming as reference the results obtained with the selected software package when the criterion of Lagomarsino et al. (2013) is adopted. This result quantifies the potential dispersion, being the same SW adopted for the analyses.

  • In Fig. 25 the percentage variation is computed assuming as reference the average values resulting from all the six adopted SWs, as computed in Sect. 3.3 and reported in Table 5. In this case, the obtained scatter is affected not only by the uncertainty due to the criterion adopted for the definition of the geometrical dimensions of the structural elements of the EF model, but also by the intrinsic model uncertainty related to the choice of the software to use. This means, in other words, that the final dispersion is affected by the initial scatter characterizing the adopted software with respect to the “reference solution” (the one already highlighted in Sect. 3.3).

Fig. 24
figure 24

Scatter with respect to solution of Lagomarsino et al. (2013) of the SRPs associated to the equivalent bi-linear curves (Ks, Vy and du): positive and negative direction of analysis

Fig. 25
figure 25

Scatter with respect to the “benchmark solution” of the SRPs associated to the equivalent bi-linear curves (Ks, Vy and du): positive and negative direction of analysis

By looking at Figs. 24 and 25, it can be observed that the criterion proposed by Dolce (1991) in general lead to ultimate displacement capacities higher than the other ones, since it produces more slender piers (i.e. piers characterized by higher effective heights, see Figs. 3, 4 and 5) particularly subjected to a prevailing flexural response (which higher drift thresholds also correspond to). On the other hand, the four criteria analyzed produce very similar responses in terms of overall base shear and stiffness, for both load patterns considered.

Further evidence on the potential influence of the adoption of alternative criteria for the EF idealization of walls are discussed in Manzini et al. (2021) for BS4 (2-storey single unit URM building).

5 Impact of the modelling uncertainties on the safety verification

5.1 Effect due to the software-to-software variability

The impacts on the safety verification of the dispersion of results analyzed in the previous sections are discussed in the following. To this aim, the comparison is herein made in terms of values of the maximum peak ground acceleration (PGAPL) compatible with different performance levels (PL). In particular two PLs are considered, corresponding to the yield point of the equivalent bilinear curve (PGAVy) and to the ultimate displacement of pushover curves (PGAdu).

As an example, the results are reported with reference to case BS5/C and to the analyses carried out adopting the “uniform” load pattern.

The N2 method (Fajfar 2000) has been adopted for the evaluation of the PGA. According to this method, the following differences among the results obtained through the SWs play a role in the final calculation of the PGASL:

  • The values of the three parameters describing the equivalent bi-linear curve (Fy, Ks and du).

  • The conversion factors (namely the participation factor Γ and participating mass m*) addressed to convert the pushover curve representative of the MDOF into the equivalent SDOF system. In particular, these factors allow to convert the overall base shear and the stiffness into the yield acceleration (Ay = Fy/Γm*) and the equivalent T* period, respectively.

According to the N2 method, the final value of PGA is also affected by the assumed value for Tc (i.e. the period that in the acceleration response spectrum separates the region at constant acceleration from that at constant velocity) and its relationship with T*.

In particular, following data were used to calculate the spectral shape: soil factor S = 1.52; corner period TC = 0.714; amplification factor F0 = 2.363. These values are consistent with the seismic hazard of the Visso municipality, according to NTC (2018), for a return period of 475 years and the assumption of soil class D.

The following figures show the comparison of the values of the above-mentioned parameters obtained by the SWs. In particular, Fig. 25 reports the values of T*: since the T*/TC ratio is lower than 1 for all cases, the calculation of the expected seismic demand is made with reference to the region of maximum amplification of the response spectrum. Moreover, the value of Γ is in most cases invariant with the load pattern (as shown in the product with m* in Fig. 26, with reference in particular to the value of MX*). This is consistent with the assumption that the modal participation factor is calculated by most of the SWs referring to the eigenvector components of the first mode, regardless of the forces applied in the non-linear static analysis. Actually, in most of the commercial SWs used, the first mode is approximated by the deformed shape resulting from the application of the “triangular” load pattern on a linear elastic model of the structure. Few SWs allow to choose between different calculation methods for Γ. Conversely, in the case of SW3 and SW5, in the case of “uniform” load pattern the value of Γ is assumed unitary as default (without any alternative choice by the user).

Fig. 26
figure 26

T*, ΓM*, q* values for different programs for both directions and load pattern

Figure 27a shows the resulting values of PGA, while Fig. 27b illustrates the percentage variations with respect to the average value computed by considering the estimates provided by all the SWs. As it may be observed the variation results:

  • In the case of PGAVy: up to a maximum of 22% and on average 9%.

  • In the case of PGAdu: up to a maximum of 26% and on average 10%.

Fig. 27
figure 27

PGA (a) and the scatter with respect to the average value (b) for the positive direction of analysis

The maximum values of these percentage variations occur in isolated cases, which typically refer to SW6 (in particular, for the PGAdu resulting from analysis in the Y direction), SW5 and SW7 (in particular, for the PGAVy always in the Y direction). The combined comparison of Fig. 27 with Fig. 8, reporting the percentage variations of the three parameters that define the equivalent bilinear curves, allows to verify that these latter results can be justified because of the greater differences found, in the case of SW6, in the ultimate displacement in the Y direction and, in the case of SW5 and SW7, in the overall base shear Vy and stiffness Ks, in the Y direction, with respect to the other SWs.

5.2 Effect due to other alternative modelling options or modelling uncertainties

The computation of PGAdu has been repeated for all the cases examined in Sect. 4 considering different criteria for the EF idealization (EF-I) of the masonry walls, the out-of-plane contribution of piers (OP) and the effectiveness of the wall-to-wall connection (FE). The obtained results are summarized in Table 7, where the percentage variations of PGAdu are always computed with respect to the “average solution” reported in Sect. 5.1 referring to results obtained in Sect. 3. Considering the different modelling uncertainties, for SW1 the different criteria for the EF idealization brings a greater variation of PGAdu than the wall-to-wall connection. In the case of SW2, the out-of-plane contribution and the wall-to-wall connection led to very similar variations. In general, as expected, to consider the out-of-plane contribution causes greater values of PGA, particularly for SW5. Figure 28 also summarizes the corresponding PGAdu values and shows that a greater variation among the different criteria for the EF idealization results for PGAdu than for PGAVy, highlighting how the different idealization affects especially the ultimate displacement.

Table 7 Summary of the different modeling criteria adopted
Fig. 28
figure 28

PGAdu values obtained for the conditions examined: a low wall-to-wall connection; b contribution of the out-of-plane of the piers; c EF idealization (SW1)

6 Conclusions

The paper presents the results obtained within the research activity carried out by several research teams involved in the “URM nonlinear modelling—Benchmark project” on the benchmark structure BS5, inspired by the “P. Capuzi” school in Visso (MC, Italy).

The benchmark structure has been analyzed by exploring the influence of different modelling assumptions, aimed to reflect those most commonly adopted by analysts at both research and professional levels. Nonlinear static analyses have been performed by SWs, also available at commercial level. Although not exhaustive, the considered set of SWs reflects the tools available to professionals in Italy nowadays; moreover, many of the selected SWs are used also at international level. In that way, it is expected that the quantification of the dispersion on achievable results discussed in the paper will constitute a useful reference for the scientific community and professional engineers as well.

The comparison of the obtained results covers a large set of parameters related to: dynamic properties of the buildings; pushover curves (also described by three synthetic parameters when passing to their equivalent bilinear curves); damage pattern; indicators useful for the safety verification aims.

With respect to other comparative studies available in the literature (as examined in detail in Cattari and Magenes 2021 and mentioned in the introduction), the results confirm that the dispersion achievable when different software packages are used is not completely negligible, as already shown by the analysis of other benchmark structures (like as in Manzini et al. 2021; Degli Abbati et al. 2021). Moreover, the configuration associated to “weak-spandrels” tends to produce higher dispersion values (at least in the initial stiffness and overall base shear) than that in which spandrels are coupled to other tensile resistant elements. However, on the other hand, the dispersion is contained within acceptable values if the consistency on the modelling assumptions across the EF models is carefully checked and guaranteed.