1 Introduction

For the design of retaining walls (e.g. sheet pile, bored pile or diaphragm walls), gravity dams, cantilever walls or bridge abutments determination of earth pressures is a fundamental task. In contrast to the active earth pressure acting as driving force, the passive earth pressure contributes in general to the resisting forces in the system. As over prediction of the passive earth pressure may lead to an unsafe geotechnical design, estimation of the passive earth pressure is an important task for practical engineers. Furthermore, since earth pressure coefficients are based on different theories and assumptions, it is highly recommended for practitioners to be familiar with the fundamental theories used to derive earth pressure coefficients.

In general, the passive earth pressure force \(E_{\mathrm {ph}}\) is calculated based on three terms which are related to soil weight \(\gamma\), effective cohesion \(c^\prime\) and surcharge q. However, for a purely frictional material and no surcharge applied to the backfill, determination of \(E_{\mathrm {ph}}\) can be reduced to Eq. 1, with the height of the wall h and the passive earth pressure coefficient \(K_{\mathrm {ph}}\).

$$\begin{aligned} E_{\mathrm {ph}} = 0.5 \cdot \gamma \cdot h^2 \cdot K_{\mathrm {ph}} \quad \text {with} \quad c^\prime = q = 0\,{\mathrm {kPa}} \end{aligned}$$
(1)

The first theory to determine earth pressures was developed by Coulomb [8] using a translational wedge element to describe the active and passive zones. From the results earth pressure coefficients have been derived for variable soil and wall friction angles (\(\delta\)) as well as different inclinations of the soil-wall contact surface (\(\alpha\)) and slopes of the backfill (\(\beta\)). Further milestones in estimation of earth pressures were achieved by Rankine [18], Caquot and Kérisel [3] and Sokolovski [22]. Since then, many contributions for a more realistic determination of earth pressure coefficients have been published for static and/or seismic conditions [4, 5, 9, 2325]. Recently, Krabbenhoft [11] applied finite-element limit analysis (FELA) to derive earth pressure coefficients as mean value of rigorous upper and lower bound solutions. Krabbenhoft [11] reported that a maximum difference of less than 0.5% between upper and lower bound solutions was obtained, indicating an almost exact solution.

Although the determination of earth pressure coefficients using advanced methods and complex algorithms has become very accurate, in many studies the influence of the flow rule is not discussed sufficiently. In other words, the effect of a non-associated flow rule with a dilation angle \(\psi ^\prime\) smaller than the effective friction angle \(\varphi ^\prime\) on the limit load is not taken into account, despite the fact that soils do not obey an associated flow rule. Depending on the degree of non-associativity (\(\varLambda = \varphi ^\prime - \psi ^\prime\)) this may result in significantly smaller \(K_{\mathrm {ph}}\) values. Thus, assuming associated plasticity could yield results on the unsafe side. Particularly for large \(\varLambda\) values this effect is accompanied by numerical instabilities as well as non-unique failure mechanisms [12, 14].

Due to the fact that in some circumstances the obtained failure load (or factor of safety) is significantly over estimated following an associated flow rule, Davis [6] introduced a reduction factor \(\beta\) to determine reduced shear parameters \(c^*\) and \(\varphi ^*\) which should account for the non-associativity of the material. Applying the reduced shear parameters, as given in Eqs. 24, in combination with an associated flow rule should serve as an approximation of the response (e.g. factor of safety in slope stability problem) of a non-associated material.

$$\begin{aligned}&c^* = \beta c^\prime \end{aligned}$$
(2)
$$\begin{aligned}&\tan \varphi ^* = \beta \tan \varphi ^\prime \end{aligned}$$
(3)
$$\begin{aligned}&\beta = \frac{\cos \psi ^\prime \cos \varphi ^\prime }{1 - \sin \psi ^\prime \sin \varphi ^\prime } \end{aligned}$$
(4)

To evaluate the influence of the flow rule for slope stability problems Tschuchnigg et al. [27] compared factors of safety (FoS) for different slopes using a frictional and a cohesive-frictional material following both an associated and a non-associated flow rule. In addition, calculations with an associated flow rule using reduced shear strength parameters according to Davis [6] approach were performed to analyze whether good agreement with the FoS using the non-associated material can be achieved. The comparison revealed that the Davis approach provides a conservative estimate to the FoS of an non-associated material, whereas an associated flow rule yields an over estimation of the FoS. Analyzing the differences between these three solutions, it was found that in many cases the gap between associated and non-associated flow rule was significantly larger than the gap between non-associated flow rule and Davis approach, putting emphasis on the use of the Davis approach.

However, as Tschuchnigg et al. [27] only investigated the influence of the flow rule for the slope stability problem the question arises to what extent the flow rule influences, e.g. the passive earth pressure problem. Most importantly, \(K_{\mathrm {ph}}\) values have to be evaluated for different combinations of \(\varphi ^\prime\), \(\psi ^\prime\) and \(\delta\) to conclude whether (1) following an associated flow rule leads to significant over estimation and/or (2) applying the Davis approach yields approximations, which are too conservative for the use in design.

Therefore, the objective of this study is to analyze the influence of the flow rule on the passive earth pressure coefficient \(K_{\mathrm {ph}}\) for different combinations of \(\varphi ^\prime\), \(\psi ^\prime\) and \(\delta\), the failure mechanism and the robustness of the numerical calculation for frictional materials. For this purpose, passive earth pressure coefficients derived from displacement finite-element analysis (FEA) using Plaxis 2D [2] will be compared to finite-element limit analysis (FELA) performed with OptumG2 [16] and selected data from literature.

2 Methods

2.1 Displacement finite-element analysis (FEA)

Within the last 20–30 years displacement finite-element analysis (FEA) has become very popular in geotechnical engineering. Due to its flexibility of modeling any geometrical problem, implementation of interface elements to approximate soil-structure interaction and advanced algorithms that enable fast calculations, FEA can be applied to a wide range of geotechnical problems. Combined with advanced constitutive models which enable to take into account hardening/softening, anisotropy, creep, non-associativity, barotropy, pyknotropy and other effects, the soil behavior can be approximated accurately. In this study displacement finite-element analysis is applied using the code Plaxis 2D [2].

2.2 Finite-element limit analysis (FELA)

Finite-element limit analysis (FELA) is based on the upper bound and lower bound theorems of plasticity introduced by Drucker et al. [7]. Finite-element lower-bound analysis was first applied by Lysmer [13] for plane-strain conditions. Bottero et al. [1] were among the first to apply finite-element upper-bound analysis for geotechnical problems considering plane-strain conditions. Since then many contributions helped to continuously improve both methods. For more details of the historical development as well as the theoretical background of both finite-element lower- and upper-bound analysis the reader is referred to Sloan [21]. In general, in FELA it is assumed that the material is rigid-perfectly plastic and obeys an associated flow rule. Furthermore, it only applies for small deformations. Using FELA in combination with the correct element types [21], rigorous upper and lower bound solutions can be obtained where the true collapse load is bracketed from above and below. In this study, finite-element limit analysis is applied using the code OptumG2 [16].

2.3 Sokolovski method

Lateral earth pressure coefficients according Sokolovski [22] are determined following the Rankine [18] method using the method of characteristics. Since a detailed explanation of this method can be found in [22], only a brief description is given in this section. Based on the static method for determining earth pressure, two differential equations [10] are solved for every infinitesimal element within the plastic zone. The soil mass within the plastic zone is assumed to be at failure and, thus, follows the Mohr–Coulomb failure criterion. Furthermore, plane-strain conditions are assumed. For a cohesionless soil the shear strength is governed by the effective friction angle which is fully mobilized within the plastic zone. Moreover, it should be mentioned that in contrast to limit equilibrium approaches, the method of characteristics does not require an assumption of the shape of the failure mechanism. However, Davis [6] noted that for solutions obtained using the method of characteristics the kinematic admissibility needs to be investigated additionally in order to examine whether all deformation boundary conditions of the specific problem are satisfied.

3 Passive earth pressure problem

3.1 Problem description and spatial discretizations adopted

To analyze the passive earth pressure problem, a numerical model is created, which is has the same dimensions and boundary conditions for FEA and FELA. Geometry and dimension are shown in Fig. 1a. The mechanical boundary conditions of the model are as follows: at the left and right boundaries deformations are restricted in normal direction, whereas at the bottom deformations are restricted in both normal and tangential direction. Deformations of the rigid block, which is attached at the top left part of the model, are restricted in vertical direction. No mechanical fixity is applied to the soil top surface of the model. The soil is assumed to be homogeneous and effects due to ground water are not considered. To simulate the passive earth pressure problem, the rigid block is pushed into the soil by applying either a force or displacement at the left vertical edge of the block. As vertical displacements of the rigid block are prohibited the block is translated in horizontal direction only.

Fig. 1
figure 1

a Geometry and dimensions of the model and discretization of the numerical simulation in (b) Plaxis and (c) Optum after five adaptive mesh refinement steps

In displacement finite-element analysis (FEA) using Plaxis 2D the domain has been discretized using 15-node triangular elements with a shape function of 4th order. The spatial discretization adopted in FEA is presented in Fig. 1b. It can be seen from this figure that the overall element size in Plaxis 2D is small with further refinement of the elements in the area of the expected failure mechanism (2 h × 4 h) and next to the interface elements between the rigid block and soil. This discretization has been found to be appropriate after performing a mesh study with different mesh element sizes.

To obtain rigorous lower and upper bound results with finite-element limit analysis 3- and 6-node triangular elements have been chosen, respectively. Due to the adaptive mesh refinement, the critical failure mechanism can be obtained with less elements and with less computational costs as has been shown, for instance by Oberhollenzer et al. [15] and Schmüdderich et al. [20] for the slope stability and bearing capacity problem, respectively. In FELA, the mesh has been refined in five adaptive steps using the shear dissipation as decisive parameter leading to a rather heterogeneous discretization with coarse elements towards the bottom and the right edge of the model and very fine elements close to the failure mechanism (Fig. 1c). In general, adaptive mesh refinement can also be implemented for displacement finite-element analysis in order to enable determination of precise results in terms of the approximation of the failure mechanism and the corresponding earth pressure force.

3.2 Material parameters

To analyze the earth pressure problem a linear elastic-perfectly plastic material model using a Mohr-Coulomb (MC) failure criterion is applied. Apart from the soil weight \(\gamma\), the basic stiffness input parameters of the model are Young’s modulus E and Poisson’s ratio \(\nu\). The strength of the soil is defined with the effective cohesion \(c^\prime\), the effective friction angle \(\varphi ^\prime\) and the dilation angle \(\psi ^\prime\). In this study, soil weight, Young’s modulus, Poisson’s ratio and effective cohesion are assumed to be constant (\(\gamma = 16\,{\mathrm {kN/m}}^3\), \(E = 30\,{\mathrm {MPa}}\), \(\nu = 0.3\) and \(c^\prime =0\,{\mathrm {kN/m}}^2\)), while soil friction angle, dilation angle and soil-wall contact, expressed in terms of the interface friction angle \(\delta\) and modeled with an individual set of parameters, are varied. The importance of the flow rule (associated, non-associated) is investigated for the passive earth pressure problem for different soil friction angles \(\varphi ^\prime\) and wall friction angles \(\delta\). As reported among others by [26] for the slope stability problem, it should be noted that the degree of non-associativity \(\varLambda\), defined as the difference between friction angle and dilation angle (\(\varLambda = \varphi ^\prime - \psi ^\prime\)) is an important parameter which needs to be considered in the later evaluation. As simulations with the Davis approach are conducted, reduced shear strength parameters \(\varphi ^*\) and \(c^*\) are derived based on Eqs. 24.

4 Results and discussion

In this section, the results of the study are presented and general trends for different combinations of the friction angle \(\varphi ^\prime\), the dilation angle \(\psi ^\prime\) and the wall friction ratio \(\delta /\varphi ^\prime\) are pointed out. Evaluation and discussion of the results are conducted in terms of passive earth pressure coefficients, failure mechanisms and performance of the numerical simulation within three subsequent steps. These steps account for (1) analyzing results obtained with an associated flow rule and (2) with a non-associated flow rule as well as (3) comparing the results presented in (1) and (2) with the estimation of \(K_{\mathrm {ph}}\) values obtained following the Davis [6] approach. For an easier distinction of the different calculations performed, it should be noted that letters A, NA and D refer to calculations based on an associated flow rule (A), non-associated flow rule (NA) and Davis approach (D), respectively.

4.1 Simulations with an associated flow rule

Results obtained using FEA, method of stress characteristics (following Sokolovski [22]) as well as lower (LB) and upper bound (UB) FELA are presented in Table 1 in terms of the passive earth pressure coefficient \(K_{\mathrm {ph}}\) for friction angles between \(\varphi ^\prime =20^\circ\) and \(\varphi ^\prime =45^\circ\) assuming an associated flow rule (\(\psi ^\prime =\varphi ^\prime\)) and a wall friction ratio of \(\delta /\varphi ^\prime =0.67\). From results presented in this table it can be seen that, in general, there is a good agreement between all approaches. However, a more detailed analysis reveals that FELA provides smaller \(K_{\mathrm {ph}}\) values than FEA and even the UB solution is slightly smaller than FEA. An explanation for this observation can be given with respect to the adaptive mesh refinement which allows for more accurate approximation of the failure mechanism in FELA. Furthermore, a mesh fan with a fine subdivision of elements is utilized in FELA, which enables easier rotation of the failure surface at the bottom of the soil-wall contact.

Table 1 Comparison of passive earth pressure coefficient \(K_{\mathrm {ph}}\) obtained from FEA, method of stress characteristics and lower (LB) and upper bound (UB) FELA for friction angles between \(\varphi ^\prime =20^\circ\) and \(\varphi ^\prime =45^\circ\), \(\psi ^\prime /\varphi ^\prime =1.0\) and \(\delta /\varphi ^\prime =0.67\)

Comparing the method of stress characteristics with the LB solution obtained with FELA, it is apparent that the Sokolovski [22] solution yields smaller \(K_{\mathrm {ph}}\) values at small effective friction angles (\(\varphi ^\prime \le 25^\circ\)) but larger \(K_{\mathrm {ph}}\) values at increasing effective friction angles, except for \(\varphi ^\prime =45^\circ\), for which significantly smaller \(K_{\mathrm {ph}}\) values have been obtained with the first method. Although there is no clear trend to be discussed based on these observations, a possible explanation can be that the design equations [17] utilized to obtain \(K_{\mathrm {ph}}\) values in accordance with the Sokolovski [22] solution are less accurate for very large friction angles. However, the reader should keep in mind that the method of stress characteristics and the FELA yield \(K_{\mathrm {ph}}\) which compare well with the FEA solution assuming an associated flow rule.

Fig. 2
figure 2

Comparison of numerical methods with respect to the failure mechanism in terms of a the incremental deviatoric strains obtained from FEA simulations and the b shear dissipation obtained from FELA simulations for \(\varphi ^\prime =30^\circ\) and \(\delta /\varphi ^\prime =0.67\) considering an associated flow rule

In addition to passive earth pressure coefficients, failure mechanisms obtained from both numerical methods are compared. As shown in Fig. 2, failure mechanisms obtained from (a) FEA (Plaxis 2D) and (b) FELA (OptumG2) are highly comparable in terms of the length (\(L_{x,A} \approx 2.32\) h) of the failure surface as well as the angle (\(\nu _{1,A} = 45^\circ - \varphi ^\prime /2= 45^\circ - \psi ^\prime /2= 30^\circ\)) at which the failure mechanism intersects the ground surface. Based on the performed studies it can also be concluded that an associated flow rule yields a unique failure mechanism which is (almost) independent of the numerical method applied. However, it should be noted that this statement is only valid if the discretization utilized is appropriate. Comparing the size of the failure mechanism with the dimensions of the numerical model, it is obvious that the model dimensions have been chosen large enough in order to avoid boundary effects. This observation also holds for larger friction angles.

4.2 Simulations with a non-associated flow rule

In order to investigate the significance of the flow rule for the passive earth pressure problem, FEA simulations have been performed for effective friction angles between \(\varphi ^\prime =20^\circ\) and \(\varphi ^\prime =45^\circ\) and ratios of non-associativity in the range of \(\psi ^\prime /\varphi ^\prime = 0.00\), 0.25, 0.50 and 0.75 assuming a constant wall friction ratio of \(\delta /\varphi^\prime =0.67\). For all simulations, the ratio of non-associativity, which is utilized in the soil domain, is also applied to the soil-wall contact (interface). The results are presented in terms of load-displacement curves expressed as \(u_x/h\) (x-axis) versus \(K_{\mathrm {ph}}\) (y-axis) for \(\varphi ^\prime =20^\circ - 45^\circ\) in Fig. 3a–f, respectively, where \(u_x\) is the horizontal displacement of the rigid block. However, it should be noted that the solid line in Fig. 3f has been obtained for \(\psi ^\prime /\varphi ^\prime =0.05\) as FEA simulations with \(\psi ^\prime /\varphi ^\prime =0.00\) led to highly erratic results and terminated before sufficient displacements could be applied. Since only a small reduction in \(K_{\mathrm {ph}}\) is expected by decreasing from \(\psi ^\prime /\varphi ^\prime =0.05\) down to \(\psi ^\prime /\varphi ^\prime =0.00\), the results presented in this figure will be considered as the benchmark for \(\varphi ^\prime =45^\circ\) and \(\psi ^\prime /\varphi ^\prime =0.00\).

Fig. 3
figure 3

Influence of degree of non-associativity on passive earth pressure coefficient \(K_{\mathrm {ph}}\) for a \(\varphi ^\prime =20^\circ\), b \(\varphi ^\prime =25^\circ\), c \(\varphi ^\prime =30^\circ\), d \(\varphi ^\prime =35^\circ\), e \(\varphi ^\prime =40^\circ\) and f \(\varphi ^\prime =45^\circ\) considering a constant wall friction ratio of \(\delta /\varphi ^\prime = 0.67\)

It is apparent from this figure that the \(K_{\mathrm {ph}}\) value is decreasing with increasing ratio of non-associativity (\(\psi ^\prime /\varphi ^\prime\)). This effect is more pronounced for large friction angles. In addition, it is clear from Fig. 3 that simulations with a non-associated flow rule show numerical oscillations, thus, do not converge to a single value after a certain applied displacement. This effect is more obvious with increasing degree of non-associativity \(\varLambda\) and increasing friction angle. These oscillations are a consequence of the non-associated flow rule.

Table 2 Influence of non-associativity ratio (\(\psi ^\prime /\varphi ^\prime\)) on normalized passive earth pressure coefficient \(K_{\mathrm {ph}}/K_{\mathrm {ph}}(\psi ^\prime =\varphi ^\prime )\) for friction angles between \(\varphi ^\prime = 20^\circ\) and \(\varphi ^\prime = 45^\circ\) and wall friction ratios of \(\delta /\varphi ^\prime =0.67\)

To enable a fast evaluation of the influence of the flow rule for non-associated materials, results of Fig. 3 have been summarized in Table 2 with respect to the passive earth pressure coefficient \(K_{\mathrm {ph}}\) normalized by the value obtained with associated flow rule \(K_{\mathrm {ph}}(\psi ^\prime =\varphi ^\prime )\). In this table, results have been obtained as minimum and maximum values of the oscillating curves between 80% and 100% of the applied displacement. As the minimum values represent the conservative estimate and, thus, the more relevant results for practical applications, maximum values have been presented in brackets. As can be seen for \(\varphi ^\prime =40^\circ\) and \(\psi ^\prime /\varphi ^\prime =0.00\), the simulation with a non-associated flow rule yields a maximum reduction of the passive earth pressure coefficient of more than 40%. Still, for slightly more realistic cases such as \(\varphi ^\prime =40^\circ\), \(\psi ^\prime /\varphi ^\prime =0.25\) (\(\psi ^\prime =10^\circ\)) and \(\varphi ^\prime =30^\circ\), \(\psi ^\prime /\varphi ^\prime =0.00\), maximum reductions of approximately 26% and 15% are observed, respectively.

As the impact of the flow rule has been discussed in this study in terms of the passive earth pressure coefficient and the performance of the simulations, it is still not clear if there is any influence of \(\psi ^\prime <\varphi ^\prime\) on the shape of the failure mechanism. Furthermore, it is still a point of discussions whether the failure mechanism varies/changes during the calculation. To investigate both effects, failure mechanisms obtained at four different calculation steps are presented in Fig. 4 for the case of \(\varphi ^\prime =40^\circ\) and \(\psi ^\prime /\varphi ^\prime =0.00\) (solid line in Fig. 3e). The calculation steps for this evaluation have been selected at different parts of the load-displacement curve (e.g. different calculation steps), thus, points located close to maximum or minimum values or intermediate points. From Fig. 4 it can be seen that the failure mechanism does not converge to a final form but varies throughout the calculation. The variation can be observed in terms of different geometrical factors, for instance length/extend of the failure mechanism (\(L_{\mathrm {x,NA}}\)) or the intersection angles with the ground surface (\(\nu _{\mathrm {1,NA}}\)) and the bottom of the soil-wall contact surface (\(\nu _{\mathrm {2,NA}}\)). Furthermore, it can be seen in Fig. 4b and c that the failure surface is not continuous, but shear strains are identified close to the outer slip surface of the failure mechanism and inside the failing soil mass originating from the top left corner of the soil domain, which is the top point of the soil-wall contact.

Fig. 4
figure 4

Non-uniqueness of the failure mechanism (incremental deviatoric strains) due to large degree of non-associativity (\(\varphi ^\prime = 40^\circ\), \(\varLambda = 40^\circ\)) evaluated at different calculation steps: a step 855, b step 899, c step 1372 and d step 1643

Comparing the passive earth pressure coefficients of the four calculation steps highlighted in Fig. 3e it is clear from this figure that steps 855 and 1643 yield smaller \(K_{\mathrm {ph}}\) values than steps 899 and 1372. However, setting these results into context with the different failure mechanisms presented in Fig. 4 it appears that the failure mechanism with the largest lateral extend and the largest outer slip surface (step 1643) leads to the smallest \(K_{\mathrm {ph}}\) value. Furthermore, it can be recognized that the failure mechanism with a much smaller horizontal extend but more dominant secondary slip lines (step 899) leads to the highest \(K_{\mathrm {ph}}\) value.

4.3 Simulations using the Davis approach

As has been shown in the previous section, \(K_{\mathrm {ph}}\) values are significantly smaller for non-associated materials compared to associated materials. Furthermore, FEA simulations show oscillations in the load-displacement behavior which lead to difficulties in determination of the passive earth pressure coefficient. Therefore, a major objective in this study is to evaluate whether the Davis [6] approach can provide a good estimate of the passive earth pressure coefficient in case of highly non-associated frictional materials. In order to discuss this issue, a parametric study has been conducted using FELA in combination with the Davis [6] approach for a wide range of friction angles, degrees of non-associativity and wall friction ratios. Although differences between FEA and FELA are small for simulations with associated flow rule, which is used in the Davis approach in combination with reduced shear strength parameters, the approximation of the failure mechanism is more accurate in FELA due to the adaptive mesh refinement.

The parametric study has been performed for friction angles in the range of \(\varphi ^\prime =20^\circ \,-\,45^\circ\) (in 6 steps), for degrees of non-associativity between \(\varLambda = \varphi ^\prime - \psi ^\prime = 0^\circ\) and \(\varLambda = 45^\circ\) (in 9 steps with respect to \(\psi ^\prime /\varphi ^\prime\)) and for wall friction ratios in the range of \(\delta /\varphi ^\prime =0.0\,-\,1.0\) (in 7 steps). Thus, a total number of 378 lower (LB) and upper bound (UB) FELA simulations have been performed and mean values from LB and UB simulations have been calculated. The results are presented in terms of the normalized passive earth pressure coefficient \(\zeta = K_{\mathrm {ph}}/K_{\mathrm {ph}}(\psi ^\prime =\varphi ^\prime )\) (y-axis) with respect to the degree of non-associativity (x-axis) and the wall friction ratio (different curves) in Fig. 5a–f for friction angles of \(\varphi ^\prime =20^\circ \,-\,45^\circ\), respectively. In general it can be observed from this figure that \(\zeta\) is decreasing with increasing with friction angle, with increasing degree of non-associativity and with increasing wall friction ratio. Analyzing the curve trends and comparing these trends for different subplots, it is apparent that there is a strong influence of the degree of non-associativity on the normalized passive earth pressure coefficient. An influence of the friction angle and the wall friction ratio on \(\zeta\) can also be observed, however, their influence is slightly smaller compared to the effect of \(\varLambda\) on \(\zeta\), especially for small degrees of non-associativity.

Fig. 5
figure 5

Influence of degree of non-associativity \(\varLambda\) on normalized \(K_{\mathrm {ph}}\) following Davis [6] approach for wall friction ratios between \(\delta /\phi ^\prime = 0.0\) and \(\delta /\phi ^\prime = 1.0\) and friction angles of a \(\phi ^\prime = 20^\circ\), b \(\phi ^\prime = 25^\circ\), c \(\phi ^\prime = 30^\circ\), d \(\phi ^\prime = 35^\circ\), e \(\phi ^\prime = 40^\circ\) and f \(\phi ^\prime = 45^\circ\)

Moreover, it is observed for friction angles \(\varphi ^\prime \le 35^\circ\) that all curves presented in Fig. 5a–d follow a concave trend, where the curvature of these concave curves is decreasing with increasing degree of non-associativity and decreasing wall friction ratio. However, for large friction angles and large wall friction ratios (e.g. \(\varphi ^\prime \ge 40^\circ\), \(\delta /\varphi ^\prime \ge 0.5\)) concave curve trends can only be observed up to approximately \(\varLambda \approx 25^\circ\). For larger values of \(\varLambda\), the curvature changes from negative to positive and the curve trend is convex.

To evaluate whether the Davis approach provides a useful/realistic estimate for the passive earth pressure problem of a frictional material following a non-associated flow rule, direct comparison of all three solutions (A, NA, Davis) is necessary. Considering the minimum \(K_{\mathrm {ph}}\) values obtained for the non-associated material in FEA as the benchmark, the over- or underestimation due to an associated flow rule or the Davis approach is evaluated in terms of \(\varUpsilon\) according to Eq. 5. In this equation, \(K_{\mathrm {ph,A/D}}\) refers to the passive earth pressure coefficients obtained following an associated flow rule (A) or Davis approach (D) and \(K_{\mathrm {ph,NA}}\) refers to the passive earth pressure coefficient obtained using a non-associated flow rule (NA). The parameter \(\varUpsilon\) can then be considered as the relative deviation of the A/D results from the benchmark results (NA) with positive and negative values indicating over- and underestimation, respectively.

$$\begin{aligned} \varUpsilon = (K_{\mathrm {ph,A/D}} - K_{\mathrm {ph,NA}}) / K_{\mathrm {ph,NA}} \end{aligned}$$
(5)
Fig. 6
figure 6

Comparison of relative deviations of \(K_{\mathrm {ph}}\) values obtained using an associated flow rule and Davis [6] approach from the benchmark defined as \(K_{\mathrm {ph}}\) values obtained using a non-associated flow rule with (−) and (\(+\)) values indicating under- and overestimation

The results of the (A, NA and D) simulations presented in Figs. 3 and 5 are evaluated in terms of \(\varUpsilon\) in Fig. 6 for \(\varphi ^\prime =20^\circ - 45^\circ\) and \(\psi ^\prime /\varphi ^\prime = 0.00\), 0.25, 0.50 and 0.75 at a constant wall friction ratio of \(\delta /\varphi ^\prime =0.67\). It is apparent from this figure that \(|\varUpsilon |\) increases with increasing friction angle and increasing degree of non-associativity (decreasing \(\psi ^\prime /\varphi ^\prime\)). This trend holds for all results obtained with an associated flow rule and for most of the results obtained with the Davis approach. However, in case of \(\varphi ^\prime \ge 35^\circ\) and \(\psi ^\prime /\varphi ^\prime =0.00\) the Davis approach shows less underestimation compared to \(\psi ^\prime /\varphi ^\prime =0.25\). Furthermore, it can be seen that the overestimation of \(K_{\mathrm {ph}}\) due to associated plasticity is significantly larger than the underestimation of \(K_{\mathrm {ph}}\) due to Davis approach, especially for large friction angles and small \(\psi ^\prime /\varphi ^\prime\) ratios. For instance, comparing \(\varUpsilon\) values for \(\varphi ^\prime =40^\circ\), \(\psi ^\prime /\varphi ^\prime =0.25\) (\(\psi ^\prime =10^\circ\)) and \(\varphi ^\prime =30^\circ\), \(\psi ^\prime /\varphi ^\prime =0.00\) an overestimation of 35% and 18% is observed using an associated flow rule, whereas an underestimation of 6.5% and 10% is observed using the Davis approach, respectively. Furthermore, it should be noted that, as stated in the first paragraph of Sect. 4.2, the NA benchmark results utilized for \(\varphi ^\prime =45^\circ\) and \(\psi ^\prime /\varphi ^\prime =0.00\) have been obtained using \(\psi ^\prime /\varphi ^\prime =0.05\). Thus, the NA results for \(\psi ^\prime /\varphi ^\prime =0.00\) may be slightly smaller, which would also lead to an increase of the accuracy of the Davis approach estimate.

Based on the above mentioned observations it can be stated that the Davis approach provides a reasonable estimate for the passive earth pressure coefficient. Although slightly conservative compared to the NA benchmark solution, the \(K_{\mathrm {ph}}\) value determined using the Davis approach can be considered a more realistic estimate than a \(K_{\mathrm {ph}}\) value which has been derived using an associated flow rule. As the Davis approach yields good estimates of the passive earth pressure for a wide range of friction angles and degrees of non-associativity, the results presented in Fig. 5 may also serve as design charts to enable a fast determination of passive earth pressure coefficients. Thus, for practical use, \(K_{\mathrm {ph}}\) values can be taken from Table 1 or other earth pressure tables and corrections can be applied using the \(\zeta\) plots given in Fig. 5. Still it should be noted that more FEA simulations with other wall friction ratios (\(\delta /\varphi ^\prime \ne 0.67\)) are necessary to further evaluate the applicability of the Davis approach for the passive earth pressure problem of non-associated materials.

4.4 Further discussion and additional remarks

Prior studies investigated the influence of the flow rule on the stability of slopes as well as the limit load for bearing capacity problems. However, less research was conducted with respect to the importance of this issue for the passive earth pressure problem. The results of this study show that also the determination of passive earth pressure coefficient is significantly influenced by the choice of the flow rule.

Taking another look on the results presented in Table 1, it is interesting to note that although the flow rule is not a direct input, results of Sokolovski [22] can clearly be categorized to an associated flow rule with \(\psi ^\prime =\varphi ^\prime\). As expected, the passive earth pressure coefficients obtained using FELA and FEA for \(\psi ^\prime = \varphi ^\prime\) compare well with the approach from Sokolovski [17] when using the same friction angle. However, since dilation angle is not an input parameter, it needs to be questioned why Sokolovski results are similar to the ones obtained for associated flow rule. A possible explanation for this is that in the Sokolovski solution passive earth pressure coefficients are derived based on the method of characteristics considering a stress field which must nowhere violate the Mohr–Coulomb failure criterion. However, since it is generally accepted that the failure surface is better approximated by velocity characteristics rather than by stress characteristics, also shear strength parameters which correspond to the stress state on the velocity characteristics have to be utilized. For this reason, Davis [6] and Roscoe [19] argued that shear strength on a slip or failure surface is smaller than on stress characteristics and recommended to use reduced shear strength parameters. One possibility to account for reduced shear strength on velocity characteristics is to apply the Davis approach using \(\varphi ^*\) and \(c^*\). To evaluate to what extent shear strength needs to be reduced, Roscoe [19] evaluated direct shear tests and confirmed the approach suggested by Davis [6]. Pregl [17] also came to this conclusion, but argued that the influence of not considering this shear strength reduction (strictly speaking the Davis approach) should be small compared to other influences (e.g. shape of the failure surface, distribution of normal forces, estimation of shear strength parameters, progressive evolution of failure mechanism etc.). Though, the findings of this study indicate that the impact of \(\psi ^\prime\) on the computed values of \(K_{\mathrm {ph}}\) may be larger than expected, as can be seen, for instance in Fig. 6.

Following an associated flow rule instead of non-associated flow rule, the passive earth pressure coefficient is significantly over predicted, especially for large friction angles and large degrees of non-associativity. However, it still needs to be investigated whether the impact of the flow rule is smaller for cohesive-frictional soils. For non-associated plasticity the observations match those described in earlier studies as numerical instabilities are likely to occur for materials with large friction angles and low values of \(\psi ^\prime\). Consequences of this problem are oscillations in the load-displacement curves as well as multiple failure mechanisms which change during the calculation, making a rigorous assessment of \(K_{\mathrm {ph}}\) values difficult. Therefore, for simple cases as discussed in this contribution it can be recommended to follow the Davis approach which is in good agreement with FEA applying non-associated plasticity.

5 Summary and conclusions

In this contribution, the influence of the flow rule on the passive earth pressure problem has been studied. Calculations have been performed using displacement finite-element analysis (FEA) considering associated and non-associated frictional materials as well as using finite-element limit analysis (FELA) with and without reduced shear strength parameters according to Davis [6]. Results have been presented in terms of passive earth pressure coefficients and compared with selected data from literature. Furthermore, the influence of the flow rule on the passive earth pressure coefficient, the shape of the failure mechanism and the robustness of the numerical simulation has been studied and a parametric study has been conducted with FELA in order to create design charts of a correction factor for the passive earth pressure coefficient in accordance with the Davis approach. Based on the analyses performed in the present study, the following general remarks can be drawn:

  1. 1.

    For an associated flow rule, passive earth pressure coefficients obtained with FEA and FELA are in good agreement with \(K_{\mathrm {ph}}\) values reported in literature, e.g. [11, 22].

  2. 2.

    Comparing results for an associated and a non-associated flow rule, it is apparent that \(K_{\mathrm {ph}}\) values are significant smaller for the latter case. This trend is significantly noticeable with increasing difference between internal friction and dilation angle (\(\varLambda = \varphi ^\prime - \psi ^\prime\)). Furthermore, FEA simulations conducted for these materials may lead to highly erratic results as well as a variation of the failure mechanism at different calculation steps.

  3. 3.

    Following Davis [6] approach to take into account the non-associativity of real soils, passive earth pressure coefficients are slightly underestimated. Due to the combination of \(\varphi ^*\) and \(c^*\) with an associated flow rule, the robustness of the numerical simulations is enhanced compared to calculations following a non-associated flow rule.