Abstract
Computing the total energy of a system of N interacting dislocations in the presence of arbitrary free surfaces is a difficult task, requiring Finite Element (FE) numerical calculations. Worst, high accuracy requires very fine meshes in the proximity of each dislocation core. Here we show that FE calculations can be conveniently replaced by a Machine Learning (ML) approach. After formulating the elastic problem in terms of one and two-body terms only, we use Sobolev training to obtain consistent information on both energy and forces, fitted using a feed-forward neural network (NN) architecture. As an example, we apply the proposed methodology to corrugated, heteroepitaxial semiconductor films, searching for the minimum-energy dislocation distributions by using Monte Carlo. Importantly, the presence of an interaction cutoff allows for the application of the method to systems of different sizes without the need to repeat training. Millions of energy evaluations are performed, a task which would have been impossible by brute-force FE calculations. Finally, we show how forces can be exploited in running 2D ML-based dislocation dynamics simulations.
Similar content being viewed by others
Introduction
Machine Learning (ML) methods have been recently exploited in a large number of applications in materials science1,2,3,4, solid-state physics5, molecular chemistry6,7,8,9,10, and crystallography11. The application of ML methods in these fields are allowing for data-intensive tasks that were previously considered inaccessible, such as the compositional search for material-discovery2,4,12 or the automated defect detection and classifications13, and are replacing conventional simulation techniques by allowing for better accuracy with faster computational time. In particular, the application of ML to the development of Force Fields (FFs) for Molecular Dynamics (MD) simulations14,15,16,17,18 have been proposed as a way to overcome the limitation of the classical modeling approaches. Established simulations procedures have relied up to now on performing very computationally demanding ab initio MD simulations, limited to a few hundreds of atoms, or on the exploitation of approximate empirical potentials. The large interest raised by ML techniques for the development of FF is due to the unprecedented trade-off between accuracy and computational speed allowed by ML19. The high level of flexibility provided by ML models such as Neural Networks (NN)14,20,21 and Gaussian Processes16,22,23,24 have been successfully exploited to faithfully reproduce first-principle atomistic calculations. This is achieved by evaluating large databases of atomistic configurations starting from ab-initio approaches such as Density Functional Theory (DFT)17,18,25,26 or Coupled Cluster27. This database is then used to train a ML model in predicting forces and energies for arbitrary atomistic configurations. The resulting FF is more computationally demanding than classical empirical potentials typically used in MD simulations of solids but it has been demonstrated that can be used to accurately reproduce ab-initio calculations with just a fraction of their computational cost19.
Here we show that a similar approach can be implemented also on the continuum scale for the modeling of dislocations within the linear elasticity framework. Describing the movement and arrangement of dislocations in a material is fundamental because these defects are the carrier of plasticity at the microscale. The mechanical properties of crystalline materials are dominated by their movement and interactions28,29. They are also commonly encountered during the fabrication of semiconductor devices in microelectronic as they can be easily generated in the relaxation process of thin films and heterostructures30,31,32,33. Interest in the application of ML for the modeling of dislocations has been recently raised34 and some successful applications of ML have been already demonstrated35,36,37 but these previous work focus more on reproducing complex collective behavior of dislocations, without putting emphasis on the details of the behavior of individual dislocations.
In our approach, however, we seek to develop a framework akin to the one used in atomistic FF evaluations in order to develop a ML model for high accuracy prediction of both energies and forces for simulations of dislocations. By exploiting a NN-based model we were able to predict the interaction between the defects, closely reproducing a properly-designed database of Finite Element (FE) calculations. We recall that the numerical evaluation of the dislocation–dislocation interaction is required whenever the problem involves the presence of complex free surface geometries28,38. In this kind of problems no analytical expressions for the stress/strain field of dislocations are available and thus the forces and energies produced by the defects need to be evaluated by solving the Partial Differential Equation (PDE) of mechanical equilibrium39,40. The inclusion of both energies and forces predictions in our approach represents a novel advancement with respect to previous works in this field. This is particularly relevant as this allow for the exploitation of our ML method both in minimum-search algorithms exploiting energy evaluations, both in Dislocation Dynamics approaches where the interaction forces between dislocations are required.
After separating the problem of interacting defects into convenient one and two-body terms, we used Sobolev training, in which both energies and forces are consistently learned by the NN41,42.
We then apply our ML approach to a relevant physical system, searching for the optimal arrangement of Misfit Dislocations (MDs) in a corrugated SiGe/Si heteroepitaxial film modeled in two dimensions (2D), for the sake of simplicity. Even so, the problem of finding the minimum energy dislocation distribution cannot be tackled by brute force, at least for large enough simulation cells (and assigned defect density), considering the proliferation of local energy minima43. The NN model developed here is thus applied as a high-throughput approach to a Monte Carlo (MC) minimum energy search at a fraction (approximately one order of magnitude less) of the computational cost of a single FE calculation (out of the more than \(10^5\) required). This allowed us to statistically analyze the dislocation distributions, confirming existing experimental observations and theoretical predictions regarding this kind of systems.
Methods
The method presented in this Paper seeks to develop high accuracy predictions for forces and energies produced by an ensemble of N interacting dislocations near a free surface of generic geometry. In this section we will present a description of the general features of the method, as sketched in Fig. 1. As stated in the “Introduction”, our approach is inspired by the wide adoption of ML in the field of atomic FF calculations, we derive a similar method in the linear elasticity framework regarding dislocations. Following this analogy, first a high-accuracy evaluation of force/energy contributions is performed by means of FE calculations in order to obtain a trusted set of data, called the Training Set (TS). This is achieved by considering one and two body terms, exploiting the functional form of the dislocation–dislocation interaction as will be shown later in this section. The system is a thin heteroepitaxial film hosting dislocations, here modeled in two dimensions for the sake of simplicity. We considered a representative non-flat geometry for the free surface of the layer modeled by a sinusoidal perturbation as in the top inset of Fig. 1. Once the TS has been computed, we train a NN based on those data and test its performance on an independent set of data, the validation set. Finally, the trained NN can be used to perform high-throughput algorithms for minimum energy search or force-based physical models.
Sketch of the proposed method. A TS is constructed exploiting the interaction decomposition by numerically solving two-dislocation problems. Neural Networks are used to build predictive models of energies and forces of dislocation configurations. These are then used to search for low energy configurations or dislocation dynamics simulations orders of magnitude faster than by FE bruteforce evaluations.
Energy and forces decomposition
The energy of a system of N dislocations near an arbitrary surface with an arbitrary external stress field in a elastic body can be written as44,45:
where V, H and W are, respectively, the dislocation self-energy, dislocation-external field interaction and the dislocation–dislocation interaction. In the following, term H will be referred as “dislocation-heteroepitaxial field interaction”, as this is the case we are interested in the current work. In the framework of linear elasticity this decomposition is exact. The terms under summation can be expressed in different ways. For example, self energy of a dislocation can be written as a function of the traction its own stress field exerts on the slip plane45. Another equivalent approach is to consider the expression of the elastic energy stored in a deformed body. This can be obtained by an integral over the whole material domain \(\Omega\), as44:
where \(\sigma _i\) and \(\varepsilon _i\) are the stress and strain fields generated by dislocation i, respectively. Similar results can be obtained for terms \(H_i\) and \(W_{ij}\). A complete derivation of these expressions can be found in the Supplementary Information of this Paper. For fixed boundary conditions and infinite straight dislocations, the only case we shall consider here, the value of \(V_i\) and \(H_i\) are functions of the dislocation position and Burgers vector only. Similarly, \(W_{ij}\) depends only on the position and Burgers vector of dislocations i and j. The forces can be obtained by considering the gradient of Eq. (1). The force on the ith dislocation is:
where \(\vec {\nabla }_i\) is the gradient with respect to the position of dislocation i. This expression corresponds to the Peach-Koehler formula, well known in dislocation theory44,45:
where \(\sigma\) is the total external stress tensor acting on the position of dislocation i, \(\vec {b}_i\) and \({\hat{\xi }}_i\) are the ith dislocation Burgers vector and dislocation line direction. Requiring the consistency between the two formulations, we can identify the following terms:
the terms \(\sigma _\text {self}\), \(\sigma _\text {het}\) and \(\sigma _j\) indicating respectively the dislocation self stress, the heteroepitaxial stress field and the stress field generated by the jth dislocation at the position of dislocation i. We emphasize that self stress indicates here the stress field present at the dislocation core position as an effect of the free surface boundary conditions. Singular “bulk” terms, therefore, do not contribute to Peach–Koehler force44,45.
This energy and forces decomposition presents several advantages when building a database for the application of ML algorithms. There is a reduction in the complexity of models, leading to reduced overfitting problems, smaller memory requirements and faster evaluation times. A second advantage is that generalization to an arbitrary number of dislocations is a straightforward summation as in Eq. (1) and the database can be constructed considering only one and two body interactions.
Data generation
As stated in the “Introduction”, analytical expressions for the stress/strain field of dislocations are available only in the simple case of dislocations in bulk systems or near a flat free surface44,45. All other non-trivial configurations require the numerical solution of the equilibrium PDE for an elastic continuum. In this work we numerically solved this equation by exploiting a MATLAB FE solver, like in Ref.39. In order to avoid divergences in dislocation cores we used the regularization approach presented in Ref.46 which also ensures consistency between the derivatives of the total elastic energy, Eq. (3), and the Peach–Koehler formula, Eq. (4). Locally-refined meshes were used in order to efficiently reproduce the high variations in the stress/strain field in the proximity of dislocation cores.
The system was modeled by considering the heteroepitaxial strain due to the lattice mismatch betweeen \(\text {Si}_{0.75}\text {Ge}_{0.25}\) and Si(001) and the dislocations considered as infinite straight lines perpendicular to the system. Periodic boundary conditions were applied, similarly to Ref.39. Simulation cell was 1200 nm wide. The total stress/strain fields were evaluated by FE by setting the heteroepitaxial and dislocation strain fields as the initial condition for the mechanical equilibrium PDE with the help of the eigenstrain formalism (Refs.39,40).
In our work, we considered Burgers vectors only between the two possible relaxing orientations of \(60^{\circ }\) dislocations. These are indeed the kind of defects that are normally nucleated in the Ge/Si(001) and SiGe/Si(001) system30,31. The sign of the in-plane (i.e. laying on the growth plane) component of the Burgers vector is fixed due to the need to relax the compressive misfit strain, while in a full 2D description only the sign of the out-of-plane component can vary. This reduces the choice for the Burgers vector to the two possibilities: \(b_1 = b[\frac{1}{2}, \frac{1}{\sqrt{2}}, 0]\) and \(b_2 = b[\frac{1}{2}, -\frac{1}{\sqrt{2}}, 0]\), with \(b=0.3857~\text {nm}\).
As described in the Introduction, we focused on the effect of the free surface shape on the minimum-energy distribution of dislocations. Therefore, several TSs have been constructed by random sampling both positions and Burgers vectors of two-dislocation configurations for each different surface morphology. Initially, a TS with flat free surface have been generated using FE, even though an analytical solution is available in this particular case. This served as a baseline comparison between our method and an exact treatment. Next, TSs with perturbed surfaces were constructed. In particular, we chose a simple sinusoidal perturbation, used as a prototypical variation from the flat profile that integrates naturally with periodic boundary conditions. Periodicity of the perturbation was kept fixed to 600 nm (half the simulation cell), while oscillation amplitude A was varied. Each TS comprised approximately 12000 two-dislocation configurations. Periodicity and symmetries of the simulation cell has been exploited for TS augmentation.
Starting from the FE solution, strain/stress fields of dislocation, as well as \(V_i\), \(H_i\) and \(W_{ij}\) values have been collected and the forces acting on dislocations have also been inserted in the TSs by exploiting Eq. (4). In this work, reported energies are in the units in which Young modulus for Si is unity.
Model training and validation
The ML model used to learn the energy and force terms was a feed-forward, fully-connected NN. The choice of this approach over a Gaussian Process Regression comes from the constant computational costs with respect to the dimension of the TS, which can therefore be expanded without increasing evaluation times. The architecture chosen was the following: for one-body terms \(H_i\) and \(V_i\), the NNs had three hidden layers with 30, 20 and 20 neurons each, while for \(W_{ij}\) the NN had four hidden layers with 40, 40, 40 and 20 neurons respectively. The activation functions chosen were hyperbolic tangents. No particular attempts in tuning the number of hidden units and other hyperparameters was performed, as our main concern was the feasibility of the proposed approach. NN implementation relied on the PyTorch framework47. The first training regression was made using a Mean Squared Error loss function on energy values. The functional to be minimized with respect to NN parameters \(\theta _k\) reads like:
where \(N_\text {TS}\) is the number of elements in the TS, index i runs on TS elements, \(\vec {x_i}\) represent the parameters defining the configuration (i.e. dislocation positions and Burgers vectors). In the following, fitting procedures using Eq. (6) will be referred as “Value training” (following Ref.48). Notation E indicates true values of the energy functions V, H and W as extracted by FE solutions, and \(\hat{E}\) indicate the NN approximation.
(a) Loss function calculated on the validation set during NN parameters optimization using Value (blue line) and Sobolev training (orange line). (b) Plot of energy and force near a dislocation as predicted from the NN model. Regression plots for the H term (both energies and forces) obtained from the model predictions on a validation set. A free surface with a perturbation of \(60~\text {nm}\) amplitude was considered: value training (c) and Sobolev training (d).
As stated in the previous section, solving the mechanical equilibrium equation for a distribution of dislocations allows the collection of energy derivatives through Peach–Koehler forces. These can be used to enhance regression results through a procedure called Sobolev training48. Equation (6) can be modified by explicitly inserting derivatives of the NN output as, for example, in49:
where l is an index running on cartesian components of the ith dislocation position. \(g_l\) is a weight parameter accounting for the relative importance of forces in regression. In our work we fixed its value so that relative errors in energies and forces contribute in the same way to the total loss. Notice that in Sobolev training, the forces are not an independent output of the NN, but are obtained by differentiation of the energies. This leads to a fully consistent model.
A comparison between Value and Sobolev has been performed on two NNs initialized with the same weights and hyperparameters using a validation set of configurations the models were not exposed during training. Training has continued until the relative decrease in the loss function was less than \(10^{-6}\) in 1000 optimization steps. Convergence of the two different training approaches has been monitored by analyzing the evolution of the loss on a validation set versus the number of optimization steps. In order to have a fair comparison between Sobolev and Value training, Mean Squared Error Loss on the predicted energies only has been used for both algorithms. In Fig. 2a results are displayed for the \(H_i\) term (dislocation-field interaction) for a sine-perturbed surface (amplitude 60 nm). It is clear that convergence is reached in both cases without overfitting. Such nice behavior is determined by the large number of examples present in the TS (\(\approx 22,000\), considering data augmentation) with respect to the number of parameters in the networks (\(\approx 1100\)). The risk of overfitting is further reduced when using Sobolev training, as the information content for every data point is effectively augmented.
Regression plots are reported in Fig. 2c,d for Value and Sobolev training respectively. As can be clearly appreciated from the figure, Sobolev training performs better, especially in predicting forces. This is corroborated by the comparison between Root Mean Square Errors (RMSE), which shows a reduced error for both energy and forces, confirming that Sobolev training leads to equivalent or better predictions of both quantities. The energy and forces terms are also shown in the colormaps of Fig. 2b, as predicted by the trained NN model.
Interaction cutoff
The method presented so far allows for a high-throughput simulation approach for dislocation in thin films but its application is limited to the simulation cell used to build the TS. A straightforward solution to this problem is the introduction of a cutoff radius beyond which dislocation-dislocation interactions can be considered null. This approach is justified by the presence of free surfaces, which ensures that dislocation fields decay more rapidly (\(\propto r^{-2}\)) than fields of bulk dislocations (\(\propto r^{-1}\))45. Readers are addressed to the Supplementary Information file for more information regarding the choice of the cut-off scheme used and its performance.
Results and discussion
In this section we present the results obtained by applying the model discussed and validated in “Methods”. We investigated a system consisting of N dislocations in a corrugated \(\text {Si}_{0.75}\text {Ge}_{0.25}\)/Si(001) film. In order to model a representative non-flat geometry we considered a sinusoidal perturbation of the heterolayer free surface, described by its amplitude A. The search for minimum-energy configurations for this kind of systems with several dislocations has been proven to be a difficult task due to the observed proliferation of local energy minima43. The absence of analytical solutions for the case of a non-flat free surface geometry would thus require expensive numerical evaluations for the total elastic energy of the system, making the brute-force search for the global energy minimum an unreachable task.
Furthermore, while often the minimum energy configuration is never achieved in real systems hosting dislocations, it has been shown that in semiconductor heteroepitaxy the lowest energy configurations can indeed provide valuable information on the relaxation process and even closely reproduced experimental results. A review of the main achievements in the field of heteroepitaxy can be found in the book by Hull30. Good agreements between theoretical predictions and observed dislocation distributions were found for dislocated heteroepitaxial islands, where the minimum energy criteria has been proved to be useful in determining the onset of plasticity50,51 or peculiar phenomena such as the cyclic growth of islands39,52. In thin films, ordered arrays of misfit dislocations have been ovbserved at the interface between the heteroepitaxial layer and the substrate53,54, confirming theoretical findings regarding the lowest energy distribution for non-graded layers30,39,43. Finally, in systems hosting few dislocations like the Vertical Heterostructures33, the onset of plasticity and the experimentally observed dislocation distributions have been observed to be in good agreement with the theoretical predicitons40,55,56,57.
These factors make the following analysis an ideal case for the application of the high-throughput model presented in this Paper. The minimum-energy search was here performed by a Monte Carlo algorithm exploiting the energy evaluations predicted by the trained NN discussed in “Methods”. Starting from a random dislocation configuration, at each simulation step a dislocation is selected and displaced. The new configuration is retained with probability \(\exp {-\Delta E/k_BT}\), being \(\Delta E\) the energy difference between initial and final configurations, \(k_B\) Boltzmann constant and T the temperature of the system. A simulated annealing in which, after an initial minimization at absolute zero, temperature is progressively increased (up to \(1000~\text {K}\)) and then decreased has been performed in order to reduce local minima trapping. After this first temperature ramp, a second energy minimization at absolute zero is performed.
The algorithm discussed above was applied to a system with \(N=8\) dislocations. In order to validate the physical soundness of the results of our model we started by investigating a thin flat film where exact analytical expressions for the dislocation-dislocation interaction are available58 and the minimum-energy configurations are already known and well described in the literature30,43. As discussed in “Data generation”, we modeled two possible \(60^{\circ }\) dislocations. For the scope of these simulations we considered two distributions of dislocations, one with all equal Burgers vector \(\vec {b} = \vec {b_1}\) and the other with 50% of Burgers vectors \(\vec {b_1}\) and the remaining \(\vec {b_2}\). In the following we will refer to those distribution as “equal” and “alternated” Burgers vector, respectively. Results are shown in Fig. 3a,b for the equal and alternated distributions. In the case of alternated Burgers vector we allowed the reaction of two \(60^{\circ }\) dislocations to form a single edge dislocation as expected by dislocation theory28,44. The resulting defect has a Burgers vector \(\vec {b} = \vec {b_1} + \vec {b_2}\) and the reaction was allowed provided that the two original defects fell inside a typical cutoff distance \(r_c = 5 \text {nm}\) during the simulated annealing. The final result shows, as expected, an ordered array of dislocations placed at the \(\text {Si}_{0.75}\text {Ge}_{0.25}\)/Si interface. For the case of dislocations with equal Burgers vectors, Fig. 3a, they form an array with all dislocations equally spaced and placed at the interface. On the other hand, for the case of alternated Burgers vector, each dislocation reacts with its complementary defect forming an edge dislocation. The result is an array of 4 edge dislocations equally spaced and placed at the \(\text {Si}_{0.75}\text {Ge}_{0.25}\)/Si interface, as shown in Fig. 3b. Furthermore, in Fig. 3c we present the results obtained by applying the Monte Carlo algorithm to a system with a free surface described by a sinusoidal perturbation of amplitude \(A = 60~\text {nm}\). Here we can see that dislocations with alternated Burgers vector do not react anymore to form edge dislocations but place themselves in alternated fashion under the valley of the perturbation, directly showing the interplay between the surface morphology and the optimal dislocation positioning39,59. This results resembles the optimal positioning of \(60^{\circ }\) dislocations in a heteroepitaxial island, providing optimal strain relaxation52,60,61. If the energies of the final configurations, as predicted from our NN functions, is compared with the correct energies evaluated by the FE solver, we observe a relative deviation in the order of 2‰. This confirm the accuracy of the predictions of our method, making the minimum energy search an ideal application of the presented approach.
Example of low energy configurations obtained by minimum searches (right) starting from random initial configurations (left). Colormap indicates the xx component of strain field. As expected, regular arrays of \(60^{\circ }\) (a) or edge dislocations (b) are observed. When the free surface is perturbed, edge dislocation formation is inhibited (c) and defects place below valleys in the surface profile.
The interplay between the surface morphology and the optimal dislocation positioning has then been further analyzed. Thanks to the speedup provided by the ML model we performed several Monte Carlo minimization (500 for each considered configuration) starting from random initial dislocation distributions and different values for the amplitude of the sinusoidal perturbation A. In Fig. 4 we plot the dislocation densities obtained by averaging all the (smoothed) dislocation positions at the end of our MC minimization algorithm. The averaging is required in order to deal with the proliferation of local minima observed in these systems43. Despite the smoothing step the trend is clear: increasing the amplitude A produces a polarization in the positioning of the dislocations, depending on their Burgers vectors. At \(A = 0\) most of the dislocation pairs react to form edge dislocations that are placed at the interface. This is expected from the observation of the lowest-energy configuration of Fig. 3b. In this case the dislocation densities of the \(60^{\circ }\) dislocations (red dashed and red dot-dashed lines) are almost zero everywhere while the density of edge dislocations (green solid line) is nearly constant because all the positions at the interface are energetically equivalent. When the amplitude increases a lower number of edge dislocation is formed, corresponding to a higher probability of finding \(60^{\circ }\) dislocations aligned with the valleys of the perturbation. At the maximum A value considered, \(A=60~\text {nm}\), as in Fig 3c, a clear polarization in the positioning of dislocation with respect to their Burgers vector is observed. In this case no edge dislocations are formed in all the MC simulations attempted. The density plot thus reflects the net polarization observed in the lowest-energy configuration found, already reported in Fig 3c, where all the \(60^{\circ }\) dislocations are placed on the lateral sides of the valleys of the perturbation, depending on their Burgers vector.
Dislocation density for different Burgers vectors as a function of the amplitude of the sinusoidal perturbation of the free surface (500 Monte Carlo searches each). Free surface profile is reported in transparency. As expected, for flat films (A = 0 nm) dislocations react and form edge dislocations (green solid line). Increasing the intensity of the perturbation, the density of \(60^{\circ }\) dislocations (red dashed and red dot-dashed lines) increase and they tend to localize near valleys in the free surface profile (A = 7.5 nm and A = 15 nm). At the highest perturbation value (A = 60 nm) the formation of edge dislocations is completely prevented.
Furthermore, in order to demonstrate an application of our approach to simulation cells larger than the one used to generate the TS we performed additional simulations exploiting the cutoff scheme described in “Interaction cutoff”. A large-scale MC minimum energy search was performed considering a simulation cell four times larger (\(4800~\text {nm}\)) than the one described above and used for the generation of the TS. In Fig. 5 we report the result of the MC minimization, obtained again starting with all the dislocation randomly placed in the whole simulation cell. The energy as a function of the variance in the number of dislocations for each periodicity of the free-surface perturbation is reported in the left inset. The independent variable in the plot has been chosen as a descriptor of the symmetry of the configuration: a value of 0 means that dislocations are evenly distributed along all the valleys of the simulation cell. Error-bars correspond to 3‰ of the the energy value, the total relative error between the lowest-found NN and FE-evaluated energies. As reported above (Fig. 3c) the lowest energy configuration is associated with an ordered distribution of dislocations with the defects aligned along the two sides of the perturbation valleys, depending on their Burgers vectors. This indicates that the error induced by the use of the cutoff scheme is not critical for minimum energy searches. The bottom part of Fig 5 shows the lowest energy configuration found. The trend of the energy distribution and the high symmetry of the configuration suggests this is a reasonable candidate for the global energy minimum of the system. Therefore, the restriction of the validity of the trained ML model to a specific geometry when building the database is partially overcome by the cutoff scheme here proposed.
Minimum energy configuration obtained on a cell 4800 nm long using cutoff. Colormap shows xx component of the strain field. Left inset shows the energy of found local minima as a function of the variance of the number of dislocations below each valley in the free surface. Error bars give indicative errors in energy (approximately 3‰ of energy values). Right inset shows zooms in the vicinity of a single period of oscillation in the free surface. Dislocation separation by Burgers vector can be clearly observed.
Finally, while the search for energy minima is an interesting application of our method per-se, in most dislocation simulations the motion of the defects is bound to prescribed crystallographic directions called Glide Planes (GPs), in order to mimick the behavior of these defects in real systems. This is exploited in approaches like the Dislocation Dynamics (DD) where the simulations predict the time evolution of a given initial dislocation microstructure. While in 3D this procedure requires complex tracking of dislocation line topology, in 2D DD reduces to a constrained motion of point-like particles moving under the influence of the Peach–Koehler force. As reported in “Model training and validation”, the NN model trained with the Soboelev training also provide reliable force predictions. It is therefore possible to run DD simulations with surface-corrected interactions. One of such application is reported in Fig. 6. Initial (Fig. 6a) and final (Fig. 6b) configurations are shown for a pair of dislocations. On the left part of the Figure it is possible to observe the motion of two dislocation with different Burgers vector that follow different GPs (highlighted by the white dashed lines). Their motion ends at the intersection between the GPs and the \(\text {Si}_{0.75}\text {Ge}_{0.25}\)/Si interface. The final result shows the two defects aligned at the two sides of the perturbation as seen in the previously discussed MC results. However, by switching the Burgers vector of the two defects the result changes completely, as can be seen in the right part of the Figure. This happens because the defects are still restricted to move on their GPs and thus they glide towards the center, reacting with each other and forming a single edge dislocation. This result, as discussed before, do not represent the optimal positioning of the defects in this system but show a typical outcome when considering the constrained motion of this crystallographic defects.
Conclusions
In this paper we presented a ML model for high-accuracy predictions of forces and energies for dislocations simulation. The scheme of our method was inspired by the adoption of ML in the field of atomistic FF evaluations. We trained a NN model with the help of a properly-evaluated database of FE calculations and exploited the Sobolev training to enhance the predictive ability of our model. Furthermore, the separation of the problem into one and two-body terms allowed by the functional form of the dislocation-dislocation interaction allowed us to train a very high accuracy NN model with a reasonable-sized TS.
The resulting NN was then applied for producing fast energy and forces evaluations in algorithms such as MC minimum energy search or DD in a corrugated \(\text {Si}_{0.75}\text {Ge}_{0.25}\)/Si thin film. The obtained results were in agreement with several existing observations regarding these systems but a complete statistical investigation was made possible only by the speedup provided by ML. The total wall time of a MC energy minimization exploiting the ML model was about 1 min, orders of magnitude faster than the brute-force FE calculations would have required (more than 2 years keeping the same accuracy used to build the TS). This demonstrates how new possible ways of investigating this systems are allowed by the enhanced predictive ability of such a high-throughput model.
Extension of the present model to 3D systems requires a major effort in order to deal with the additional complexities raised by the full description of the dislocation lines, but a first extension considering straight dislocations has already been envisaged.
Data availability
The authors declare that all data supporting the findings of this study are available within the Paper and its Supplementary Information file. Further information are available upon reasonable request.
Change history
11 July 2023
A Correction to this paper has been published: https://doi.org/10.1038/s41598-023-38180-z
References
Nyshadham, C. et al. A computational high-throughput search for new ternary superalloys. Acta Mater. 122, 438–447. https://doi.org/10.1016/j.actamat.2016.09.017 (2017).
Kaufmann, K. & Vecchio, K. S. Searching for high entropy alloys: A machine learning approach. Acta Mater. 198, 178–222. https://doi.org/10.1016/j.actamat.2020.07.065 (2020).
Sanvito, S. et al. Accelerated discovery of new magnets in the Heusler alloy family. Sci. Adv.https://doi.org/10.1126/sciadv.1602241 (2017).
Frydrych, K. et al. Materials informatics for mechanical deformation: A review of applications and challenges. Materials.https://doi.org/10.3390/ma14195764 (2021).
Zdeborová, L. New tool in the box. Nat. Phys. 13, 420–421. https://doi.org/10.1038/nphys4053 (2017).
Dral, P. O. & Barbatti, M. Molecular excited states through a machine learning lens. Nat. Rev. Chem. 5, 388–405. https://doi.org/10.1038/s41570-021-00278-1 (2021).
Keith, J. A. et al. Combining machine learning and computational chemistry for predictive insights into chemical systems. Chem. Rev. 121, 9816–9872. https://doi.org/10.1021/acs.chemrev.1c00107 (2021) (PMID: 34232033).
Zhang, Y. & Xu, X. Predictions of adsorption energies of methane-related species on Cu-based alloys through machine learning. Mach. Learn. Appl. 3, 100010. https://doi.org/10.1016/j.mlwa.2020.100010 (2021).
Zhang, Y. & Xu, X. Machine learning specific heat capacities of nanofluids containing CuO and Al2O3. AIChE J. 67, e17289. https://doi.org/10.1002/aic.17289 (2021).
Zhang, Y. & Xu, X. Solubility predictions through lsboost for supercritical carbon dioxide in ionic liquids. New J. Chem. 44, 20544–20567. https://doi.org/10.1039/D0NJ03868G (2020).
Patala, S. Understanding grain boundaries—The role of crystallography, structural descriptors and machine learning. Comput. Mater. Sci. 162, 281–294. https://doi.org/10.1016/j.commatsci.2019.02.047 (2019).
Stanev, V., Choudhary, K., Kusne, A. G., Paglione, J. & Takeuchi, I. Artificial intelligence for search and discovery of quantum materials. Commun. Mater. 2, 1–11. https://doi.org/10.1038/s43246-021-00209-z (2021).
Goryaeva, A. M. et al. Reinforcing materials modelling by encoding the structures of defects in crystalline solids into distortion scores. Nat. Commun. 11, 1–14. https://doi.org/10.1038/s41467-020-18282-2 (2020).
Behler, J. & Parrinello, M. Generalized neural-network representation of high-dimensional potential-energy surfaces. Phys. Rev. Lett. 98, 146401. https://doi.org/10.1103/PhysRevLett.98.146401 (2007).
Behler, J. Atom-centered symmetry functions for constructing high-dimensional neural network potentials. J. Chem. Phys. 134, 074106. https://doi.org/10.1063/1.3553717 (2011).
Bartók, A. P., Payne, M. C., Kondor, R. & Csányi, G. Gaussian approximation potentials: The accuracy of quantum mechanics, without the electrons. Phys. Rev. Lett. 104, 1–4. https://doi.org/10.1103/PhysRevLett.104.136403 (2010).
Bartók, A. P., Kermode, J., Bernstein, N. & Csányi, G. Machine learning a general-purpose interatomic potential for silicon. Phys. Rev. X 8, 41048 (2018).
Mueller, T., Hernandez, A. & Wang, C. Machine learning for interatomic potential models. J. Chem. Phys. 152, 050902. https://doi.org/10.1063/1.5126336 (2020).
Friederich, P., Häse, F., Proppe, J. & Aspuru-Guzik, A. Machine-learned potentials for next-generation matter simulations. Nat. Mater. 20, 750–761. https://doi.org/10.1038/s41563-020-0777-6 (2021).
Hornik, K., Stinchcombe, M. & White, H. Multilayer feedforward networks are universal approximators. Neural Netw. 2, 359–366. https://doi.org/10.1016/0893-6080(89)90020-8 (1989).
Shaidu, Y. et al. A systematic approach to generating accurate neural network potentials: The case of carbon. NPJ Comput. Mater.7, 1–13. https://doi.org/10.1038/s41524-021-00508-6 (2021). arXiv:2011.04604.
Bartõk, A. P. & Csányi, G. Gaussian approximation potentials: A brief tutorial introduction. Int. J. Quantum Chem.115, 1051–1057. https://doi.org/10.1002/qua.24927 (2015). arXiv:1502.01366.
Deringer, V. L. et al. Gaussian process regression for materials and molecules. Chem. Rev. 121, 10073–10141. https://doi.org/10.1021/acs.chemrev.1c00022 (2021).
Vollmar, M. & Evans, G. Machine learning applications in macromolecular X-ray crystallography. Crystallogr. Rev. 27, 54–101. https://doi.org/10.1080/0889311X.2021.1982914 (2021).
Dragoni, D., Daff, T. D., Csányi, G. & Marzari, N. Achieving DFT accuracy with a machine-learning interatomic potential: Thermomechanics and defects in bcc ferromagnetic iron. Phys. Rev. Mater. 2, 013808. https://doi.org/10.1103/PhysRevMaterials.2.013808 (2018).
Imbalzano, G. & Ceriotti, M. Modeling the Ga/As binary system across temperatures and compositions from first principles. Phys. Rev. Mater. 5, 1–19. https://doi.org/10.1103/physrevmaterials.5.063804 (2021).
Smith, J. S. et al. Approaching coupled cluster accuracy with a general-purpose neural network potential through transfer learning. Nat. Commun. 10, 2903. https://doi.org/10.1038/s41467-019-10827-4 (2019).
Kubin, L. Dislocations, Mesoscale Simulations and Plastic Flow (Oxford University Press, 2013).
Bulatov, V., Abraham, F. F., Kubin, L. P., Devincre, B. & Yip, S. Connecting atomistic and mesoscale simulations of crystal plasticity. Nature 391, 669–672. https://doi.org/10.1038/35577 (1998).
Hull, R. Equilibrium theory of misfit dislocations networks. In Properties of Silicon Germanium and SiGe: Carbon (eds. Kasper, E. & Lyutovich, K.) 21–41 (Inspec, 2000).
Fitzgerald, E. A. Dislocations in strained-layer epitaxy: Theory, experiment, and applications. Mater. Sci. Rep. 7, 87–142. https://doi.org/10.1016/0920-2307(91)90006-9 (1991).
Fertig, R. S. & Baker, S. P. Simulation of dislocations and strength in thin films: A review. Prog. Mater Sci. 54, 874–908. https://doi.org/10.1016/j.pmatsci.2009.03.004 (2009).
Montalenti, F. et al. Dislocation-free SiGe/Si heterostructures. Crystals 8, 257. https://doi.org/10.3390/cryst8060257 (2018).
Bertin, N., Sills, R. B. & Cai, W. Frontiers in the simulation of dislocations. Annu. Rev. Mater. Res. 50, 437–464. https://doi.org/10.1146/annurev-matsci-091819-015500 (2020).
Salmenjoki, H., Alava, M. J. & Laurson, L. Machine learning plastic deformation of crystals. Nat. Commun. 9, 5307. https://doi.org/10.1038/s41467-018-07737-2 (2018).
Yang, Z. et al. Learning to predict crystal plasticity at the nanoscale: Deep residual networks and size effects in uniaxial compression discrete dislocation simulations. Sci. Rep. 10, 1–14. https://doi.org/10.1038/s41598-020-65157-z (2020).
Papanikolaou, S., Tzimas, M., Reid, A. C. E. & Langer, S. A. Learning crystal plasticity using digital image correlation: Examples from discrete dislocation dynamics (2019). arXiv:1709.08225.
Sills, R. B., Kuykendall, W. P., Aghaei, A. & Cai, W. Fundamentals of dislocation dynamics simulations. In Multiscale Materials Modeling for Nanomechanics, chap. 2 (eds. Weinberger, C. R. & Tucker, G. J.) 1–35 (Springer, 2016).
Rovaris, F., Bergamaschini, R. & Montalenti, F. Modeling the competition between elastic and plastic relaxation in semiconductor heteroepitaxy: From cyclic growth to flat films. Phys. Rev. B 94, 205304. https://doi.org/10.1103/PhysRevB.94.205304 (2016).
Rovaris, F. et al. Three-dimensional SiGe/Si heterostructures: Switching the dislocation sign by substrate under-etching. Phys. Rev. Mater. 1, 073602. https://doi.org/10.1103/PhysRevMaterials.1.073602 (2017).
Kissel, M. & Diepold, K. Sobolev training with approximated derivatives for black-box function regression with neural networks. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)11907 LNAI, 399–414. https://doi.org/10.1007/978-3-030-46147-8_24 (2020).
Hornik, K. Approximation capabilities of multilayer feedforward networks. Neural Netw. 4, 251–257. https://doi.org/10.1016/0893-6080(91)90009-T (1991).
Lanzoni, D., Rovaris, F. & Montalenti, F. Computational analysis of low-energy dislocation configurations in graded layers. Curr. Comput. Aided Drug Des. 10, 661. https://doi.org/10.3390/cryst10080661 (2020).
Hirth, J. & Lothe, J. Theory of Dislocations (Krieger Publishing Company, 1982).
Lardner, R. W. Mathematical Theory of Dislocations and Fracture (University of Toronto Press, 1974).
Cai, W., Arsenlis, A., Weinberger, C. R. & Bulatov, V. V. A non-singular continuum theory of dislocations. J. Mech. Phys. Solids 54, 561–587. https://doi.org/10.1016/j.jmps.2005.09.005 (2006).
Paszke, A. et al. PyTorch: An imperative style, high-performance deep learning library. arXiv (2019). arXiv:1912.01703.
Czarnecki, W. M., Osindero, S., Jaderberg, M., Swirszcz, G. & Pascanu, R. Sobolev training for neural networks. Adv. Neural Inf. Process. Syst.2017-December, 4279–4288 (2017). arXiv:1706.04859.
Kim, B. et al. Deep fluids: A generative network for parameterized fluid simulations. Comput. Graphi. Forum38, 59–70. https://doi.org/10.1111/cgf.13619 (2019). arXiv:1806.02071.
Marzegalli, A. et al. Critical shape and size for dislocation nucleation in Si1-xGex Islands on Si(001) A. Phys. Rev. Lett. 99, 235505. https://doi.org/10.1103/PhysRevLett.99.235505 (2007).
Gatti, R., Marzegalli, A., Zinovyev, V. A., Montalenti, F. & Miglio, L. Modeling the plastic relaxation onset in realistic SiGe islands on Si(001). Phys. Rev. B Condens. Matter Mater. Phys. 78, 1–12. https://doi.org/10.1103/PhysRevB.78.184104 (2008).
LeGoues, F. K., Reuter, M. C., Tersoff, J., Hammar, M. & Tromp, R. M. Cyclic growth of strain-relaxed islands. Phys. Rev. Lett. 73, 300–303. https://doi.org/10.1103/PhysRevLett.73.300 (1994).
Sakai, A., Taoka, N., Nakatsuka, O., Zaima, S. & Yasuda, Y. Pure-edge dislocation network for strain-relaxed SiGe/Si(001) systems. Appl. Phys. Lett. 86, 221916. https://doi.org/10.1063/1.1943493 (2005).
Taoka, N. et al. Growth and characterization of strain-relaxed SiGe buffer layers on Si(001) substrates with pure-edge misfit dislocations. Mater. Sci. Semicond. Process. 8, 131–135. https://doi.org/10.1016/j.mssp.2004.09.057 (2005).
Salvalaglio, M. & Montalenti, F. Fine control of plastic and elastic relaxation in Ge/Si vertical heterostructures. J. Appl. Phys. 116, 104306. https://doi.org/10.1063/1.4895486 (2014).
Isa, F. et al. From plastic to elastic stress relaxation in highly mismatched SiGe/Si heterostructures. Acta Mater. 114, 97–105. https://doi.org/10.1016/j.actamat.2016.05.014 (2016).
Isa, F. et al. Highly mismatched, dislocation-free SiGe/Si heterostructures. Adv. Mater. 28, 884–888. https://doi.org/10.1002/adma.201504029 (2016).
Head, A. K. Edge dislocations in inhomogeneous media. Proc. Phys. Soc. Sect. B 66, 793–801. https://doi.org/10.1088/0370-1301/66/9/309 (1953).
Rovaris, F. et al. Dynamics of crosshatch patterns in heteroepitaxy. Phys. Rev. B 100, 085307. https://doi.org/10.1103/PhysRevB.100.085307 (2019).
Spencer, B. J. & Tersoff, J. Stresses and first-order dislocation energetics in equilibrium Stranski–Krastanow islands. Phys. Rev. B 63, 205424. https://doi.org/10.1103/PhysRevB.63.205424 (2001).
Boioli, F. et al. Self-ordering of misfit dislocation segments in epitaxial SiGe islands on Si(001). J. Appl. Phys. 110, 044310. https://doi.org/10.1063/1.3611385 (2011).
Funding
F.R. acknowledges support from the European Union Horizon 2020 research and innovation programme (Grant Agreement No. 857470) and from the European Regional Development Fund via the Foundation for Polish Science International Research Agenda PLUS programme (Grant No. MAB PLUS/2018/8).
Author information
Authors and Affiliations
Contributions
Investigation, D.L.; software, D.L. and F.R.; supervision, F.R. and F.M.; writing—original draft, F.R. and D.L.; writing—review and editing, F.M.
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing interests.
Additional information
Publisher's note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
The original online version of this Article was revised: The Funding section in the original version of this Article was omitted. Full information regarding the correction made can be found in the correction for this Article.
Supplementary Information
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Lanzoni, D., Rovaris, F. & Montalenti, F. Machine learning potential for interacting dislocations in the presence of free surfaces. Sci Rep 12, 3760 (2022). https://doi.org/10.1038/s41598-022-07585-7
Received:
Accepted:
Published:
DOI: https://doi.org/10.1038/s41598-022-07585-7
- Springer Nature Limited