Abstract
In this article, the resistive switching (RS) behaviors in Lu2O3 thin film for advanced flexible nonvolatile memory applications are investigated. Amorphous Lu2O3 thin films with a thickness of 20 nm were deposited at room temperature by radio-frequency magnetron sputtering on flexible polyethylene terephthalate substrate. The structural and morphological changes of the Lu2O3 thin film were characterized by x-ray diffraction, atomic force microscopy, and x-ray photoelectron spectroscopy analyses. The Ru/Lu2O3/ITO flexible memory device shows promising RS behavior with low-voltage operation and small distribution of switching parameters. The dominant switching current conduction mechanism in the Lu2O3 thin film was determined as bulk-controlled space-charge-limited-current with activation energy of traps of 0.33 eV. The oxygen vacancies assisted filament conduction model was described for RS behavior in Lu2O3 thin film. The memory reliability characteristics of switching endurance, data retention, good flexibility, and mechanical endurance show promising applications in future advanced memory.
Background
Resistive switching (RS) behavior, which utilizes the resistance change effect of oxide material, has attracted considerable attention and been widely investigated due to its potential application in future nonvolatile memory (NVM) devices [1]. Several metal oxide materials including NiO [2], TiO2[3], Cu x O [4], and Al2O3[5] have been studied for resistive random access memory (ReRAM) applications. On the other hand, the flexible electronics are an emerging class of devices in an intriguing technological paradigm. The demand for flexible electronics is revived because of their inherit merits of low cost, light weight, excellent portability, and user-friendly interfaces over conventional rigid silicon technology [6]. Despite these advantages, there is very little in the works about the flexible and NVM devices because of the difficulty to satisfy the dual requirements of memory element. A major challenge for flexible electronics is the lack of good performance NVM devices fabricated at low temperature [7, 8]. The ReRAM shows promising memory performance on plastic flexible substrate when processed at low temperature, but the degradation behavior due to excessive mechanical and electrical stress, large switching power, and distribution is the basic limitation for high-density electronic applications [9–12]. It is expected that an achievement of such flexible- and nonvolatile-type memory device will be the next step toward the realization of flexible electronic systems. Recently, flexible resistive memories have been reported in various oxides including graphene oxide (GO) [13], HfO2[14], NiO [15], and single-component polymer [16] thin films. However, the huge dispersion in switching parameters, deprived reliability, and poor understanding of the RS behavior are some of the fundamental issues which hinder its application for high-density flexible electronics.
It is well articulate that the amorphous high-κ gate dielectrics, which have already been established to be promising for semiconductor transistor technologies, can be good alternative for ReRAM applications as long as such these materials can perform good RS behaviors. Rare earth metal oxides as high-κ dielectrics are considered as the replacement of hafnium-based technology [17–19], among which Lu2O3 is the promising one as it shows well-insulating property, large bandgap (5.5 eV), better hygroscopic immunity, good thermal stability, and adequate dielectric constant of approximately 11 [20]. Gao et al. reported promising unipolar RS behavior in amorphous Lu2O3 oxide [21]. In contrast, we previously demonstrated the bipolar RS in various high-κ rare earth metal oxides, such as Tm2O3, Yb2O3, and Lu2O3, on silicon substrate [22]. The different RS behavior may be originated from their distinguished morphological changes. However, no flexible memory device has been demonstrated and detail switching dynamics is still unclear in this material. The superior experimental switching characteristics in Lu2O3 and room temperature deposition process allow it to be a possible functional material for flexible electronics. Therefore, in this study we investigate the RS behaviors of the sputter deposited lutetium sesquioxide (Lu2O3) thin film on flexible substrate for nonvolatile flexible memory application. In addition, we demonstrate that the memory performance of ReRAM on a flexible substrate has excellent electrical and mechanical reliabilities due to the high ductility of amorphous Lu2O3 thin film and the merit of the low-temperature process. Unlike other typical flexible resistive memory, better RS characteristics were achieved for advanced flexible memory applications.
Methods
Flexible Ru/Lu2O3/ITO RS memory devices were fabricated on flexible polyethylene terephthalate (PET) substrates. The sputtered ITO-coated PET substrate was glued on a Si dummy wafer with polyimide tape to mechanically support the flexible substrate during fabrication process. The Lu2O3 thin films with a thickness of 20 nm were deposited by reactive radio frequency magnetron sputtering system in argon-oxygen (3:1) medium at room temperature from a Lu metal target. The chamber working pressure was maintained at 10 mTorr with the rf power of 130 W during deposition. The sputtering rate and time of the film were about 0.17 Å/s and 20 min, respectively. Finally, a 50-nm-thick square shape (100 × 100 μm2) Ru metal top electrode was deposited on the oxide films through shadow mask by DC sputtering technique operated at 10 mTorr in Ar environment.
The crystalline structure and the chemical compositions of the films were examined by x-ray diffraction (XRD) and x-ray photoelectron spectroscopy (XPS), respectively. The crystal structure of the Lu2O3/ITO film was determined in a Bruker-AXS D5005 diffractometer (Bruker Biosciences Inc., Billerica, MA, USA) using Cu Kα (λ = 1.542 Å) radiation. The composition and chemical bonding in the Lu2O3 film were analyzed using a Thermo Scientific Microlab 350 VG system (Thermo Fisher Scientific, Inc., Waltham, MA, USA) with a monochromatic Al Kα (1,486.7 eV) source. The surface of the Lu2O3 film was pre-sputtered using an Ar ion source. The chemical shifts in the spectra were corrected with reference to the C 1 s peak (from adventitious carbon) at a binding energy of 285 eV. Curve fitting was performed after Shirley background subtraction using a Lorentzian-Gaussian fitting. The roughness of the film was measured using an NT-MDT Solver P47 (NT-MDT Co., Zelenograd, Moscow, Russia). The atomic force microscope (AFM) was operated in the tapping mode for imaging. The electrical properties of the Ru/Lu2O3/ITO memory devices were measured by a semi-automated cascade measurement system equipped with Agilent E5260 high-speed semiconductor parameter analyzer (Agilent Technologies, Sta. Clara, CA, USA).
Results and discussion
The grazing incident XRD spectra recorded on 20-nm thick as deposited Lu2O3 films on ITO/PET are shown in Figure 1. No diffraction peak was observed from the Lu2O3 film deposited at room temperature, which indicates that the films remain in amorphous phase. To investigate the compositional changes of the oxide, XPS analyses were performed on Lu2O3 thin films. Adventitious hydrocarbon C 1 s binding energy was used as a reference to correct the energy shift of O 1 s and Lu 4d core levels due to differential charging phenomena. The core levels of O 1 s and Lu 4d spectra with their appropriate peak curve-fitting lines for the Lu2O3 thin film are shown in Figure 2a,b, respectively. The O 1 s spectrum at the surface of Lu2O3 thin film consists of two binding energy peaks: a low binding energy peak at 529.2 eV for Lu2O3 and a high binding energy peak at 531.4 eV, usually attributed to oxide defects or nonlattice oxygen ions [23, 24]. The Lu 4d line spectrum consists of a higher binding energy peak at 196 eV for Lu2O3 and a lower binding energy peak at 194.4 eV, which is attributed to the existence of Lu ions in the oxide thin film [23]. The presence of Lu ionic peak in Lu 4d line spectrum can be attributed to the formation of chemical defects, most probably the oxygen vacancies. Figure 3 shows the AFM images of 20-nm-thick Lu2O3 film. The rms value obtained by AFM observation was 1.82 nm. The lower surface roughness may result in better uniformity and higher yield of the fabricated memory devices.
In order to investigate the memory performance of the flexible Ru/Lu2O3/ITO ReRAM cell, the RS characteristics were analyzed. A high bias voltage with predefined current compliance (ICC) of 100 μA was applied to the pristine memory cell to initiate the RS into the Lu2O3 thin film, as shown in Figure 4a. ICC is required to protect the device from hard breakdown. During this initial bias sweeping, a sudden abrupt decrease in oxide conductance was observed, which is known as soft breakdown or electroforming process. A nanomorphological change into the oxide layer is assumed due to the introduction of a high oxygen vacancy density of the oxide thin films [25]. After the electroforming process, the memory device switches to low-resistance state (LRS). To change the resistance state of the memory device, a sufficient positive bias of certain value (Vreset) was applied and the devices transform to high-resistance state (HRS), as shown in Figure 4b. In contrast, an application of negative bias results in a transition from HRS to LRS at certain set voltage (Vset) and this effect is reproducible over several hundreds of voltage sweeping cycles. As can be seen that the Ru/Lu2O3/ITO ReRAM cell can be switched between two distinguished resistance state (HRS to LRS and vice versa), at a very low voltage of approximately 0.8 V (100 μA set current) and approximately 1.2 V (<1 mA reset current) for set and reset operations, respectively. The lower switching voltage is believed due to the low power hopping conduction via oxide defects [7]. In order to realize the current conduction mechanism into the Lu2O3 thin film, both HRS and LRS current–voltage (I-V) characteristics at different temperature were analyzed.
Analysis of the RS characteristics of Ru/Lu 2 O 3 /ITO ReRAM device. (a) The electroforming process of the Ru/Lu2O3/ITO ReRAM device with current compliance of 100 μA. Shaded area shows the typical RS behavior after electroforming process. (b) Enlarged view of the shaded region showing promising RS characteristics of the Ru/Lu2O3/ITO ReRAM device.
Figure 5 shows the resistance variation of the memory device at different resistance states at different temperatures ranging from 303 to 353 K. In HRS, the resistance value decreases as the temperature increase to 353 K. These results can be associated with a semiconducting/oxide-like behavior of the oxide film. On the other hand, the LRS increases with increasing the temperature, indicating the formation of a metallic-like filament by percolation of oxygen vacancies and other ionic and electronic defects within or near the interface area [26]. Therefore, oxide defects mainly oxygen-vacancies-mediated filament conduction is believed to influence the RS behavior in the Ru/Lu2O3/ITO ReRAM device. The current conduction behavior at HRS and LRS is further analyzed. The double-logarithmic plot of room temperature I-V data at HRS for Lu2O3 thin film shows ohmic (I ∞ V) and quadratic (I ∞ V2) in Figure 6. Therefore, space-charge-limited-current (SCLC) conduction is dominant in Lu2O3 thin dielectric. For a single trap level, the SCLC conduction mechanism can be explained as follows [27, 28]:
where q is an electronic charge, n0 is the effective free carrier density of traps in thermal equilibrium, μ is the electronic mobility of oxide, tox is the oxide thickness, V is the externally applied voltage, ϵ 0 is the permittivity of free space, and ϵ r is the dynamic dielectric. For an applied voltage across the oxide below 1.0 V, the slope of the logI- logV characteristic is on the order of 1.0 to approximately 2.0, which implies ohmic conduction, because the numbers of the injected electrons are lower compared to the thermally generated free electrons density (n0) inside the oxide film. When the applied voltage is higher than 1.0 V, the slopes are larger (≥2), which implies SCLC conduction. A transition from ohmic to SCLC region is observed when the injected carrier density exceeds the volume-generated free carrier density. The SCLC transition voltage can be expressed as follows [27, 28]:
where θ is the ratio of free to total carrier density, Nc is the density of state in the conduction band, g n is the degeneracy of the energy state in the conduction band, Nt is the trap density, k B is the Boltzmann constant, and Et and Ec are the trap and conduction band energy level, respectively. By further increasing the applied voltage, more carriers will be injected from the injecting electrode and a space charge region appears near the injecting electrode interface so that the injected excess carriers dominate the thermally generated charge carrier and hence the current increases rapidly.
Figure 7a shows the I-V characteristics of Lu2O3 thin film at different temperatures. The measured transition voltage (Vtr) obtained from the I-V characteristics is depicted in Figure 7(b). It can be seen that the Vtr decreases with increasing temperature, suggesting that the thermal generation of the carrier increases with temperature. Relatively lower voltage is required to fill all the trap levels at higher temperature and hence Vtr decreases. The trapping level in the Lu2O3 thin film can be determined from the Arrhenius plot of the current for different electric fields. The activation energy (Ea) was calculated from the slope ln(I)-1/T plot to be about 0.33 eV, as shown in Figure 8. The LRS I-V curves of Lu2O3 ReRAM devices were plotted on the logarithmic scale, as shown in Figure 9. The linear behavior of I-V curve of the ReRAM devices with a nearly constant slope value of approximately 1.01 suggests that the ohmic conduction is dominant in LRS conduction. This may be due to stochastic filament formation by accumulated oxide defects/vacancies into the Lu2O3 film [29].
Figure 10 depicts the memory switching characteristics for successive switching cycle. The resistance ratio between two memory states in Ru/Lu2O3/ITO ReRAM cell is maintained more than 103 during the continuous memory switching, which is useful for NVM applications. Additionally, a good uniformity in resistance values at HRS and LRS was observed. This may be due to the smoother surface roughness of the Lu2O3 film. Good switching and device uniformity in memory device are an important factor for flexible ReRAM devices. Very few literatures have been reported on cycle-to-cycle (C2C) distribution (switching uniformity) of flexible NVM applications [10, 30–32]. However, device-to-device (D2D) distribution (device uniformity) among different devices is very crucial for successful implementation of NVM technology. Figure 11 shows the Weibull distribution of switching voltages and resistance values of the Ru/Lu2O3/ITO ReRAM device. Randomly selected 15 ReRAM cells were measured for 100 switching cycle of each device. A very small dispersion was observed in both parameters as shown.
To understand the potentiality of Ru/Lu2O3/ITO flexible memory device, the reliability characteristics of impulse switching endurance, data retention, and mechanical endurance were characterized. Figure 12 shows the pulse switching endurance characteristics of the flexible memory device under ±2 V of impulse voltages, measured at room temperature and 85°C. After each pulse switching a reading voltage pulse of 0.1 V was applied for reading operation. The Ru/Lu2O3/ITO flexible memory device can be switched over 103 program/erase (P/E) cycle maintaining a memory window of approximately 103 at both room temperature and 85°C. Figure 13 shows the data retention characteristics of the Lu2O3 flexible memory devices after cyclic measurement at both room temperature and 85°C. Good data retention of 105 s is obtained. A small fluctuation is observed at elevated temperature for endurance and retention test. This may be attributed to the generation and redistribution of oxide defects in the switching material [7, 33] due to increase stress and temperature. In retention characteristics, a degradation behavior in memory window was observed, though a well resolved memory window of approximately 10 after 105 s is maintained. This can be explained by the stress-induced leakage current via generated defects in the oxide thin films [7]. The flexibility and mechanical endurance are the key parameter for flexible electronic applications. The flexibility and mechanical endurance were also experienced for Ru/Lu2O3/ITO memory devices, as shown in Figure 14a,b, respectively. It was observed that good flexibility and mechanical endurance can be achieved in both devices. This may be due to the high ductility of thin Ru metal electrodes and the amorphous Lu2O3 oxide film in ReRAM structure. In addition, good mechanical endurance is also achieved up to 104 of the bending cycle. The mechanical stress is applied by bending the Ru/Lu2O3/ITO flexible ReRAM device to a small 10-mm radius at every second, and the resistances were measure after each 1,000 bending cycle. As shown in Figure 14b, the device reveals a well-resolved memory window of approximately 102 after 104 of continuous bending cycle, indicating good flexibility of the Ru/Lu2O3/ITO ReRAM cell. The superior switching characteristics of the Ru/Lu2O3/ITO flexible ReRAM device show the potential for future flexible low-power electronic applications.
Conclusions
In this work, the RS behavior in the Lu2O3 thin films on flexible PET substrate is explored for advanced flexible nonvolatile random access memory applications. The current conduction mechanism is dominated by the bulk-limited SCLC conduction in HRS and the ohmic-like conduction in LRS. A shallow trap level at 0.33 eV below the conduction band was evaluated in Lu2O3 thin films. The filament conduction via oxide defects was described for the RS behavior in the Lu2O3 thin films on ITO/PET substrate. Low-voltage RS and good device uniformity were obtained in the Ru/Lu2O3/ITO flexible ReRAM cell. Good memory reliability characteristics of switching endurance, data retention, flexibility, and mechanical endurance were promising for future memory applications. The superior switching behaviors in Ru/Lu2O3/ITO flexible ReRAM device have great potential for future advanced nonvolatile flexible memory applications.
References
Bersuker G, Gilmer DC, Veksler D, Kirsch P, Vandelli L, Padovani A, Larcher L, McKenna K, Shluger A, Iglesias V, Porti M, Nafria M: Metal oxide resistive memory switching mechanism based on conductive filament properties. J Appl Phys 2011, 110: 124518. 10.1063/1.3671565
Russo U, Ielmini D, Cagli C, Lacaita AL: Filament conduction and reset mechanism in NiO-based resistive-switching memory (RRAM) devices. IEEE Trans Electron Devices 2009, 56: 186–192.
Jeong HY, Kim SK, Lee JY, Choi SY: Impact of amorphous titanium oxide film on the device stability of Al/TiO2/Al resistive memory. Appl Phys A 2011, 102: 967–972. 10.1007/s00339-011-6278-3
Ebrahim R, Wu N, Ignatiev A: Multi-mode bipolar resistance switching in CuxO films. J Appl Phys 2012, 111: 034509. 10.1063/1.3682086
Wu Y, Yu S, Lee B, Wong P: Low-power TiN/Al2O3/Pt resistive switching device with sub-20 μA switching current and gradual resistance modulation. J Appl Phys 2011, 110: 094104. 10.1063/1.3657938
Kim S, Jeong HY, Kim SK, Choi SY, Lee KJ: Flexible memristive memory array on plastic substrates. Nano Lett 2011, 11: 5438–5442. 10.1021/nl203206h
Cheng CH, Yeh FS, Chin A: Low-power high-performance non-volatile memory on a flexible substrate with excellent endurance. Adv Mater 2011, 23: 902–905. 10.1002/adma.201002946
Seo JW, Park JW, Lim KS, Kang SJ, Hong YH, Yang JH, Fang L, Sung GY, Kim HK: Transparent flexible resistive random access memory fabricated at room temperature. Appl Phys Lett 2009, 95: 133508. 10.1063/1.3242381
Jeong HY, Kim YI, Lee JY, Choi SY: A low-temperature-grown TiO2-based device for the flexible stacked RRAM application. Nanotechnology 2010, 21: 115203. 10.1088/0957-4484/21/11/115203
Kim S, Choi YK: Resistive switching of aluminum oxide for flexible memory. Appl Phys Lett 2008, 92: 223508. 10.1063/1.2939555
Kim S, Moon H, Gupta D, Choi S, Choi YK: Resistive switching characteristics of sol–gel zinc oxide films for flexible memory applications. IEEE Trans Electron Devices 2009, 56: 696–699.
Wang ZQ, Xu HY, Li XH, Zhang XT, Liu YX, Liu YC: Flexible resistive switching memory device based on amorphous InGaZnO film with excellent mechanical endurance. IEEE Electron Device Lett 2011, 32: 1442–1444.
Hong SK, Kim JE, Kim SO, Choi SY, Cho BJ: Flexible resistive switching memory device based on graphene oxide. IEEE Electron Device Lett 2010, 31: 1005–1007.
Fang RC, Wang LH, Yang W, Sun QQ, Zhou P, Wang PF, Ding SJ, Zhang DW: Resistive switching of HfO2 based flexible memories fabricated by low temperature atomic layer deposition. J Vac Sci Technol B 2012, 30: 020602. 10.1116/1.3694003
Yu Q, Liu Y, Chen TP, Liu Z, Yu YF, Lei HW, Zhu J, Fung S: Flexible write-once–read-many-times memory device based on a nickel oxide thin film. IEEE Trans Electron Devices 2012, 59: 858–862.
Kuang Y, Huang R, Tang Y, Ding W, Zhang L, Wang Y: Flexible single-component-polymer resistive memory for ultrafast and highly compatible nonvolatile memory applications. IEEE Electron Device Lett 2010, 31: 758–760.
He G, Sun Z: High-k Gate Dielectrics for CMOS Technology. Germany: Wiley-VCH; 2012:111.
Wilk GD, Wallace RM, Anthony JM: High-κ gate dielectrics: current status and materials properties considerations. J Appl Phys 2001, 89: 5243–5275. 10.1063/1.1361065
Lopes JMJ, Roeckerath M, Heeg T, Rije E, Schubert J, Mantl S, Afanasev VV, Shamuilia S, Stesmans A, Jia Y, Schlom DG: Amorphous lanthanum lutetium oxide thin films as an alternative high-κ gate dielectric. Appl Phys Lett 2006, 89: 222902. 10.1063/1.2393156
Darmawan P, Lee PS, Setiawan Y, Lai JC, Yang P: Thermal stability of rare-earth based ultrathin Lu2O3 for high-k dielectrics. J Vac Sci Technol B 2007, 25: 1203–1207. 10.1116/1.2749526
Gao X, Xia Y, Xu B, Kong J, Guo H, Li K, Li H, Xu H, Chen K, Yin J, Liu Z: Unipolar resistive switching behaviors in amorphous lutetium oxide films. J Appl Phys 2010, 108: 074506. 10.1063/1.3490758
Pan TM, Lu CH, Mondal S, Ko FH: Resistive switching characteristics of Tm2O3, Yb2O3, and Lu2O3-based metal–insulator–metal memory devices. IEEE Trans Nanotechnol 2012, 11: 1040–1046.
Nefedov VI, Gati D, Dzhurinskii BF, Sergushin NP, Salyn YV: X-ray electron study of oxides of elements. Zhur Neorg Khim 1975, 20: 2307–2314.
Mondal S, Chen HY, Her JL, Ko FH, Pan TM: Effect of Ti doping concentration on resistive switching behaviors of Yb2O3 memory cell. Appl Phys Lett 2012, 101: 083506. 10.1063/1.4747695
Walczyk C, Walczyk D, Schroeder T, Bertaud T, Sowinska M, Lukosius M, Fraschke M, Wolansky D, Tillack B, Miranda E, Wenger C: Impact of temperature on the resistive switching behavior of embedded HfO2-based RRAM devices. IEEE Trans Electron Devices 2011, 58: 3124–3131.
Tseng HC, Chang TC, Huang JJ, Yang PC, Chen YT, Jian FY, Sze SM, Tsai MJ: Investigating the improvement of resistive switching trends after post-forming negative bias stress treatment. Appl Phys Lett 2011, 99: 132104. 10.1063/1.3645004
Chiu FC: Electrical characterization and current transportation in metal/Dy2O3/Si structure. J Appl Phys 2007, 102: 044116. 10.1063/1.2767380
Chiu FC, Chou HW, Lee JY: Electrical conduction mechanisms of metal/La2O3/Si structure. J App Phys 2005, 97: 103503. 10.1063/1.1896435
Chen C, Yang YC, Zeng F, Pan F: Bipolar resistive switching in Cu/AlN/Pt nonvolatile memory device. Appl Phys Lett 2010, 97: 083502. 10.1063/1.3483158
Lee S, Kim H, Yun DJ, Rhee SW, Yong K: Resistive switching characteristics of ZnO thin film grown on stainless steel for flexible nonvolatile memory devices. Appl Phys Lett 2009, 95: 262113. 10.1063/1.3280864
Hackett NG, Hamadani B, Dunlap B, Suehle J, Richter C, Hacker C, Gundlach D: A flexible solution-processed memristor. IEEE Electron Device Lett 2009, 30: 706–708.
Kim S, Yarimaga O, Choi SJ, Choi YK: Highly durable and flexible memory based on resistance switching. Solid-State Electron 2010, 54: 392–396. 10.1016/j.sse.2009.10.021
Shen W, Dittmann R, Breuer U, Waser R: Improved endurance behavior of resistive switching in (Ba, Sr)TiO3 thin films with W top electrode. Appl Phys Lett 2008, 93: 222102. 10.1063/1.3039809
Acknowledgement
This work was supported by the National Science Council (NSC) of Republic of China under contract no. NSC-102-2221-E-182-072-MY3.
Author information
Authors and Affiliations
Corresponding author
Additional information
Competing interests
The authors declare that they have no competing interests.
Authors’ contributions
SM designed the experiment, measured the data of the Ru/Lu2O3/ITO flexible ReRAM cell, and drafted the manuscript. JLH and KK provided useful suggestions and helped analyze the characterization results. TMP supervised the work and finalized the manuscript. All authors read and approved the final manuscript.
Authors’ original submitted files for images
Below are the links to the authors’ original submitted files for images.
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 2.0 International License ( https://creativecommons.org/licenses/by/2.0 ), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
About this article
Cite this article
Mondal, S., Her, JL., Koyama, K. et al. Resistive switching behavior in Lu2O3 thin film for advanced flexible memory applications. Nanoscale Res Lett 9, 3 (2014). https://doi.org/10.1186/1556-276X-9-3
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/1556-276X-9-3