Abstract
Photoacoustic imaging has the advantages of high contrast and deep imaging depth. However, with the increasing of imaging depth, the signal-to-noise ratio (SNR) of the detected signal decreases, due to the light scattering that seriously affects the recovery image quality. In this paper, we experimentally demonstrated that higher contrast photoacoustic imaging was achieved using photoacoustic wavefront shaping technology in the presence of light scattering and low SNR signals. The imaging contrast is improved from 1.51 to 5.30. More importantly, we propose a dynamic time window method for the photoacoustic signal extraction algorithm, named correlation detection of adaptive time window, which further improves the contrast of photoacoustic imaging to 9.57. Our method effectively improves the contrast of photoacoustic imaging through scattering media.
Similar content being viewed by others
Introduction
Photoacoustic imaging technology is one of the research focuses in microscopic imaging. Biological tissue absorbs pulse laser to excite thermal expansion to produce an outwardly radiated ultrasonic signal, a phenomenon known as photoacoustic effect1. Photoacoustic imaging utilizes ultrasonic signals in photoacoustic effect for imaging. Common optical imaging methods are affected by scattering property of biological tissue, and have shallow imaging depth. Different from optical imaging methods, the scattering of ultrasound is two to three orders of magnitude weaker than the light scattering in biological tissue2, so the penetration depth of photoacoustic imaging is deeper than that of optical imaging methods. Besides, photoacoustic imaging also has the advantage of high contrast1. In recent years, photoacoustic imaging technology has been widely applied in the field of biomedicine. It provides very promising application in the research of blood vessels testing, cancer detection and so on3,4,5. However, in the deeper region of the tissue, the incident light (the pulse laser utilized to excite the photoacoustic signal) is seriously scattered. And with the increasing of imaging depth, the light scattering becomes more severe. This scattering seriously reduces the energy of the pulse laser utilized to excite the photoacoustic signal, resulting in a low signal-to-noise ratio (SNR) of the photoacoustic signal. Traditional photoacoustic imaging methods rarely consider the influence of scattering of the incident light6,7.
The emergence of wavefront shaping technology makes it possible to use diffuse light for focusing and imaging, which can actually improve the imaging depth8. By modulating the amplitude and phase of the incident light before it arrives at scattering media, an optical focus can be formed behind the scattering media. Photoacoustic wavefront shaping technology combining photoacoustic effect and wavefront shaping uses the ultrasonic signal generated by photoacoustic effect as a noninvasive feedback signal to modulate the incident light, and can achieve high contrast imaging and improve imaging depth. Caravaca-Aguirre A. M. et al. combined photoacoustic imaging and wavefront shaping to effectively improve the spatial resolution of imaging9. Conkey D. B. et al. further improved the resolution of the photoacoustic wavefront shaping imaging by using the spatially non-uniform sensitivity of the focused ultrasound transducer to the focus region10. However, most of the wavefront modulate devices used in the study are liquid crystal spatial light modulators (SLMs)9,10. And it is difficult to apply in living tissue with short decorrelation time due to the limitation of the low refresh rate of SLM (~100 Hz). Digital micromirror device (DMD) whose refresh rate is 22 kHz can greatly improve the speed of optimization. Yet compared to SLM (<40 mJ/cm2), the light intensity threshold of DMD surface is lower (<200 μJ/cm2). As a result, the energy of the incident light used for exciting the ultrasound is lower, which leads to a lower SNR of the photoacoustic signal11. In wavefront shaping process, the wavefront of the incident light are optimized, and the light intensity of the focus in the biological tissue is improved, so the amplitude of the photoacoustic signal gets enhancement. The essence of imaging based on photoacoustic signals captured by ultrasound transducers is the procedure of digital signal processing. In previous studies, the peak-to-peak value of the photoacoustic signal was directly used as a reference for the optical focus optimization during imaging. Even so, the clutters generated by devices’ electrostatic and amplifier noise still have a great influence on the imaging contrast of final recovered image.
In this paper, we experimentally demonstrated that higher contrast photoacoustic imaging was achieved using photoacoustic wavefront shaping technology in the presence of light scattering and low SNR signals. The imaging contrast is improved from 1.51 to 5.30. More importantly, we propose a dynamic time window method for the photoacoustic signal extraction algorithm, named correlation detection of adaptive time window. Our method eliminates the interference of clutters and noise. Besides, our method eliminates the time deviation of photoacoustic signals from different positions to ultrasound transducer. The contrast of photoacoustic imaging is further improved to 9.57. Our method effectively improves the contrast of photoacoustic imaging through scattering media.
Experimental Setup
The experimental configuration is shown in Fig. 1. The optical pluses emitted from a commercial pulse laser source (LABest, SGR-10) have a 532 nm wavelength with a repetition rate of 10 Hz and a pulse energy of ~800 μJ. The laser beam was expanded and collimated, then it was reflected by the mirror onto the DMD (Texas Instruments, DLP6500). The light reflected by the DMD was constricted and filtered by a 4 f system and then was focused by the objective lens (10 × , NA = 0.25) onto the scattering diffuser (Edmund, Diffuser 83419). A portion of the beam was split into the photodiode (Hamamatsu Photonics, S5971) to compensate for the energy fluctuations of the pulse laser. The photoacoustic signals were generated from an absorber embedded in an agarose gel. The absorber used in our experiment was 100 μm diameter black nylon thread, which was placed 2.5 cm behind the scattering diffuser to produce speckles approximate to the absorber. Similarly, in order to improve the optimization results, the speckle size set in the experiment matched the size of the absorber. The resolution of the imaging system was also determined by the speckle size9. A 20 MHz ultrasound transducer (Olympus, V317) was used to collect the photoacoustic signals. The photoacoustic signals were amplified by the amplifier (Mini-Circuits, ZFL-500LN + ) and then acquired by the oscilloscope (LeCroy, 806Zi-A). The computer dealt with the data digitized by the oscilloscope in real-time and refreshed the mask of the DMD according to the photoacoustic feedback signal. The water tank was placed on a two-dimensional translation stage (Daheng, GCD-203050M/301101 M) and moved in the x-z plane.
Experimental configuration. BS: Beam splitter; PD: Photodiode; L1, L2, L3, L4: Lens; M: Mirror; SF: Spatial filter; OL: Objective lens; S: Scattering diffuser; UST: Ultrasound transducer; The absorber is embedded in an agarose gel and placed in a water tank. The absorber is perpendicular to both the laser irradiation direction and the axial direction of UST. The blue line denotes the circuit part in the experiment.
In the wavefront shaping process, the incident light was optimized by genetic algorithm to enhance the amplitude of the photoacoustic signals. Genetic algorithm used photoacoustic signals as feedback signals12. Random masks were generated as the initial populations, which were ranked in descending order by the fitness of the initial populations. In the experiment, the fitness value was the peak-to-peak value of the photoacoustic signal acquired by the oscilloscope. Masks with high fitness values in each generation were easier to be selected by PC to generate next generation by crossing and mutating, and were loaded on the DMD. Through multiple iterations, an optimal mask, i.e., the mask with the largest peak-to-peak value of photoacoustic signal at the target point, was obtained13. In the experiment, we set 80 generations, and each generation contains 50 populations. The result of wavefront shaping optimization is shown in Fig. 2, in which the peak-to-peak value of photoacoustic signal reaches about 4 through 80 iterations and the photoacoustic signal is enhanced by about 8.05 times. After wavefront shaping optimization, DMD constantly displayed the optimal mask during scanning and imaging.
Genetic algorithm optimization process. (a) is the evolution curve of the genetic algorithm, and (b) is the comparison of the photoacoustic signals before and after optimization. The blue line and the red line represent the photoacoustic signal before and after wavefront shaping optimization, respectively.
Scanning and Imaging
After the enhancement of the photoacoustic signal by wavefront shaping optimization, we experimentally demonstrated two-dimensional scanning and imaging. We kept the scattering diffuser and the ultrasound transducer at a fixed position. The absorber and the water tank moved with the x-z two-dimensional translation stage.
We scanned four crossed nylon threads before and after wavefront shaping optimization respectively. The photoacoustic signal amplitude, recorded from each position (x-z plane), was processed to reconstruct the 2D maximum intensity projection of the four crossed nylon threads. The imaging results are shown in Fig. 3(a,b). In order to evaluate the contrast of the image, one can use a contrast calculation formula, known as the Weber contrast, defined as14:
where I and Ib represent the luminance of the image and the background, respectively. The contrast of the image before wavefront shaping is 1.51, and the contrast of the image after wavefront shaping is 5.30. Since the energy of the speckle field is relatively dispersed before wavefront shaping, the image of the pre-optimized image has a poor imaging resolution and low contrast. After wavefront shaping optimization, the scattered light is focused on the absorber, and the resolution and contrast of the image are improved effectively. However, due to the presence of clutters and Gaussian white noise, the contrast of image is not satisfactory. The normalized 1D scans at the x = 1.60 mm profile (white dashed line) of Fig. 3(a,b) are shown in Fig. 3(c,d). From the 1D scans, we can also see that the contrasts of the images are poor due to the interference of clutters and Gaussian white noise. The clutters were caused by the devices’ electrostatic and amplifier noise during the experiment. Figure 4 shows a photoacoustic signal mixed with clutters acquired by the oscilloscope. The signal in the red block is the photoacoustic signal, and the signals in the blue blocks are the clutters. Clutters appear randomly in the time domain. When clutters and photoacoustic signal overlap in the time domain, the waveform and the amplitude of the photoacoustic signal will be seriously affected.
In order to eliminate the interference of clutters and noise and improve the imaging contrast, we applied a photoacoustic signal extraction algorithm based on wavelet de-noising and correlation detection in the scanning and imaging process. Details about the photoacoustic signal extraction algorithm are given in our previous paper15. Firstly, the signal was de-noised by wavelet de-noising to remove Gaussian white noise. The mother wavelet was a fourth-order daubechies wavelet similar to our photoacoustic signal waveform16. Then, the correlation detection was used to calculate the correlation coefficient between each acquired signal and the template signal. The normalized correlation coefficient is calculated as equation17:
where γxy is the normalized correlation coefficient, N is the number of points of the template signal, x(n) are the template signal points, y(n) are the signal points under analysis, \(\bar{x}\) is the mean of the template signal points, and \(\bar{y}\) is the mean of signal points. The value of the normalized correlation coefficient is between −1 and 1, and 1 denotes the exact match between the signal under analysis and the template signal. In the experiment, the signal whose correlation coefficient was lower than the threshold value, that is, the photoacoustic signal was interfered by clutters, was filtered out. The photoacoustic signals of each position were collected five times, and the average values of the peak-to-peak value of these signals were calculated as the maximum intensity projection of the image. The template signal used for correlation detection was the photoacoustic signal at the first point of the image and the threshold value of the correlation coefficient was 0.7. The imaging result is shownin Fig. 5(a), which is a projection image of the maximum intensity of the photoacoustic signal at each position. In scanning and imaging, we obtained photoacoustic signals at each position and calculated their peak-to-peak values (the maximum value of the signal minus the minimum value) as the maximum intensity of their photoacoustic signals, then normalized the maximum intensities of these signals as a recovered photoacoustic image. We find that wavelet de-noising and correlation detection can effectively eliminate clutters and Gaussian white noise. However, after applying the photoacoustic signal extraction algorithm, at the position where photoacoustic signal should be extracted by the photoacoustic signal extraction algorithm, the photoacoustic signal cannot be recognized. It should be noted that the extraction of photoacoustic signals in Fig. 3(a,b) did not apply wavelet de-noising and correlation detection, so this problem did not occur.
The photoacoustic signal waveforms at the first point (red circle) and at the 2340th point (blue circle) of Fig. 5(a) are shown in Fig. 5(b,c), respectively. We can see that the relative time of these two signals has a deviation in time domain (black dashed lines in Fig. 5(b,c)). In fact, the ultrasound transducer used in the experiment has a focal region of 200 μm and the nylon thread has a diameter of 100 μm. Therefore, during scanning and imaging, the change of the relative position of the absorber and the ultrasound transducer causes the change of the time of the photoacoustic signal transmitting to the ultrasound transducer. Although the photoacoustic signals at the two positions are similar, the correlation coefficient between these two signals is very low (−0.6719, Fig. 5(b,c)). This is mainly due to the different time the transducer receives the signal. Eventually, at the position where photoacoustic signal should be extracted, the photoacoustic signal cannot be recognized.
Figure 6 shows the relationship between the correlation coefficient of the photoacoustic signal and template signal versus their relative time, in which a positive relative time value indicates that the signal is acquired after the template and a negative relative time value indicates that the signal is acquired before the template. From the figure we can see that, with the changing of relative time, the correlation coefficient of the photoacoustic signal and the template signal fluctuates between −0.7 and 1. The negative value of the correlation coefficient is mainly caused by the fact that the crest of the photoacoustic signal overlaps with the trough of the template signal. In our experiments, different waveforms of the photoacoustic signals and the noises were collected, and their correlation coefficients were calculated. The correlation coefficients for the photoacoustic signals corresponding to different masks are above 0.8, and the correlation coefficients between photoacoustic signals and noises are below 0.4. Therefore, we set the correlation coefficient threshold to 0.7. If the correlation coefficient of template signal and photoacoustic signal is lower than the threshold value, the photoacoustic signal extraction algorithm will recognize it as a clutter and filter it out.
To solve this problem, we propose a dynamic time window method for the photoacoustic signal extraction algorithm, named correlation detection of adaptive time window. The method dynamically finds the lowest point of the photoacoustic signal, which is used as the reference point to select the time window. Thus, the influence on the correlation coefficient caused by the difference in relative time of the photoacoustic signal and template signal is eliminated.
The correlation coefficient between the photoacoustic signal and the template signal at the corresponding white dashed line in Fig. 3(b) is shown in Fig. 7(a). Figure 7(b) shows the values of the correlation coefficients using correlation detection of adaptive time window. Through the adaptive window method, the correlation coefficient between the photoacoustic signal and the template signal is significantly improved. And signals can be effectively distinguished from the clutters by setting an appropriate threshold value. Figure 7(c) shows the final recovered image of the extracted photoacoustic signals using correlation detection of adaptive time window. The contrast of Fig. 7(c) is calculated to be 9.57. Due to the application of correlation detection of adaptive time window, clutters and noise are well filtered out. Figure 7(d) is the 1D scan of the image at the white dashed line position x = 1.60 mm, which further demonstrates the improvement of imaging contrast.
Figures of using correlation detection of adaptive time window. (a,b) indicate the correlation coefficient without using adaptive time window and with using adaptive time window (the white dashed line of Fig. 3(b)) respectively. (c) is the final recovered image of the extracted photoacoustic signals using correlation detection of adaptive time window. (d) is the normalized 1D scan of white dashed lines in (c).
Discussion and Conclusion
In this experiment, the wavefront shaping process takes about 30 minutes, and the scanning and imaging process takes about 1 hour. Applying wavelet de-noising and correlation detection of adaptive time window, we do not need to spend more time to acquire a large number of photoacoustic signals for averaging to improve the SNR. Currently, the speed of focusing and imaging is mainly limited by the low pulse laser repetition rate. With a higher repetition rate laser source and a faster calculating device (e.g. FPGA), sub-second optimization of the incident light may be implemented18.
We have experimentally demonstrated the ability to focus light through scattering media using a faster wavefront modulation device (DMD). We obtained the optimal DMD mask by wavefront shaping. The amplitude of the photoacoustic signal is enhanced by about 8.05 times compared to using a random mask. Different from SLM, DMD can only modulate the amplitude of incident light, which leads to a lower enhancement of photoacoustic signals after wavefront shaping, but its faster refresh rate reduces the experimental time. We further demonstrated the ability to scan and image using enhanced photoacoustic signals. The pulse laser is seriously scattered before the wavefront shaping, so the resolution and contrast of the image are poor. After wavefront shaping, the energy of the speckle field is concentrated, thereby improving the resolution and contrast of the image. After wavefront shaping, we improved the contrast of photoacoustic imaging from 1.51 to 5.30.
Furthermore, we applied the photoacoustic signal extraction algorithm based on wavelet de-noising and correlation detection to photoacoustic imaging. In complex electromagnetic environment, clutters and noise exist everywhere and are severe. Our proposed focusing and imaging methods can effectively eliminate the interference of clutters and noise. Considering the situation that the change of the relative position of the absorber and the ultrasound transducer causes the change of the time of the photoacoustic signal transmitting to the ultrasound transducer, we propose a dynamic time window method for the photoacoustic signal extraction algorithm, named correlation detection of adaptive time window. Our method eliminates the time deviation of photoacoustic signals from different positions to ultrasound transducer. Correlation detection of adaptive time window further improves the contrast of photoacoustic imaging to 9.57. Our method effectively improves the contrast of photoacoustic imaging through scattering media.
References
Xu, M. & Wang, L. V. Photoacoustic imaging in biomedicine. Review of Scientific Instruments 77, 041101 (2006).
Duck, F. Physical properties of tissues: A comprehensive reference book. (Academic press, 2013).
Lu, T. & Zang, H. Photoacoustic tomography of micro-blood vessels in tissue mimicking phantom. 2010 3rd International Conference on Biomedical Engineering and Informatics, Yantai, 456–458 (2010).
Agarwal, A. et al. Targeted gold nanorod contrast agent for prostate cancer detection by photoacoustic imaging. Journal of Applied Physics 102, 064701 (2007).
Li, W. et al. In vivo photoacoustic imaging of brain injury and rehabilitation by higheffcient nearinfrared dye labeled mesenchymal stem cells with enhanced brain barrier permeability. Advanced Science 5, 1700277 (2018).
Wang, L., Zhang, C. & Wang, L. V. Grueneisen relaxation photoacoustic microscopy. Physical Review Letters 113, 174301 (2014).
Zhang, Z., Shi, Y., Yang, S. & Xing, D. Subdiffraction-limited second harmonic photoacoustic microscopy based on nonlinear thermal diffusion. Optics Letters 43, 2336–2339 (2018).
Vellekoop, I. M. & Mosk, A. P. Focusing coherent light through opaque strongly scattering media. Optics Letters 32, 2309–2311 (2007).
Caravaca-Aguirre, A. M. et al. High contrast three-dimensional photoacoustic imaging through scattering media by localized optical fluence enhancement. Optics Express 21, 26671–26676 (2013).
Conkey, D. B. et al. Super-resolution photoacoustic imaging through a scattering wall. Nature Communication 6, 7902 (2015).
Chaigne, T. et al. Improving photoacoustic-guided focusing in scattering media by spectrally filtered detection. Optics Letters 39, 6054–6057 (2014).
Conkey, D. B., Brown, A. N., Caravaca-Aguirre, A. M. & Piestun, R. Genetic algorithm optimization for focusing through turbid media in noisy environments. Optics Express 20, 4840–4849 (2012).
Feng, Q., Zhang, B., Liu, Z., Lin, C. & Ding, Y. Research on intelligent algorithms for amplitude optimization of wavefront shaping. Applied Optics 56, 3240–3244 (2017).
Li, W., Lu, C. & Zhang, J. A lower envelope Weber contrast detection algorithm for steel bar surface pit defects. Optics & Laser Technology 45, 654–659 (2013).
Sun, J., Zhang, B., He, H., Ding, Y. & Liu, Q. Photoacoustic wavefront shaping with high signal to noise ratio for light focusing through scattering media. Scientific Reports 9, 4328 (2019).
Ngui, W. K., Leong, M. S., Hee, L. M. & Abdelrhman, A. M. Wavelet analysis: Mother wavelet selection methods. Applied Mechanics and Materials 393, 953–958 (2013).
Chiu, C., Lin, T. & Liau, B. Using correlation coefficient in ECG waveform for arrhythmia detection. Biomedical Engineering-Applications, Basis & Communication 17, 147–152 (2005).
Wang, D. et al. Focusing through dynamic tissue with millisecond digital optical phase conjugation. Optica 2, 728–735 (2015).
Acknowledgements
The authors acknowledge the support of the National Key Research and Development Program of China (Grant No. 2017YFB1104500), the National Natural Science Foundation of China (Grant No. 21627813), the Natural Science Foundation of Beijing (Grant No.7182091), and the Research projects on biomedical transformation of China-Japan Friendship Hospital (Grant No. PYBZ1801).
Author information
Authors and Affiliations
Contributions
L. Yu, J. Sun, X. Lv, Q. Feng, B. Zhang and Q. Liu conceived the experiments, L. Yu, J. Sun, X. Lv, H. He and Y. Ding conducted the experiments, L. Yu analyzed the results. All authors reviewed the manuscript.
Corresponding authors
Ethics declarations
Competing interests
The authors declare no competing interests.
Additional information
Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Yu, L., Sun, J., Lv, X. et al. High-contrast photoacoustic imaging through scattering media using correlation detection of adaptive time window. Sci Rep 9, 17262 (2019). https://doi.org/10.1038/s41598-019-53990-w
Received:
Accepted:
Published:
DOI: https://doi.org/10.1038/s41598-019-53990-w
- Springer Nature Limited