Abstract
Melanin plays a significant role in the regulation of epidermal homeostasis and photoprotection of human skin. The assessment of its epidermal distribution and overall content is of great interest due to its involvement in a wide range of physiological and pathological skin processes. Among several spectroscopic and optical imaging methods that have been reported for non-invasive quantification of melanin in human skin, the approach based on the detection of two-photon excited fluorescence lifetime distinguishes itself by enabling selective detection of melanin with sub-cellular resolution, thus facilitating its quantification while also resolving its depth-profile. A key limitation of prior studies on the melanin assessment based on this approach is their inability to account for the skin heterogeneity due to the reduced field of view of the images, which results in high dispersion of the measurement values. Pigmentation in both normal and pathological human skin is highly heterogeneous and its macroscopic quantification is critical for reliable measurements of the epidermal melanin distribution and for capturing melanin-related sensitive dynamic changes as a response to treatment. In this work, we employ a fast large-area multiphoton exoscope (FLAME), recently developed by our group for clinical skin imaging, that has the ability to evaluate the 3D distribution of epidermal melanin content in vivo macroscopically (millimeter scale) with microscopic resolution (sub-micron) and rapid acquisition rates (minutes). We demonstrate significant enhancement in the reliability of the melanin density and distribution measurements across Fitzpatrick skin types I to V by capturing the intra-subject pigmentation heterogeneity enabled by the large volumetric sampling. We also demonstrate the potential of this approach to provide consistent measurement results when imaging the same skin area at different times. These advances are critical for clinical and research applications related to monitoring pigment modulation as a response to therapies against pigmentary skin disorders, skin aging, as well as skin cancers.
Similar content being viewed by others
Explore related subjects
Find the latest articles, discoveries, and news in related topics.Introduction
Melanin is a group of molecules with multifunctional characteristics and a chromophore responsible for pigmentation of the skin. The prevalent forms of melanin in the skin are eumelanin (brown-black) and pheomelanin (yellow-reddish). They are produced by specialized cells, called melanocytes, mainly found in the basal layer of the skin epidermis1,2,3. Stored in melanosomes, they are transferred to keratinocytes to protect the skin against photo-damage from UV radiation4. Melanin plays a significant role in a variety of physiological and pathological conditions. Reliable measurements of the cutaneous melanin distribution and the melanin-related sensitive dynamic changes are essential for a better understanding and more efficient treatment of pigmentary skin disorders and for differentiating melanoma from benign pigmented lesions.
The current gold standard methods for melanin quantification in skin involve ex vivo chemical analyses5. These approaches are invasive and thus, impractical to be performed repeatedly for applications such as those related to pigmentary skin disorders that require monitoring of the treatment response6. They are also not feasible for the assessment of the melanocytes density, a key metric in quantitative approaches proposed for the non-invasive diagnosis of melanoma7. A potential non-invasive approach based on electron paramagnetic resonance (EPR) technique, particularly unique for studying melanin based on its paramagnetic properties, has been explored in various dermatological applications including mapping of melanin in vivo in melanoma mouse models8,9,10. At present, methods based on EPR offer limited spatial resolution (tens of micrometers)8,9. For melanin characterization in vivo in human skin, optical methods based on reflectance spectroscopy and colorimetry have been more successful11,12,13,14. However, the epidermal depth-information and spatial resolution provided by these approaches are limited. Both concentration of melanin and its depth distribution play key roles in understanding the skin photobiology15, while melanin detection with high spatial resolution allows for melanin quantification measurements in a broader context, in clinical applications where visualization of cellular structures is also required. Multispectral photoacoustic imaging enables non-invasive 3D mapping of epidermal melanin based on the detection of ultrasonic waves generated by rapid thermoelastic expansion of melanin induced by pulsed laser irradiation16,17,18. Remarkably, this approach generates images of melanin and blood vessels from 1 to 2 mm below the skin surface, but the 5–30 μm spatial resolution of the images is not sufficient for resolving the epidermal melanin depth profiles17,18. In recent work, Yakimov et al. reported on a promising approach for determining epidermal melanin depth-distribution based on fluorescence and Raman spectroscopy data acquired from two subjects with different skin types19. An approach that has been demonstrated to be effective for the quantification of epidermal melanin, while also resolving its depth profile, is based on the detection of melanin two-photon excited fluorescence (TPEF)6,20,21,22. TPEF laser-scanning microscopy technologies can generate in vivo 3D sub-micron resolution images of epidermal melanin distribution in human skin6,20,21,22,23. The penetration depth of this imaging technique is limited to 150–200 μm depending on the skin type and other imaging parameters24,25. Nonetheless, this depth is sufficient for capturing the entire thickness of the epidermis on most areas of the body26. Enhanced specificity of the melanin detection in the skin is further achieved using two-photon fluorescence lifetime imaging (FLIM) by exploiting the melanin fast fluorescence decay (< 0.2 ns) compared to the fluorescence decay of other fluorophores in the skin22,23,27. Pena et al. demonstrated the feasibility of this approach by studying the modulation of the 3D epidermal melanin following long-term topical treatments21,22. FLIM, among other methods such as pump-probe28 and Coherent anti-Stokes Raman Scattering imaging29, has also been demonstrated as a potentially effective tool for selective detection of eu- and pheo-melanin in excised pigmented lesions from human skin and in vivo in murine model28,29 and human skin27. To enhance the clinical imaging feasibility of this approach, our group and others have proposed and demonstrated significant enhancement in image acquisition time based on temporal binning30 along with analysis of the fluorescence temporal decay slope21,22.
While the potential of the two-photon FLIM approach for quantification of melanin and its depth-distribution in human skin has been demonstrated in the clinical setting, a key limitation remains. This limitation is related to the reduced field of view (0.25 × 0.25 mm2) of the commercial clinical multiphoton tomograph31,32 that has been used in prior studies for evaluating the potential of the TPEF intensity6,20 and lifetime21,22,23 detection in the assessment of melanin in human skin. Given the heterogeneous nature of both normal and pathological skin, generating depth-resolved images over wide areas along the skin surface is critical for reliable measurements of the epidermal melanin distribution and of the melanin-related sensitive dynamic changes as a response to treatment.
Recently, our group has developed a fast large-area multiphoton exoscope (FLAME)30, a multiphoton imaging system optimized for clinical skin imaging that has the ability to rapidly generate 3D images (within minutes) over macroscopic areas of skin (up to 1 cm2) with sub-cellular resolution (0.5–1 μm). Combined with fluorescence temporal gating and binning for melanin-specific detection, this system is capable of quantifying melanin almost in real-time. In this work, we employed FLAME to evaluate in vivo, in human skin, the significance of the increased imaging area on the epidermal melanin measurement’s reliability.
Results
Macroscopic mapping of melanin volume fraction for different Fitzpatrick skin types
We employed FLAME to measure the melanin density in human skin based on volumetric multiphoton microscopy (MPM) images acquired from the volar and dorsal forearms of subjects with Fitzpatrick skin types ranging from I to V (Fig. 1). Figure 1a shows the macroscopic maps (millimeter scale) for the melanin volume fraction (MVF) as z-projections corresponding to sun-exposed (dorsal forearm) and non-sun-exposed (volar forearm) areas for subjects with skin types I–V. These images clearly illustrate the heterogeneity in the melanin distribution, particularly for skin type I. To evaluate the z-distribution of the epidermal melanin content, we measured the average melanin density for each epidermal layer. Here, the position across the epidermis was normalized against the epidermal thickness starting from the basal layer (0) to stratum granulosum (1) (Fig. 1b). We generally measured a higher melanin density in the epidermal layers close to the stratum basale compared to the upper epidermal layers. For the volar forearm of subjects with skin types I–IV, the epidermal melanin z-distribution showed mostly a lack of pigmentation in the upper third of the epidermis. In the dorsal forearm of the same subjects, the melanin was present across the entire epidermis with higher values in the layers close to the stratum basale. The skin type V subjects showed elevated melanin content across the entire epidermis for both their volar and dorsal forearms compared to subjects with lighter skin types. The global MVF values for the subjects’ dorsal and volar forearms are summarized in Fig. 1c. As expected, the global MVF values increase with skin type and exhibit an overall change of ~ 7 × from skin type I to V. Although not linear, this increasing trend in MVF correlates strongly with the lightness (L*) parameter from the colorimetry measurements (Supplementary Fig. S1). One-way analysis of variance (ANOVA) shows a significant difference in the average MVF values corresponding to both the volar and dorsal forearms among all skin types, except for skin types II and III (Supplementary Tables S1, S2). Lastly, the average MVF values between the volar and dorsal forearms also show a significant difference for skin types II-V (Supplementary Table S3). This is consistent with the lower L* parameters measured from the dorsal forearm compared to the volar forearm (Supplementary Fig. S1).
Macroscale mapping of melanin volume fraction captures intra-subject heterogeneity
While the MVF values and the 2D melanin density profiles across the epidermis were determined based on the total melanin content imaged at different depths over a skin area of 3.2 × 3.2 mm2, a closer examination of the melanin distribution maps reveals the variability of these values along the epidermis because of the skin heterogeneity. The images and data in Fig. 2 illustrate the degree of variability of the melanin density along and across the epidermis within representative subjects with light and dark skin types I and V, respectively. Thus, the skin type I subject (Fig. 2a) presents skin areas characterized by MVF values as low as 0.3% (ROI-1) in close proximity to areas characterized by MVF values as high as 52% (ROI-3). The corresponding melanin density z-depth profiles (Fig. 2b) show a very distinct distribution for each ROI, where the ROI-3 has high melanin content in all epidermal layers while the ROI-1 is almost void of it across the entire epidermis. The skin type V subject presents a more uniform skin pigmentation when visualized macroscopically (Fig. 2c), yet at the microscopic scale, the MVF values show some degree of heterogeneous pigmentation with areas of 78% MVF (ROI-3) in close proximity of areas with 52% MVF (ROI-1). The areas characterized by high MVF values (ROI-3) showed a higher melanin content in the upper epidermal layers compared to skin areas with lower MVF values (ROI-1 and ROI-2) as illustrated by the melanin density z-distribution profiles (Fig. 2d). Note that we analyzed the MVF values and corresponding 2D melanin density profiles over regions of interest (ROIs) of 0.25 × 0.25 mm2. The rationale for emphasizing the skin heterogeneity when examining this area size is related to the fact that this is the skin area typically scanned with the current commercial clinical multiphoton tomograph employed in prior studies for in vivo melanin quantification in human skin20,21,22.
The precision of global MVF measurements increases with an increase in the imaging area
The results described above show the heterogeneity in the 3D distribution of melanin in human skin for all skin types, which further suggests that a large sampling volume is critical for the reliability of the MVF measurements as they would capture this heterogeneity. To test this hypothesis, we evaluated the MVF values corresponding to different imaging areas. We performed these measurements by dividing the 3D stacks acquired over the entire scanning area of 3.2 × 3.2 mm2 into 3D stacks of sub-images with sizes ranging from 0.25 × 0.25 to 1.6 × 1.6 mm2 (see “Methods” for more details). The MVF values were calculated for all the sub-images in the 3D stacks. The corresponding average and standard deviation (S.D.) values are summarized in Fig. 3. Our measurements showed the averages of the MVF values are independent of the size of the imaging area for all skin types provided that for small scanning areas a large number of stacks is acquired to encompass a macroscopic, mm-scale area. However, while this approach can estimate the average MVF value, it does so with a large error margin. Based on the data presented in Fig. 3c and d, the variation in the MVF values, based on their S.D. values, decreases with the increase in the imaging area. Our measurements also showed a rapid decrease in the standard deviation of the MVF values for the small range of imaging areas (0.25 × 0.25 to 0.65 × 0.65 mm2), followed by a more gradual change for the relatively large imaging areas (0.80 × 0.80 to 1.6 × 1.6 mm2). An increase in the FOV size from 0.25 × 0.25 mm2 to 1.6 × 1.6 mm2 results in an average of ~ twofold and ~ threefold increase in the MVF precision for the volar and dorsal forearms, respectively, across the skin types.
Large-area sampling results in more precise MVF measurements compared to selective small-area sampling
As illustrated in the images above, the MVF maps measured over macroscopic, mm-scale skin areas include skin folds, hair follicles, and pores. These features are too large for measurements performed over smaller, sub-mm scale scanning areas. In this case, the images are acquired such that they are void of these large features as reported in the prior studies employing the current clinical multiphoton tomograph that generates images with a FOV limited to 0.25 × 0.25 mm26,20,21. To determine the effect of this subjective approach on the MVF measurements we compared the MVF results obtained by two methods: Method 1) manual sampling of 0.25 × 0.25 mm2 ROIs (N = 9) from the 3D stacks acquired over the entire 3.2 × 3.2 mm2 scanning area such that the selected ROIs were void of the large features mentioned above and Method 2) objective sampling by dividing the entire scanning area of 3.2 × 3.2 mm2 into 1.1 × 1.1 mm2 ROIs (N = 9). The results obtained from three representative subjects with different skin types are summarized in Fig. 4. For all subjects, the large-area, objective sampling approach (Method 2) generally resulted in significantly less variation of the MVF compared to the values obtained by selectively scanning small-areas (Method 1). Thus, the representative examples presented in Fig. 4, show a twofold (S.D. 6% → 3%) and threefold (S.D.: 9% to 3%) increase in the precision of the MVF measured in the volar and dorsal forearm, respectively of the skin type I subject by using the objective sampling (Method 2) (Fig. 4c). Similarly, the same approach resulted in about twofold enhancement of the MVF precision (S.D.: 7% to 3%) for the values measured in both volar and dorsal forearm of a skin type V (Fig. 4e). An additional finding is related to generally higher MVF average values obtained by using the selective scanning-area sampling (Method 1) compared to the large scanning area approach (Method 2). This is associated with the exclusion of the skin folds, hair follicles, and pores in the approach of Method 1. These features are generally devoid of melanin, and their exclusion results in an overestimation of the MVF values.
The MVF values are consistent between measurements
Besides accuracy and precision, reproducibility is another parameter of interest for the melanin density measurements in the skin. While the reproducibility assessment requires a dedicated rigorous study on a larger number of subjects, we aimed to provide a brief insight into the potential of our proposed approach to generate consistent results for the melanin density measurements. Thus, we performed MVF measurements on a skin type IV subject’s dorsal forearm at three different times. We used skin landmarks to ensure imaging of approximately the same location. The results are summarized in Fig. 5. One-way ANOVA shows no significant difference among the average MVF measurements (P = 0.432, Supplementary Table S4).
Discussion
The distribution of melanin in human skin is innately heterogeneous. In this work, we utilized FLAME, a fast large-area multiphoton exoscope to evaluate the 3D melanin distribution over an imaging area of about two orders of magnitude (180 ×) larger than the 0.25 × 0.25 mm2 FOV, commonly used for the melanin assessment in human skin using the commercial clinical multiphoton imaging technology20,21,22. Combined with selective detection of melanin by fluorescence temporal gating and binning, the data acquisition time for each subject was kept under ~ 7 min, which is at least an order of magnitude faster than the acquisition time that would be required for the current MPM clinical technology to scan over a similar area.
We validated the ability of FLAME to assess the melanin density and distribution in human skin by demonstrating the correlation of the global 3D epidermal melanin density with the skin type and its distribution across the epidermis. The different skin types’ skin areas were characterized by different MVF values with only skin types II and III showing a non-significant difference based on the MVF values for both the sun-exposed (dorsal forearm) and non-sun-exposed (volar forearm). This was likely due to inaccuracy in the determination of the skin type, a hypothesis supported by the colorimetry measurements (Supplementary Fig. S1). Correlations of the MVF values with skin type have been reported in prior studies based on TPEF intensity20 and lifetime22 imaging of melanin, but the statistical significance of the difference in MVF values among different skin types has not been evaluated or reported. One study employing the TPEF lifetime for cutaneous melanin quantification reported on limitation in resolving the melanin concentration in light skin types and in distinguishing the melanin concentration between volar and dorsal forearm due to insufficient precision of the measurements23.
The main findings of our work are related to the capability of FLAME to capture the pigmentation heterogeneity in human skin, which has several key implications for studies that involve monitoring melanin modulation as a response to therapies. One implication is that the epidermal melanin density measurements derived from 3D images acquired over macroscopic (mm scale) skin areas are significantly less affected by variability than the measurements obtained from volumetric images acquired over multiple small areas (sub-mm). Technically, the average melanin density values are independent of the scanning area for all skin types and are the same regardless of the sampling approach: rapidly over fewer large areas or slower over more small areas, but the precision of the measurement is higher in the former case. However, in practice, when using the current commercial clinical MPM devices (DermaInspect or MPTflex, Jenlab, Germany) the average melanin density values may be overestimated when compared to the data derived from macroscopic imaging, according to our analysis. The reason is related to the approach used for the 3D melanin density measurements derived from images acquired with the commercial MPM clinical devices where the scanning area (< 250 × 250 μm2) is selected such that it would not include large features such as skin folds, hair follicles or pores. These features are generally devoid of melanin and do not have a significant contribution to the measured melanin content, but they do contribute to the overall volume when scanning macroscopic areas.
The enhancement in the measurement precision of melanin density and distribution is expected to require fewer images to detect certain levels of variations in the MVF values in the skin. An example of a sample size estimate as a function of FOV is shown in Supplementary Table S5 based on the data acquired from the dorsal forearm of the skin type V subjects. As expected, employing the largest FOV (1.6 × 1.6 mm2) would require the smallest sample size for detecting 10% to 25% changes in the MVF values. To detect the same change, the smallest FOV (0.25 × 0.25 mm2) requires ~ 4 to 5 times higher sample size. The fewer samples required when using a larger FOV for imaging could translate to a further decrease in the acquisition time. These results were based on the limited data acquired from the dorsal forearm of the skin type V subjects, but we expect a similar trend for all skin types.
The reproducibility of the measurements is a key measurement parameter of interest in clinical studies besides reliability. We performed a brief evaluation of this metric by imaging the forearm skin of a subject at three different times in approximately the same location. The data demonstrated the potential of FLAME to generate images that would result in consistent measurements of the 3D epidermal melanin density. We attribute the consistency of the results to the insensitivity of the large-area sampling to the accuracy of the location selected for imaging. This is particularly of interest in monitoring pigment modulation as a response to therapy or to cosmetic products, where changes can be subtle, and locating the same imaging area for performing the measurements at different time points may be a challenge. A statistically powered study on a larger number of subjects will be required for a rigorous assessment of the melanin density measurements reproducibility.
One important benefit of this approach is the ability to image the melanin with high specificity based on the melanin's fast fluorescence decay compared to the fluorescence decay of other endogenous fluorophores in the skin. The images are generated rapidly by binning the time-gated TPEF signals rather than by using conventional approaches based on fitting of the full fluorescence decay or phasor analysis, which are not feasible for clinical imaging due to their long integration times. A drawback of the detection based on the time binning of the fluorescence signal is related to the sensitivity of classifying the pixels corresponding to melanin in the TPEF images with respect to the selected threshold. In a recent publication, Pena et al. performed a thorough analysis to establish a threshold for melanin detection using a method based on temporal binning and fluorescence temporal decay slope analysis, referred to as pseudo-FLIM. Although our approach is slightly different in several aspects, the mean melanin density values are comparable with the values derived in Pena’s publication22 for all skin types granted the comparison is a relatively rough estimation due to the different error margins, significantly lower for our measurements. Notably, the melanin density values measured by using these optical approaches should not be interpreted as melanin absolute concentrations. They are estimated values based on the fluorescence signal detected from melanin and are aimed to be used for measuring melanin modulations non-invasively in human skin.
While the results of this study are limited by the small number of subjects and need further confirmation on a larger population, they demonstrate the feasibility of this technology to study melanin concentration and its depth-distribution non-invasively in human skin. Moreover, the sub-micron resolution of the imaging approach enables the performance of melanin studies in a broader context of clinical applications requiring visualization of cellular structures.
Conclusion
In this study, we employ FLAME, a fast, large area multiphoton exoscope, a device with unique performance features optimized for clinical skin imaging, to evaluate the significance of the large volumetric sampling enabled by this instrument on the cutaneous melanin measurements reliability. We demonstrated significant enhancement of the melanin density and distribution measurements reliability across Fitzpatrick skin types I to V based on the ability of this imaging device to capture the intra-subject pigment heterogeneity at the microscopic scale. We also demonstrated the potential of this approach to provide consistent measurement results when imaging the same skin area at different times. We expect these advances to have an important impact in clinical and research applications related to monitoring pigment modulation as a response to therapies against pigmentary skin disorders, skin aging, as well as skin cancers.
Methods
Experimental design
We enrolled in the study a total of ten (10) subjects with Fitzpatrick skin types I–V, two (2) for each skin type. We acquired the in vivo MPM images from the skin areas on the dorsal and volar left forearm of the subjects. The experiments were conducted with full consent from each subject using an approved protocol by the Internal Review Board for clinical research in human subjects at the UC Irvine, complying with the Declaration of Helsinki.
Clinical multiphoton imaging
Fast large-area multiphoton exoscope (FLAME)
All multiphoton imaging was performed using the clinical Fast Large-Area Multiphoton Exoscope (FLAME), recently developed by our group30. Briefly, this clinical MPM imaging system consists of a turn-key femtosecond laser (Carmel 780, < 90 fs, 80 MHz, fixed 780 nm excitation, Calmar, Palo Alto, CA), an articulated arm attached to the imaging head housing near-infrared (NIR) optics: a 4 kHz resonant-galvo beam scanning module, custom-designed relay, beam-expander optics and a 25 × , 1.05 NA objective lens (XLPL25XWMP, Olympus). The optical design of this system is optimized to provide sub-micron resolution images with a single field of view of up to ~ 0.8 × 0.8 mm2 at a rapid rate of 7.5 frames per second for ~ 1024 × 1024 pixels frame. The imaging area can be increased to ~ 10 × 10 mm2 by using the tile or strip mosaic approach where adjacent field-of-views are stitched together as described in detail in our report on this device30. The tile mosaic approach was used in this study. The rapidly acquired images are post-processed using a deep-learning-based algorithm, CARE (Content-Aware Image Restoration)33, trained specifically for MPM images of human skin as previously described30.
The system has two (2) hybrid-photomultiplier tube detectors utilized for simultaneous acquisition of second-harmonic generation (SHG) (330–480 nm, blue channel), and TPEF signals (510–610 nm). We further split the TPEF signal into two-coarse components based on the lifetimes of the fluorescence signal using temporal gating in time bins of width: 0–1.6 ns (red channel) and 1.6–12.5 ns (green channel). In this study, the blue channel was used exclusively for the visualization of collagen to identify the dermal–epidermal junction. The green and red fluorescence channels were used for the quantification of melanin as described below in the “Data analyses” section. An example of an image generated by acquiring all three channels is shown in Supplementary Fig. S2.
In vivo 3D multiphoton imaging
For each subject, we acquired 4 × 4 mosaic images from the volar and dorsal forearm, encompassing a total area of ~ 3.2 × 3.2 mm2 (0.84 × 0.84 mm2, 1024 × 1024 pixels per tile, 10 frames accumulation, 2% overlap per tile). To fully capture the depth of the epidermis, a 3D z-stack was acquired for each tile, from a depth slightly above the stratum corneum to the dermis (12 optical sections at 10 µm z-step). The typical acquisition time for each mosaic image is ~ 6.5 min (24 s per 3D z-stack). The images are post-processed immediately after imaging by using the CARE denoising algorithm.
Laser power considerations
Our FLAME system uses an objective of NA = 1.05 and an excitation laser power of 60 mW at the skin surface, which is below the DNA and thermal damage threshold limits established for two-photon microscopy of human skin34,35; notably, FLAME uses a significantly lower laser fluence (1.7 ×) and faster imaging time per unit area (40 ×) compared to the values used in the establishing the damage threshold for two-photon microscopy of human skin34,35.
Colorimetry measurements
The pigmentation in both dorsal and volar regions of the subjects’ forearm was also measured by reflective colorimetry using a CR-400 Colorimeter (Konica Minolta Sensing Inc., Japan) calibrated to black and white calibration plates. The reflected light is collected for a tristimulus color analysis using the L*a*b color system as determined by the Commission Internationale de l'éclairage (CIE). The measurements were done immediately after the MPM imaging on around the same imaging spot.
Data analyses
Melanin content quantification
The melanin content for each image was quantified following an approach we described in a prior publication30. In short, in this method two TPEF images are generated by detecting the fluorescence signals based on the photons arrival time and binning them into time bins of width: 0–1.6 ns (red channel) and 1.6–12.5 ns (green channel). The reason for defining these time bins was to attain selective detection of melanin, since the fluorescence from melanin is characterized by a short lifetime with respect to most of the other endogenous fluorophores in skin23,36. Due to the integration time bin overlap of the two detection channels and the modest temporal resolution, we subtract the photon counts representing the long lifetime fluorescence (green channel) from the short lifetime fluorescence signal (red channel). This subtraction results in pixels with positive and negative values. The negative photon counts stem from the larger contribution to the signal from photons with long fluorescence lifetime. On the other hand, the positive photon counts are due to larger contribution to signal from photons with short fluorescence lifetime. These values represent mainly the melanin fluorescence signal contribution30. From this differential image, a binary melanin mask is generated. All pixels with photon counts > 0 are set to “1”, and pixels with differences in photon counts ≤ 0 are set to “0”. We then apply an open area filter to remove isolated single pixels which correspond to melanosome areas < 1 µm2. The resulting mask represents the fraction of the total area occupied by melanin in each image to the total imaged area. Similarly, the melanin volume fraction (MVF) represents the fraction of the volume occupied by melanin in each stack to the total imaged volume. A schematic describing the steps of this approach is shown in Supplementary Fig. S3.
Effect of FOV size on MVF variability
To estimate the variation in the MVF measurements as a function of the imaging FOV size, the 3.2 × 3.2 mm2 mosaic 3D stack was divided into sub-images with sizes 0.25 × 0.25 mm2 (N = 169), 0.29 × 0.29 mm2 (N = 121), 0.36 × 0.36 mm2 (N = 81), 0.46 × 0.46 mm2 (N = 49), 0.65 × 0.65 mm2 (N = 25), 0.81 × 0.81 mm2 (N = 16), 1.08 × 1.08 mm2 (N = 9) and 1.6 × 1.6 mm2 (N = 4).
Selective small-area samples vs large-area samples
Method A: Nine (9) ROIs with 0.25 × 0.25 mm2 size were manually selected from a representative mosaic image to avoid the inclusion of large features such as hairs, skin folds, and pores. Method B: The full mosaic 3D stack was divided into 9 ROIs with 1.1 × 1.1 mm2 size. In both methods, the average MVF and standard deviation were obtained.
Measurement repeatability
To assess the repeatability of the MVF quantification, we did multiple measurements on a representative subject (skin type IV, dorsal forearm). Skin landmarks were used to ensure imaging of approximately the same location. The average time between measurements was ~ 15 min.
Statistical analysis
To compare the average MVF values between dorsal and volar forearms, and between selective small-area sampling and large-area sampling (Fig. 4), we performed a two-sample unpaired t-test to determine the significant difference. The significance level threshold is set at P < 0.05. For the global MVF for each skin type from dorsal and volar forearms (Fig. 1) and the repeatability of the measurement (Fig. 5), the average MVF values obtained were compared by one-way analysis of variance (ANOVA) with Tukey–Kramer posthoc analysis. The significance level threshold was set at P < 0.05. The sample size analysis in Supplementary Data Table S5 is based on a two-sample unpaired t-test (power: 80% and significance level: 5%). Effect size (d) was estimated for detection of 10% to 25% change in the mean MVF values using different FOV sizes.
Data availability
The datasets generated and/or analyzed in this study are available from the corresponding author upon request.
References
Watt, A. A. R., Bothma, J. P. & Meredith, P. The supramolecular structure of melanin. Soft Matter 5, 3754 (2009).
Lin, J. Y. & Fisher, D. E. Melanocyte biology and skin pigmentation. Nature 445, 843–850 (2007).
Kanellis, V. G. A review of melanin sensor devices. Biophys. Rev. 11, 843–849 (2019).
Mujahid, N. et al. A UV-independent topical small-molecule approach for melanin production in human skin. Cell Rep. 19, 2177–2184 (2017).
Wakamatsu, K. & Ito, S. Advanced chemical methods in melanin determination. Pigment Cell Res. 15, 174–183 (2002).
Lentsch, G. et al. In vivo multiphoton microscopy of melasma. Pigment Cell Melanoma Res. 32, 403–411 (2019).
Balu, M. et al. Distinguishing between benign and malignant melanocytic nevi by in vivo multiphoton microscopy. Cancer Res. 74, 2688–2697 (2014).
Plonka, P. M. Electron paramagnetic resonance as a unique tool for skin and hair research. Exp. Dermatol. 18, 472–484 (2009).
Godechal, Q., Leveque, P., Marot, L., Baurain, J.-F. & Gallez, B. Optimization of electron paramagnetic resonance imaging for visualization of human skin melanoma in various stages of invasion: Optimization of EPR imaging for visualization of human skin melanoma. Exp. Dermatol. 21, 341–346 (2012).
Vanea, E. et al. Molecular electron paramagnetic resonance imaging of melanin in melanomas: A proof-of-concept. NMR Biomed. 21, 296–300 (2008).
Dolotov, L. E. et al. Design and evaluation of a novel portable erythema-melanin-meter. Lasers Surg. Med. 34, 127–135 (2004).
Matts, P. J., Dykes, P. J. & Marks, R. The distribution of melanin in skin determined in vivo. Br. J. Dermatol. 156, 620–628 (2007).
Matias, A. R., Ferreira, M., Costa, P. & Neto, P. Skin colour, skin redness and melanin biometric measurements: Comparison study between Antera ® 3D, Mexameter ® and Colorimeter ®. Skin Res. Technol. 21, 346–362 (2015).
Nkengne, A. et al. SpectraCam ®: A new polarized hyperspectral imaging system for repeatable and reproducible in vivo skin quantification of melanin, total hemoglobin, and oxygen saturation. Skin. Res. Technol. 24, 99–107 (2018).
Nielsen, K. P., Zhao, L., Stamnes, J. J., Stamnes, K. & Moan, J. The importance of the depth distribution of melanin in skin for DNA protection and other photobiological processes. J. Photochem. Photobiol. B 82, 194–198 (2006).
Viator, J. A. et al. A comparative study of photoacoustic and reflectance methods for determination of epidermal melanin content. J. Investig. Dermatol. 122, 1432–1439 (2004).
Schwarz, M., Buehler, A., Aguirre, J. & Ntziachristos, V. Three-dimensional multispectral optoacoustic mesoscopy reveals melanin and blood oxygenation in human skin in vivo. J. Biophoton 9, 55–60 (2016).
Li, X. et al. Optoacoustic mesoscopy analysis and quantitative estimation of specific imaging metrics in Fitzpatrick skin phototypes II to V. J. Biophoton. 12, 442 (2019).
Yakimov, B. P. et al. Melanin distribution from the dermal–epidermal junction to the stratum corneum: Non-invasive in vivo assessment by fluorescence and Raman microspectroscopy. Sci. Rep. 10, 14374 (2020).
Saager, R. B. et al. In vivo measurements of cutaneous melanin across spatial scales: Using multiphoton microscopy and spatial frequency domain spectroscopy. J. Biomed. Opt 20, 066005 (2015).
Tancrède-Bohin, E. et al. In vivo multiphoton imaging for non-invasive time course assessment of retinoids effects on human skin. Skin Res. Technol. 26, 794–803 (2020).
Pena, A.-M. et al. In vivo melanin 3D quantification and z-epidermal distribution by multiphoton FLIM, phasor and pseudo-FLIM analyses. Sci. Rep. 12, 1642 (2022).
Dancik, Y., Favre, A., Loy, C. J., Zvyagin, A. V. & Roberts, M. S. Use of multiphoton tomography and fluorescence lifetime imaging to investigate skin pigmentation in vivo. J. Biomed. Opt. 18, 026022 (2013).
Tang, S., Krasieva, T. B., Chen, Z., Tempea, G. & Tromberg, B. J. Effect of pulse duration on two-photon excited fluorescence and second harmonic generation in nonlinear optical microscopy. J. Biomed. Opt. 11, 020501 (2006).
Balu, M., Saytashev, I., Hou, J., Dantus, M. & Tromberg, B. J. Sub-40 fs, 1060-nm Yb-fiber laser enhances penetration depth in nonlinear optical microscopy of human skin. J. Biomed. Opt. 20, 120501 (2015).
Sandby-Møller, J., Poulsen, T. & Wulf, H. C. Epidermal thickness at different body sites: Relationship to age, gender, pigmentation, blood content, skin type and smoking habits. Acta Dermato-Venereol. 83, 410–413 (2003).
Krasieva, T. B. et al. Two-photon excited fluorescence lifetime imaging and spectroscopy of melanins in vitro and in vivo. J. Biomed. Opt 18, 031107 (2012).
Matthews, T. E. et al. In vivo and ex vivo epi-mode pump-probe imaging of melanin and microvasculature. Biomed. Opt. Express 2, 1576 (2011).
Wang, H. et al. In vivo coherent Raman imaging of the melanomagenesis-associated pigment pheomelanin. Sci. Rep. 6, 37986 (2016).
Fast, A. et al. Fast, large area multiphoton exoscope (FLAME) for macroscopic imaging with microscopic resolution of human skin. Sci. Rep. 10, 18093 (2020).
Koenig, K. & Riemann, I. High-resolution multiphoton tomography of human skin with subcellular spatial resolution and picosecond time resolution. J. Biomed. Opt. 8, 432 (2003).
Balu, M. et al. In vivo multiphoton NADH fluorescence reveals depth-dependent keratinocyte metabolism in human skin. Biophys. J. 104, 258–267 (2013).
Weigert, M. et al. Content-aware image restoration: pushing the limits of fluorescence microscopy. Nat. Methods 15, 1090–1097 (2018).
Fischer, F. et al. Risk estimation of skin damage due to ultrashort pulsed, focused near-infrared laser irradiation at 800 nm. J. Biomed. Opt. 13, 041320 (2008).
Masters, B. R. et al. Mitigating thermal mechanical damage potential during two-photon dermal imaging. J. Biomed. Opt. 9, 1265 (2004).
Seidenari, S. et al. Multiphoton laser tomography and fluorescence lifetime imaging of melanoma: Morphologic features and quantitative data for sensitive and specific non-invasive diagnostics. PLoS ONE 8, e70682 (2013).
Acknowledgements
This work was supported by the National Institute of Biomedical Imaging and Bioengineering (R01EB026705) and the UCI Skin Biology Resource-Based Center (P30AR075047). The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institute of Health.
Author information
Authors and Affiliations
Contributions
Conceptualization and study design: J.R.V., M.B. Optimization of the instrumentation for in vivo imaging: A.D. Data collection: J.R.V., K.S. Development of methodology: J.R.V., M.B. Data analysis and interpretation of data: J.R.V., M.B. Manuscript writing: J.R.V. and M.B. Manuscript review: all authors.
Corresponding author
Ethics declarations
Competing interests
M. Balu is co-author of a patent owned by the University of California, Irvine, which is related to the MPM imaging technology. M. Balu is also a co-founder of Infraderm, LLC, a startup spin off from UC Irvine, that develops MPM-based clinical imaging platforms for commercialization purpose. The Institutional Review Board and Conflict of Interest Office of the University of California, Irvine, have reviewed these disclosures and did not find any concerns. The other authors disclosed no conflicts of interest.
Additional information
Publisher's note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Vicente, J.R., Durkin, A., Shrestha, K. et al. In vivo imaging with a fast large-area multiphoton exoscope (FLAME) captures the melanin distribution heterogeneity in human skin. Sci Rep 12, 8106 (2022). https://doi.org/10.1038/s41598-022-12317-y
Received:
Accepted:
Published:
DOI: https://doi.org/10.1038/s41598-022-12317-y
- Springer Nature Limited
This article is cited by
-
In vivo multiphoton multiparametric 3D quantification of human skin aging on forearm and face
Scientific Reports (2022)