Skip to main content

Removing Specular Reflection in Multispectral Dermatological Images Using Blind Source Separation

  • Conference paper
  • First Online:
Medical Image Understanding and Analysis (MIUA 2022)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 13413))

Included in the following conference series:

  • 2311 Accesses

Abstract

In this paper we propose a new method for removing specular reflection from multispectral dermatological images which is based on blind source separation using Non-negative Matrix Factorization. The key idea of our method is based on a first step which consists to estimate the number of sources involved, by applying a Principal Component Analysis, then a first version of these sources by applying an Independent Component Analysis to our images. We exploit this first version of the sources in a second step to initialize our Non-negative Matrix Factorization algorithm instead of the random initialization that is used by most of the existing methods and that considerably affects their performances. In order to quantify numerically the performance of our method, we also propose a new protocol to artificially mix a specular reflection image with a diffuse reflection image. The tests effected on real and artificial multispectral dermatological images have shown the good performance of our method compared to two of the most used methods.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 89.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 119.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    As the reflectance function \(F(u,\lambda )\) physically represents all phenomena produced by the interaction between light and skin, it is in principle described by an exponential model representing the absorption of the different components of the skin [14].

  2. 2.

    We show that the BSS problem is an ill-posed inverse problem which admits an infinity of solutions so that it is essential to add hypotheses on the sources and/or on the mixing coefficients, which gave rise to 3 families of methods. These three families are based respectively on Independent Component Analysis (ICA), Sparse Component Analysis (SCA) and Non-negative Matrix Factorisation (NMF) (See [9] for more details).

  3. 3.

    A signal is said to be sparse in a given representation domain if there are some areas of that domain where it is inactive.

  4. 4.

    That is 3 bands corresponding to the visible range (RGB) and 3 bands corresponding to the infrared range.

  5. 5.

    We recall that this number of principal components is none other than the number of non-zero (or significant) eigenvalues of the covariance matrix associated to the image. In practice, we choose a threshold below which an eigenvalue is considered to be zero (see Results section).

  6. 6.

    For example, for a matrix of size \(m\times n\), this vectorisation consists in juxtaposing its rows one after the other which gives us a vector of length “\(m\cdot n\)”.

  7. 7.

    Indeed, BSS methods based on ICA can be classified into two families [9]. The first family includes the methods that exploit higher order statistics and assume that the source signals are statistically independent at higher orders (for example, the methods JADE [6] and FasICA [16]). The second family includes the methods that exploit second-order statistics and assume that the source signals are statistically independent at second order only (for example, the methods AMUSE [29] and SOBI [3]).

  8. 8.

    This is for example the case of audio signals.

  9. 9.

    This is the case for most of the real sources, using any BSS method.

  10. 10.

    Indeed, for all other BSS approaches, the separation is performed in two steps: the estimation of the separation matrix, then that of the sources.

  11. 11.

    In other words, in our case the number of spectral bands M of our image must be superior than or equal to the number of sources which is equal to \(N_d+1\).

  12. 12.

    Note that, we could very well propose a criterion exploiting the distribution of the specular reflection which is known for its sparseness, in order to identify it automatically.

  13. 13.

    In our computations, any eigenvalue of the covariance matrix (associated to the image) having a value less than \(10^{-3}\) is considered as null.

  14. 14.

    We used for that the source codes of the method [2] provided in [26].

  15. 15.

    Knowing that, we performed tests for different values of \(N_d\), and we found that the method [2] gives good results for \(N_d=2\).

  16. 16.

    Indeed, the criterion based on the visual analysis of the treated images is a qualitative criterion and it is difficult with the naked eye to compare in a precise way between two treated images. This comparison becomes even more difficult, if not impossible, when the two images are very close in terms of elimination the specular reflection.

  17. 17.

    i.e. the real RGB image consisting only of the diffuse reflection.

References

  1. Abbas, Q., Celebi, M.E., Fondón García, I., Rashid, M.: Lesion border detection in dermoscopy images using dynamic programming. Skin Res. Technol. 17(1), 91–100 (2011)

    Article  Google Scholar 

  2. Akashi, Y., Okatani, T.: Separation of reflection components by sparse non-negative matrix factorization. Comput. Vis. Image Underst. 146(C), 77–85 (2016)

    Article  Google Scholar 

  3. Belouchrani, A., Abed-Meraim, K., Cardoso, J.F., Moulines, E.: A blind source separation technique using second-order statistics. IEEE Trans. Signal Process. 45(2), 434–444 (1997)

    Article  Google Scholar 

  4. Berry, M.W., Browne, M., Langville, A.N., Pauca, V.P., Plemmons, R.J.: Algorithms and applications for approximate nonnegative matrix factorization. Comput. Stat. Data Anal. 52(1), 155–173 (2007)

    Article  MathSciNet  Google Scholar 

  5. Boutsidis, C., Gallopoulos, E.: SVD based initialization: a head start for nonnegative matrix factorization. Pattern Recogn. 41(4), 1350–1362 (2008)

    Article  Google Scholar 

  6. Cardoso, J.F., Souloumiac, A.: Blind beamforming for non-gaussian signals. In: IEE Proceedings F (radar and signal processing), vol. 140, pp. 362–370. IET (1993)

    Google Scholar 

  7. Cichocki, A., Zdunek, R., Phan, A.H., Amari, S.I.: Nonnegative Matrix and Tensor Factorizations: Applications to Exploratory Multi-way Data Analysis and Blind Source Separation. Wiley, New York (2009)

    Book  Google Scholar 

  8. Cohen, J.: Dependency of the spectral reflectance curves of the Munsell color chips. Psychon. Sci. 1(1), 369–370 (1964)

    Article  Google Scholar 

  9. Comon, P., Jutten, C.: Handbook of Blind Source Separation, Independent Component Analysis and Applications, February 2010. https://doi.org/10.1016/C2009-0-19334-0

  10. Dhrymes, P.J.: Matrix vectorization. In: Mathematics for Econometrics, pp. 117–145. Springer, New York (2000). https://doi.org/10.1007/978-1-4757-3238-2_4

  11. Eggert, J., Korner, E.: Sparse coding and NMF. In: 2004 IEEE International Joint Conference on Neural Networks (IEEE Cat. No.04CH37541). vol. 4, pp. 2529–2533 (2004). https://doi.org/10.1109/IJCNN.2004.1381036

  12. Févotte, C., Idier, J.: Algorithms for nonnegative matrix factorization with the \(\beta \)-divergence. Neural Comput. 23(9), 2421–2456 (2011)

    Article  MathSciNet  Google Scholar 

  13. Gutenev, A., Skladnev, V., Varvel, D.: Acquisition-time image quality control in digital dermatoscopy of skin lesions. Comput. Med. Imaging Graph. 25(6), 495–499 (2001)

    Article  Google Scholar 

  14. Hecht, H.G.: The interpretation of diffuse reflectance spectra. J. Res. Natl. Bureau Stand. Sect. A, Phys. Chem. 80(4), 567 (1976)

    Article  Google Scholar 

  15. Hoyer, P.O.: Non-negative matrix factorization with sparseness constraints. J. Mach. Learn. Res. 5(9), 1457–1469 (2004)

    MathSciNet  Google Scholar 

  16. Hyvärinen, A., Oja, E.: Independent component analysis: algorithms and applications. Neural Netw. 13(4–5), 411–430 (2000)

    Article  Google Scholar 

  17. Jacques, S.L., Samatham, R., Choudhury, N.: Rapid spectral analysis for spectral imaging. Biomed. Opt. Express 1(1), 157–164 (2010)

    Article  Google Scholar 

  18. Kuzmina, I., et al.: Multispectral imaging of pigmented and vascular cutaneous malformations: the influence of laser treatment. In: Laser Applications in Life Sciences, vol. 7376, p. 73760J. International Society for Optics and Photonics (2010)

    Google Scholar 

  19. Lee, D., Seung, H.: Algorithms for non-negative matrix factorization. Adv. Neural Inform. Process. Syst. 13, 556–562 (2001)

    Google Scholar 

  20. Lézoray, O., Revenu, M., Desvignes, M.: Graph-based skin lesion segmentation of multispectral dermoscopic images. In: International Conference on Image Processing (IEEE), pp. 897–901 (2014)

    Google Scholar 

  21. Lin, C.J.: Projected gradient methods for nonnegative matrix factorization. Neural Comput. 19(10), 2756–2779 (2007)

    Article  MathSciNet  Google Scholar 

  22. Liu, Z., Zerubia, J.: Melanin and hemoglobin identification for skin disease analysis. In: 2013 2nd IAPR Asian Conference on Pattern Recognition, pp. 145–149. IEEE (2013)

    Google Scholar 

  23. Lézoray, O.: https://lezoray.users.greyc.fr/researchDatabasesDermoscopy.php

  24. Madooei, A., Drew, M.S.: Detecting specular highlights in dermatological images. In: 2015 IEEE International Conference on Image Processing (ICIP), pp. 4357–4360. IEEE (2015)

    Google Scholar 

  25. Paatero, P., Tapper, U.: Positive matrix factorization: a non-negative factor model with optimal utilization of error estimates of data values. Environmetrics 5(2), 111–126 (1994)

    Article  Google Scholar 

  26. Ramos, V.: SIHR: a MATLAB/GNU Octave toolbox for single image highlight removal. J. Open Source Software 5(45), 1822 (2020). https://doi.org/10.21105/joss.01822

    Article  Google Scholar 

  27. Schachtner, R., Pöppel, G., Tomé, A.M., Lang, E.W.: Minimum determinant constraint for non-negative matrix factorization. In: Adali, T., Jutten, C., Romano, J.M.T., Barros, A.K. (eds.) ICA 2009. LNCS, vol. 5441, pp. 106–113. Springer, Heidelberg (2009). https://doi.org/10.1007/978-3-642-00599-2_14

    Chapter  Google Scholar 

  28. Shafer, S.A.: Using color to separate reflection components. Color Res. Appl. 10(4), 210–218 (1985)

    Article  Google Scholar 

  29. Tong, L., Liu, R.W., Soon, V.C., Huang, Y.F.: Indeterminacy and identifiability of blind identification. IEEE Trans. Circuits Syst. 38(5), 499–509 (1991)

    Article  Google Scholar 

  30. Wold, S., Esbensen, K., Geladi, P.: Principal component analysis. Chemom. Intell. Lab. Syst. 2(1–3), 37–52 (1987)

    Article  Google Scholar 

  31. Yang, Q., Wang, S., Ahuja, N.: Real-time specular highlight removal using bilateral filtering. In: Daniilidis, K., Maragos, P., Paragios, N. (eds.) ECCV 2010. LNCS, vol. 6314, pp. 87–100. Springer, Heidelberg (2010). https://doi.org/10.1007/978-3-642-15561-1_7

    Chapter  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Mustapha Zokay .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Zokay, M., Saylani, H. (2022). Removing Specular Reflection in Multispectral Dermatological Images Using Blind Source Separation. In: Yang, G., Aviles-Rivero, A., Roberts, M., Schönlieb, CB. (eds) Medical Image Understanding and Analysis. MIUA 2022. Lecture Notes in Computer Science, vol 13413. Springer, Cham. https://doi.org/10.1007/978-3-031-12053-4_54

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-12053-4_54

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-12052-7

  • Online ISBN: 978-3-031-12053-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics