Skip to main content

Advertisement

Log in

Obscuring Surface Anatomy in Volumetric Imaging Data

  • Original Article
  • Published:
Neuroinformatics Aims and scope Submit manuscript

Abstract

The identifying or sensitive anatomical features in MR and CT images used in research raise patient privacy concerns when such data are shared. In order to protect human subject privacy, we developed a method of anatomical surface modification and investigated the effects of such modification on image statistics and common neuroimaging processing tools. Common approaches to obscuring facial features typically remove large portions of the voxels. The approach described here focuses on blurring the anatomical surface instead, to avoid impinging on areas of interest and hard edges that can confuse processing tools. The algorithm proceeds by extracting a thin boundary layer containing surface anatomy from a region of interest. This layer is then “stretched” and “flattened” to fit into a thin “box” volume. After smoothing along a plane roughly parallel to anatomy surface, this volume is transformed back onto the boundary layer of the original data. The above method, named normalized anterior filtering, was coded in MATLAB and applied on a number of high resolution MR and CT scans. To test its effect on automated tools, we compared the output of selected common skull stripping and MR gain field correction methods used on unmodified and obscured data. With this paper, we hope to improve the understanding of the effect of surface deformation approaches on the quality of de-identified data and to provide a useful de-identification tool for MR and CT acquisitions.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

Notes

  1. U. S. Health Insurance Portability and Accountability Act

  2. The MATLAB source code is available at https://bitbucket.org/mmilch01/surfacemask under the BSD open source license.

  3. In the most recent version of the pipeline, this has been replaced by open source FSL’s FLIRT registration (Jenkinson and Smith, 2001), with similar resulting face ROIs.

References

  • Bischoff-Grethe, A., Ozyurt, I. B., Busa, E., Quinn, B. T., Fennema-Notestine, C., Clark, C. P., et al. (2007). A technique for the deidentification of structural brain MR images. Human Brain Mapping, 28(9), 892–903. doi:10.1002/hbm.20312.

    Article  PubMed  Google Scholar 

  • Budin, F., Zeng, D., Ghosh, A., & Bullitt, E. (2008). Preventing facial recognition when rendering MR images of the head in three dimensions. Medical Image Analysis, 12(3), 229–239. doi:10.1016/j.media.2007.10.008.

    Article  PubMed  Google Scholar 

  • Chen, J., Siddiqui, K., Moffitt, R., Juluru, K., Kim, W., Safdar, N., & Siegel, E. (2007). Observer success rates for identification of 3D surface reconstructed facial images and implications for patient privacy and security. Proceedings of SPIE International Society for Optical Engineering, 65161B-1–65161B-8.

  • Collignon, A., Maes, F., Delaere, D., Vandermeulen, D., Suetens, P., & Marchal, G. (1995). Automated multi-modality image registration based on information theory. Information Processing in Medical Imaging, 263–274.

  • Fennema-Notestine, C., Ozyurt, I. B., Clark, C. P., Morris, S., Bischoff-Grethe, A., Bondi, M. W., et al. (2006). Quantitative evaluation of automated skull-stripping methods applied to contemporary and legacy images: effects of diagnosis, bias correction, and slice location. Human Brain Mapping, 27(2), 99–113. doi:10.1002/hbm.20161.

    Article  PubMed  Google Scholar 

  • Jähne, B. (1997). Digital Image Processing (p. 622). Springer. Retrieved from http://www.amazon.com/Digital-Image-Processing-Bernd-J%C3%A4hne/dp/3540240357.

  • Jarudi, I. N., & Sinha, P. (2003). Relative Contributions of Internal and External Features to Face Recognition. Retrieved from http://dspace.mit.edu/handle/1721.1/7274.

  • Jenkinson, M., & Smith, S. (2001). A global optimisation method for robust affine registration of brain images. Medical image analysis, 5(2), 143–156. Retrieved from http://www.ncbi.nlm.nih.gov/pubmed/11516708.

    Article  PubMed  CAS  Google Scholar 

  • Kaufman, A., & Shimony, E. (1987). 3D scan-conversion algorithms for voxel-based graphics. Proceedings of the 1986 workshop on Interactive 3D graphics - SI3D ’86 (pp. 45–75). New York, New York, USA: ACM Press. doi:10.1145/319120.319126.

  • Lilliefors, H. B. (1967). On the Kolmogorov-Smirnov Test for Normality with Mean and Variance Unknown. Journal of the American Statistical Association, 318(62), 399–402. American Statistical Association. Retrieved from http://www.jstor.org/stable/2283970.

    Article  Google Scholar 

  • Marcus, D. S., Wang, T. H., Parker, J., Csernansky, J. G., Morris, J. C., & Buckner, R. L. (2007a). Open Access Series of Imaging Studies (OASIS): Cross-sectional MRI Data in Young, Middle Aged, Nondemented, and Demented Older Adults. Journal of Cognitive Neuroscience, 19(9), 9.

    Article  Google Scholar 

  • Marcus, D. S., Olsen, T. R., Ramaratnam, M., & Buckner, R. L. (2007b). The Extensible Neuroimaging Archive Toolkit: an informatics platform for managing, exploring, and sharing neuroimaging data. Neuroinformatics, 5(1), 11–34.

    Google Scholar 

  • Mazura, J. C., Juluru, K., Chen, J. J., Morgan, T. A., John, M., & Siegel, E. L. (2011). Facial recognition software success rates for the identification of 3D surface reconstructed facial images: implications for patient privacy and security. Journal of Digital Imaging: the Official Journal of the Society for Computer Applications in Radiology. doi:10.1007/s10278-011-9429-3.

  • Prior, F. W., Brunsden, B., Hildebolt, C., Nolan, T. S., Pringle, M., Vaishnavi, S. N., et al. (2009). Facial recognition from volume-rendered magnetic resonance imaging data. IEEE Transactions on Information Technology in Biomedicine: a Publication of the IEEE Engineering in Medicine and Biology Society, 13(1), 5–9. doi:10.1109/TITB.2008.2003335.

    Article  Google Scholar 

  • Ridler, T. W., & Calvard, S. (1978). Picture Thresholding Using an Iterative Selection Method. IEEE Transactions on Systems, Man, and Cybernetics, 8(8), 630–632. doi:10.1109/TSMC.1978.4310039.

    Article  Google Scholar 

  • Rowland, D. J., Garbow, J. R., Laforest, R., & Snyder, A. Z. (2005). Registration of [18F]FDG microPET and small-animal MRI. Nuclear Medicine and Biology, 32(6), 567–572. doi:10.1016/j.nucmedbio.2005.05.002.

    Article  PubMed  CAS  Google Scholar 

  • Smith, S. M. (2002). Fast robust automated brain extraction. Human Brain Mapping, 17(3), 143–155. doi:10.1002/hbm.10062.

    Article  PubMed  Google Scholar 

  • Wells, W. M., III, Viola, P., Atsumi, H., Nakajima, S., & Kikinis, R. (1996). Multi-modal volume registration by maximization of mutual information. Medical Image Analysis, 1(1), 35–51. doi:10.1016/S1361-8415(01)80004-9.

    Article  PubMed  Google Scholar 

  • Zhang, Y., Brady, M., & Smith, S. (2001). Segmentation of brain MR images through a hidden Markov random field model and the expectation-maximization algorithm. IEEE Transactions on Medical Imaging, 20(1), 45–57. doi:10.1109/42.906424.

    Article  PubMed  CAS  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Mikhail Milchenko.

Appendix

Appendix

Generating the “internal” and “external” Surfaces

Given the original volume V with dimensions {m, n, k}, we can represent an anatomical surface S as a height field F 0(\( {\cal x} \),y)over plane XY (Fig. 1). Using ray casting with discrete step w along X and Y axes, values of F are obtained in points

$$ F_{{i,j}}^0 = {F^0}\left( {iw,jw} \right),\;i = 0, \ldots, \left[ {{{m} \left/ {w} \right.}} \right] - 1,\;j = 0, \ldots, [{{n} \left/ {w} \right.}] - 1. $$
(3)

Denoting for \( s_{{i,j}}^0 \) a vertex with coordinates\( \left( {iw,jw,F_{{i,j}}^0} \right) \) belonging to an anatomical surface, a “natural” triangulation T of S 0 composed of triangles \( T_{{ij}}^1 = \left( {{s_{{i,j}}},\;{s_{{i,j + 1}}},\;{s_{{i + 1,j}}}} \right) \) and \( T_{{ij}}^2 = \left( {{s_{{i,j + 1}}},\;{s_{{i + 1,j + 1}}},\;{s_{{i + 1,j}}}} \right) \) can be selected (Fig. 10). Using T, it is now possible to describe the thin layer L that encloses anatomical surface and has roughly constant thickness. For that purpose, we construct triangulation meshes T t and T b of “external” S t (“above” S) and “deep” S b (“below” S) surfaces. Noting that \( \sum\limits_{{k = 1}}^4 {{{( - 1)}^k}n_{{i,j}}^k = 0} \), an averaged unit normal \( {\bar{n}_{{i,j}}} \) at this vertex is computed as

Fig. 10
figure 10

Triangulation S of the anatomical surface S 0

$$ {\bar{n}_{{i,j}}} = {{{\left( {n_{{i,j}}^1 + n_{{i,j}}^3} \right)}} \left/ {{\left\| {n_{{i,j}}^1 + n_{{i,j}}^3} \right\|}} \right.}, $$
(4)

where \( n_{{i,j}}^k,\;k = 1, \ldots, 4 \) are outer unit normals of four triangular faces Θ1,…,Θ4 of T that have a common vertex (Fig. 11).

Fig. 11
figure 11

The average normal in vertex S i,j (left) and construction of upper triangulation Θ t (right)

If we travel a fixed distance h along \( {\overline n_{{i,j}}} \) in “outer” (“upward”) direction, we will arrive at a vertex of the “external” triangulation T t sharing the XY parameterization with T, and similarly for “internal” surface triangulation T b:

$$ s_{{i,j}}^t = {s_{{i,j}}} + v_{{i,j}}^{{edge}},\quad s_{{i,j}}^b = {s_{{i,j}}} - v_{{i,j}}^{{edge}}, $$
(5)

where

$$ v_{{i,j}}^{{edge}} = \tfrac{1}{4}h{\bar{n}_{{i,j}}}\sum\limits_{{k = 1}}^4 {\frac{1}{{({{\bar{n}}_{{i,j}}},n_{{i,j}}^k)}}} . $$
(6)

Thus, T t and T b are fully determined by (9–10). Since these surfaces have triangular faces that are nearly parallel to the corresponding faces of S, the thickness of L is maintained about 2 h.

Boundary Volume Projection

The purpose of this derivation is to describe projection of L onto “thin” rectangular volume with dimensions m×n×h (Fig. 3b). Consider the quasi-block Ω i,j formed by two space quadrilateral faces of S t and S b(Fig. 12). Each Ω i,j can be consistently partitioned into six tetrahedra, as illustrated on Fig. 3e and f. Since cuboid box is an instance of octahedral element, establishing one-to-one correspondence between quasi-block Ω i,j and a proper block is equivalent to establishing correspondence between each pair of matching tetrahedra.

Fig. 12
figure 12

Quasi-block partition element Ω i,j of the anterior layer L

Combining all transformed boxes together constitutes the new “flattened” rectangular volume (Fig. 3). Thus, one-to-one correspondence between L and is established via piecewise linear transform.

Consider the box volume with dimensions m×n×h (Fig. 3b). Consider the partition of into proper blocks , where indices i and j have the same meaning as in Figs. 10, 11 and 12. Our aim is to establish a transformation f between these partitions such that:

(7)

Since each Ω i,j has eight vertices, it is possible to partition it into six tetrahedra \( T_{{i,j}}^1,\, \ldots, \,T_{{i,j}}^6 \) (As illustrated on Fig. 3e), and because there is a one to one correspondence between Ω i,j and , a matching tetrahedral partition can be also selected for (Fig. 3f) and matching affine transformation be computed. Since Ω i,j provides a partition of L, combining individual affine transformations\( f_{{i,j}}^k \) for each pair of \( \Omega_{{i,j}}^b \) and Ω i,j (Fig. 3c and d) will define a continuous non-degenerate piecewise linear transformation f between L and :

(8)

Denoting the 4×4 affine transformation matrix from \( T_{{i,j}}^k \) to for \( A_{{i,j}}^k \)\( f_{{i,j}}^k \) for an arbitrary point\( \ P\left( {\matrix{ {{x_p}} &{{y_p}} &{{z_p}} & 1 \\ }<!end array> } \right) \) in Ω i,j can be expressed as

$$ f_{{i,j}}^k(P) = A_{{i,j}}^k\left( {\matrix{ {{x_p}} &{{y_p}} &{{z_p}} & 1 \\ }<!end array> } \right),\quad P \in T_{{i,j}}^k $$
(9)

Coefficients of \( A_{{i,j}}^k \) are calculated from the system of 12 linear equations with 12 unknowns matching the vertices of T k and \( T_k^b \). Once this transform is calculated, intensities in target tetrahedron \( T_k^b \) are assigned by discrete 3D scanline filling (Kaufman and Shimony 1987) of its bounding box, and applying \( {\left( {A_{{i,j}}^k} \right)^{{ - 1}}} \) to each voxel that is determined to be inside of \( T_k^b \) to find the matching voxel in T k . Thus, for transformation from L to , the following discrete stepping procedure is applied:

  1. a.

    For each Ω i,j , do steps b–d:

  2. b.

    For each k, form a system of 12 equations expressing the affine transform for each member tetrahedron of Ω i,j ;

  3. c.

    Determine an affine transformation matrix \( A_{{i,j}}^k \) and its inverse ;

  4. d.

    For each voxel in , determine the matching tetrahedron (k can be one of 1,…,6) and find the corresponding voxel from \( T_{{i,j}}^k \) using , and set its intensity to the intensity of its prototype.

The transform back from to L is performed by scanning Ω i,j instead of , and following steps a-c, switching symbols with hat with symbols without hat.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Milchenko, M., Marcus, D. Obscuring Surface Anatomy in Volumetric Imaging Data. Neuroinform 11, 65–75 (2013). https://doi.org/10.1007/s12021-012-9160-3

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12021-012-9160-3

Keywords

Navigation