Abstract
Introduction
Sentinel lymph node biopsy for oral and oropharyngeal squamous cell carcinoma is a well-established staging method. One variation is to inject a radioactive tracer near the primary tumor of the patient. After a few minutes, audio feedback from an external hand-held \(\gamma \)-detection probe can monitor the uptake into the lymphatic system. Such probes place a high cognitive load on the surgeon during the biopsy, as they require the simultaneous use of both hands and the skills necessary to correlate the audio signal with the location of tracer accumulation in the lymph nodes. Therefore, an augmented reality (AR) approach to directly visualize and thus discriminate nearby lymph nodes would greatly reduce the surgeons’ cognitive load.
Materials and methods
We present a proof of concept of an AR approach for sentinel lymph node biopsy by ex vivo experiments. The 3D position of the radioactive \(\gamma \)-sources is reconstructed from a single \(\gamma \)-image, acquired by a stationary table-attached multi-pinhole \(\gamma \)-detector. The position of the sources is then visualized using Microsoft’s HoloLens. We further investigate the performance of our SLNF algorithm for a single source, two sources, and two sources with a hot background.
Results
In our ex vivo experiments, a single \(\gamma \)-source and its AR representation show good correlation with known locations, with a maximum error of 4.47 mm. The SLNF algorithm performs well when only one source is reconstructed, with a maximum error of 7.77 mm. For the more challenging case to reconstruct two sources, the errors vary between 2.23 mm and 75.92 mm.
Conclusion
This proof of concept shows promising results in reconstructing and displaying one \(\gamma \)-source. Two simultaneously recorded sources are more challenging and require further algorithmic optimization.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
Introduction
The currently established protocol for sentinel lymph node biopsy (SNB) for oropharyngeal cancer treatment involves monitoring the uptake of a circum-tumor (e.g., in the tongue) injected radioactive 99 mTc-labeled tracer [1]. A hand-held \(\gamma \)-detection probe (HGDP) is used to measure the uptake. The highest uptake is likely to be observed in sentinel lymph nodes (SLN), downstream of the tumor, and at the injection site. Post-extraction analysis of these SLNs then allows the assessment of the spreading. If no malignant cells are found (i.e., clinically negative neck, cN0), the tumor has not yet begun to spread. Otherwise, elective neck dissection (END) is performed where parts of the lymphatics of the neck are removed in the hope of containing occult metastases. An indication of a cN0 shows a good prognosis for 70 % of such cases, and the need for an END is thus unjustified [2]. Many centers conduct neck dissection for all their patients, therefore overtreating most of them.
The HGDP approach converts the activity of the tracer accumulation into audio feedback. Relying on such feedback requires spatial awareness on the part of the operator to correlate it with the actual position of the detected hot spots, resulting in a high cognitive load. Operating the HGDP interrupts the excision process and adds complexity to the workflow. SPECT/CT can help localize the SLN and improve surgical planning but does not alleviate the need for real-time intraoperative localization. The use of augmented reality (AR) for navigation could reduce the surgeon’s workload and assist them in performing accurate SLNs, potentially reducing the risk of missing relevant lymph nodes and avoiding overtreatment.
AR in surgery is gaining traction, e.g., in spinal fusion surgery and orthopedics [3], or in assessing robot-assisted approaches and procedures in minimally invasive surgery [4]. A medical device combining a classical HGDP with AR is commercially available.Footnote 1 This freehand SPECT device differs from our envisioned approach, as it requires, for example, an optical outside-in tracking system. Further, the augmentation is not displayed in the surgeon’s field of view (FoV). Our integrated approach is based on a pipeline (Fig. 1): the influence of errors (cf. Fig. 1, question marks), e.g., filter settings of the \(\gamma \)-detector, reconstruction inaccuracies, and pose estimation imprecision, were experimentally evaluated. In the first stage, the detector registers the \(\gamma \)-source activity. In subsequent stages, the image is sent to the reconstruction algorithm, and the computed position of the source is transferred wirelessly to the AR headset and displayed accordingly. In this study, the first three experiments assess the reconstruction algorithm under different conditions, and the fourth experiment examines the actual AR quality of the reconstruction.
Materials and methods
Materials
We used a 750 \(\upmu \)m-thick cadmium telluride (CdTe) crystal \(\gamma \)-detector with a hybrid photon counting (HPC) CMOS chip [5]. Its pixel size is 75 \(\upmu \)m2, with an image resolution of 1030 \(\times \) 514 pixels, and quantum efficiency of 10 % at 140.5 keV for 99mTc [6]. The device supports two thresholds in the range of [9 keV, 70 keV] to filter out \(\gamma \)-rays of a specific keV regime. In a preprocessing step, all the images were binned (summing pixel neighborhoods) to 515 \(\times \) 257 pixels to be computationally more efficient (Fig. 2). Our industrial partner DECTRIS Ltd, Baden, Switzerland, provided the device. A custom 3D printed tungsten (W) collimator was placed in front of the sensor [7]. This element has a mass attenuation coefficientFootnote 2 of 1.58 \({\textrm{cm}}^{2}\,{\textrm{g}}^{-1}\) at 140.5 keV.
The size and weight of the collimators are often not considered to be limiting factors, given their application scenario in a fixed setting, e.g., embedded into a stationary SPECT/CT device for preoperative imaging. This, however, changes for radio-guided surgery where, due to limited space in the operation room, only a small collimator is applicable. Hence, a trade-off between the aforementioned characteristics has to be made. The overall size of the collimator/detector is d \(\times \) h \(\times \) w: 280 \(\times \) 90 \(\times \) 110 mm3. The overall weight of the \(\gamma \)-detector and collimator is 4005 g. As our compact collimator consists of relatively thin walls, their shielding properties are limited and facilitate the unwanted penetration of \(\gamma \)-photons, i.e., 5 % to 10 %, blurring the image. We used a multi-pinhole collimator, inspired by the collimator proposed by [8] (see Appendix A.2 for more details). The pinholes have a diameter of 1 mm, a thickness of 1 mm, and a FoV of 90 \({}^{\circ }\). Microsoft’s HoloLens 2 (HL2) has the ability to do inside-out tracking [9]. With its spatial mapping functionality, based on integrated sensors (i.e., IMUs, infrared-based depth sensors) and the Mixed Reality Toolkit (MRTK), no additional tracking hardware is needed to align real and virtual objects [10, 11]. The optics of the waveguide display enable a FoV of approximately 53 \({}^{\circ }\). To simulate SLNs, we used 99mTc sources for the experiments. These 99mTc sources were filled into 0.5 mL vials with activities of 5 MBq, 15 MBq, 30 MBq, and 60 MBq, respectively. In addition, we used a small amount of tracer with an activity of 120 MBq for the cellulose/lignin matrix of the wooden block to emit constant radiation to simulate a hot background. These activities are high compared to tracer-enriched tissue. However, an increased exposure time for in vivo experiments with lower activity can compensate for this.
Methods
Reconstruction
We reconstructed the 99mTc distribution u in a 3D subspace using a single detector image (Fig. 3d), as described in [8, 12]. We simplified our model by assuming that the photons travel in a straight line from the source through the pinholes to the detector. Therefore, the relationship between the 3D subspace \(u\in {\mathbb {R}}^M_{\ge 0}\) and the 2D detector image \(d^{proj}\in {\mathbb {R}}^N_{\ge 0}\) can be described by a linear mapping operator \(A\in \{0,1\}^{N\times M}\), with
We used \(d^{proj}\) and u as vectors, so we can describe their relationship as a matrix–vector multiplication (Eq. 1). The entry \(A_{ij}\) of the matrix A is 1, if a straight line through the pinhole from the voxel \(u_i\) to the pixel \(d^{proj}_j\) exists, and 0 otherwise. N is the number of pixels from the detector image and M is the number of the voxels from the 3D subspace. The sentinel lymph node fingerprinting (SLNF) algorithm [8] finds the position of the 99mTc source. SLNF (cf. Algorithm 1) compares the measured detector image \(d^{obs}\) with the projected detector image \(d^{proj}\). Note that for a different position of the simulated 99mTc source u, the projected detector image \(d^{proj}\) changes. For simplicity, the 99mTc source u is approximated as a point source in the projection (u has exactly one entry set to 1, and all others are set to 0), such that u corresponds to a (x, y, z) resulting in a unique \(d^{proj}\). We use the SLNF algorithm to find the (x, y, z) position of the 99mTc source; hence, we find (x, y, z) s.t. \(d^{proj}\) maximizes \(C(d^{proj},d^{obs})\):
where \(d^{obs}\) is the observed detector image from the experiment. We have made a small adaptation to the SLNF algorithm described in [8]. Namely, we assume that the number of sources is known. Note that in line 4 of Algorithm 1, the indices of \(d_i^{obs}\) are set to zero where \(d^{proj}_{i} > 0\), so that the information of the source found is removed, and the information of the next source is dominant. See [8] for a more detailed explanation.
To decrease the runtime of the algorithm, we reduced the size of the matrix A and the detector image \(d^{obs}\). The matrix occupies a subspace volume (x, y, z) of 60 \(\times \) 100 \(\times \) 200 sampling points with a spatial sampling distance of 2 mm in each dimension. The detector image size is 515 \(\times \) 257 sampling points, in accordance with the binned image size (Sect. “Materials and methods”). Since the z-range is limited to 200 mm, we only measure and reconstruct activity within this depth range. The anatomy of the neck and the lymphatics are usually covered within this range.
Assessment of the source positions An optimal design algorithm was introduced in [13], which the authors in [8] applied to find a pinhole pattern for the collimator. In Appendix A, we describe the transformation of the optimal design algorithm so that we could assess the ability to reconstruct different positions using our collimator. To compare the nine positions given in Fig. 4 and assess which positions will be challenging to reconstruct, we assumed that each is a point source. That being the case, all values of the subspace u are 0 except for one. We used solely the column of mapping operator A (see Eq. 1) corresponding with the nonzero value of u, which is the projection of u onto the detector. Thus, we can write for the sources \(i=1,\dots ,9\) the vector \(d^{(i)}\) corresponding to the detector image, which is one of the columns of the matrix A. Using the transformation of the optimal design algorithm described in Appendix A.3, the performance of the SLNF algorithm can be assessed for each source \(i=1,\dots ,9\) with
Calibration and augmentation
A calibration step establishes a correct transformation between the different coordinate systems or frames (Figs. 3, (a) - (c)). We start by letting the HL2 register the marker \(QR_1\) attached on top of the \(\gamma \)-detector, by leveraging the MRTK [11]. This initial detection yields the liminal space from which all further augmentation is computed. Therefore, detecting and tracking the marker \(QR_1\) by the HL2’s cameras is the anchor for scene augmentation. We also detect the marker \(QR_2\) that represents the collimator. This collimator-attached marker is only needed during calibration. As long as the relationship between the detector’s marker \(QR_1\) and the collimator, attached to the front, is not changed, no re-calibration is necessary.
The obtained calibration parameters are stored and reused for the actual augmentation, in conjunction with the current world position of \(T_1\) from \(QR_1\), and the computed dependent transform \(T_3\) (Fig. 3d).
Experiments
We investigated the performance of the SLNF-based 3D reconstruction of \(\gamma \)-sources and the quality of their 2D AR representation. For each experiment, we present the setup and the data. The measurement space with the ground truth location of the sources and their indices for the result tables is shown in Fig. 4. Experiments 1, 2, and 3 evaluate the errors introduced by the SLNF reconstruction algorithm, where the complexity increases with the scene setup, i.e., one source, two simultaneous sources, and two simultaneous sources with a hot background. We initially tested with two thresholds set to 9 keV and 49 keV on the \(\gamma \)-detector. We then only used the lower threshold because there was no significant difference in the results. Experiment 4 evaluates the augmentation errors, i.e., the reconstruction errors and the pose estimation errors, to obtain the overall performance of our approach. Each source position was measured 10 times, with an exposure time of 8 s/sample. For each experiment, we report the median and the 3rd quartile \(Q_3\) of the error \(\varepsilon \) of the sequence; \(Q_3\) provides additional insight into the resulting error distribution.
Experiment 1, reconstruction of one source In the first experiment, we used a single 0.5 mL 99mTc source with activities of 5 MBq or 15 MBq that were placed at each of the positions of the wooden block (cf. source position indices Fig. 4).
Experiment 2, reconstruction of two sources Simultaneously measuring two 0.5 mL 99mTc sources with activities of 15 MBq at two different positions of the wooden block (cf. source position indices Fig. 4, Table 2).
Experiment 3, reconstruction of two sources with a hot background Simultaneously measuring two 0.5 mL 99mTc sources with activities of 30 MBq and 60 MBq, and with an induced hot background: A small amount of tracer with an activity of 120 MBq was put into the cellulose/lignin matrix of the wooden block to emit constant radiation (cf. source position indices Fig. 4, Table 3).
Experiment 4, AR assessment The evaluation of the augmentation accuracy was done on the 2D projection of the x, y, z axes to compare the results from the SLNF-reconstructed source with the ground truth. As we did not use an external tracking system, a coordinate system different from the one used for Experiments 1, 2, and 3 was applied. The AR blended-in objects (clusters) were manually segmented. To reduce potential drift from the inside-out tracking of the HL2 [14] during measurement, we mounted an additional marker on top of the vial with the tracer; this marker is detected by the HL2 and served as ground truth (green cluster in Figs. 5, 6, and 7) for comparing the location of the SLNF-reconstructed source (red cluster in Figs. 5, 6, and 7) at that position. For each position, first-person view images from the perspective of the HL2 bearer were recorded for the main axes x, y, z (cf. Table 4, Figs. 5, 6, and 7). In each image, the ruler was used to give absolute values of the position of the cluster. The computation speed is mainly governed by the \(\gamma \)-detector settings, i.e., exposure time and the requested number of images, and the runtime of the SLNF reconstruction algorithm. In our setup, we used an image series of 10 measurements/position with an exposure time of 8 s/measurement. The reconstruction algorithm took approx. 1.5 s to compute the position per measurement. Therefore, the update time for a new position was approx. 2 min. A scene redrawing for a computed position is done at a frame rate of approx. 16 fps (frames per second), given by the HL2’s render capabilities [14]. This is crucial for a good AR experience.
Results
Experiment 1, reconstruction of one source The overall median for the 5 MBq source is 3.73 mm with \(Q_3\) at 4.79 mm. The overall median for the 15 MBq source is 3.79 mm with \(Q_3\) at 4.58 mm. See Table 1 for detailed results.
Experiment 2, reconstruction of two sources The lowest medians are for Positions 7, 9 (3.14 mm, 2.23 mm) with \(Q_3\) at (4.47 mm, 2.80 mm). See Table 2 for detailed results.
Experiment 3, reconstruction of two sources with a hot background The lowest medians are for Positions 2 (60), 3 (60), (4.47 mm, 6.32 mm) with \(Q_3\) at (4.47 mm, 9.22 mm). See Table 3 for detailed results.
Experiment 4, AR assessment We applied the \(\mathrm {{\ell }^2}\)-norm to calculate the error or accuracy between the ground truth and the reconstructed source. We proceeded accordingly for all nine positions of Table 4. The lowest error of 0.00 mm is at Position 6, and the highest error of 4.47 mm is at Position 3.
Assessment of the source positions In Table 5, we compute the values of Eq. 3 for each of the nine sources and find that the highest value is at Position \(i=1\) with 3e-04, which can explain the high error at Position 1 in Tables 1 and 2.
Discussion
Experiment 1 shows a stable SLNF reconstruction in the single-source, varying activity case. For both activities, the overall median is 3.76 mm, and the overall \(Q_3\) is 4.73 mm (Table 5). For Position 1, the error distribution is highest due to the pattern design of the collimator (Sect. “Results”, Assessment of the source positions). The results of Experiment 2 and 3 show the limitations of the algorithm, with the highest medians and \(Q_3\) of 19.28 mm & 25.58 mm, and 74.35 mm & 75.92 mm, respectively. The algorithm works iteratively: (1) computes the position of the strongest source, (2) masks it from the resulting intermediate result, (3) continues to try to find the remaining sources, even if none exist. This might lead to larger errors. However, the first source detected and reconstructed is in a similar error range as is shown in Experiment 1. In Experiment 2, with Positions 1 & 7, 1 & 8, and 1 & 9, the reconstruction of Position 1 shows a larger error than the other positions. Compared to all the other results, these reconstructions additionally suffer from the bias due to the pattern design of the collimator. The reconstruction errors for Positions 2 & 7, 2 & 8, and 2 & 9, are similar. The reconstruction for Positions 3 & 7, 3 & 8, and 3 & 9, reaches an error range comparable to Experiment 1. The error band narrows the further away the sources are placed from Position 1. In Table 2, the results are shown for Positions 1 & 3, 4 & 6, and 7 & 9, where two sources are laterally placed, i.e., on the same row of the wooden block. The algorithm has less trouble reconstructing non-overlapping sources. The reconstruction errors are comparable to the ones of Experiment 1.
The setup of Experiment 3 is challenging, as the hot background introduces ghost accumulations that influence the reconstruction significantly. The error is smaller if both sources are comparable in their activities and position. Nevertheless, the results are less conclusive, as can be seen by the large error distribution for Positions 2 & 3, with two activity combinations of 30 MBq and 60 MBq
The results of Experiment 4 are mainly influenced by two factors: (1) the quality of the SLNF reconstruction and (2) the inside-out tracking. To assess these factors, the ground truth object (green cluster in Figs. 5, 6, and 7) was placed in the AR scene such that it is on top of the active source instead of being anchored on \(T_3\) (cf. Fig. 3). This minimized potential inside-out tracking errors and mitigated a potential drift of the AR objects during the measurements. The reconstruction (red cluster in Figs. 5, 6, and 7), with its origin on \(T_3\), was compared against this ground truth object to gauge accuracy. These comparisons allowed us to estimate whether systematic errors influenced the augmentation. As the errors were all in a similar range, namely from 0 mm to 4.47 mm, we assumed that no further inherent errors, e.g., drift, etc., were significant. The speed of the computation mainly depends on the runtime of the SLNF algorithm and the settings of the \(\gamma \)-detector (i.e., number of measurements, exposure time). Depending on the source activity, these settings can be adapted. And each measurement can be manually triggered by the surgeon. It is assumed that no quick motions around the region of interest, i.e., the neck of the patient, occur during the biopsy. This helps to avoid drift. Further, the tracer distribution in the lymphatic system is a rather slow process. As such, the HL2 AR rendering, done at a frame rate of approx. 16 fps, is sufficient, thanks also to the stable inside-out tracking. We note that the differences between Experiments 1 and 4 are due to the physical nature of these experiments.
Neighboring lymph nodes might have different drainage paths and need thus be identified accordingly. As these nodules have a diameter between 5 mm and 10 mm, an upper error boundary should be at around 5 mm. This goal is met for single-source reconstructions. Two sources cannot be separated, given this boundary.
Conclusion
This proof-of-concept study showed how an integrated approach works by combining a stationary \(\gamma \)-detector, a head-mounted display, and a reconstruction algorithm. Such a setup could support and improve sentinel lymph node biopsy (SNB) and thus also improve the patient’s outcome. The strenuous process of locating relevant lymph nodes using a hand-held \(\gamma \)-detecting probe can thus be significantly simplified using the power of AR. The detection and reconstruction of single sources with activities between 5 MBq and 60 MBq are robust, with errors in an acceptable range. The actual augmentation depends not only on the reconstruction quality but also on the inside-out tracking capabilities of the head-mounted display; in our case, it shows good accuracy and stability. The detection of multiple sources is challenging for the reconstruction algorithm. Thus, more experiments need to be done with phantoms, as well as with patient cohorts. Clinical measurements showed that the accumulated tracer in biologically active lymph nodes varies and is, in general, very low, i.e., 0.1 % − 10 % of the initially injected volume [15]. Therefore, exposure time and the \(\gamma \)-detector placement are crucial for reliable data acquisition. Our experiments show promising results for the proposed approach and deserve further research.
References
de Bree R, de Keizer B, Civantos FJ, Takes RP, Rodrigo JP, Hernandez-Prera JC, Halmos GB, Rinaldo A, Ferlito A (2021) What is the role of sentinel lymph node biopsy in the management of oral cancer in 2020? Eur Arch Otorhinolaryngol 278(9):3181–3191
Tartaglione G, Stoeckli SJ, De ree R, Schilling C, Flach GB, Bakholdt V, Sorensen JA, Bilde A, Von Buchwald C, Lawson G, Dequanter D, Villarreal PM, Forcelledo MFF, Amezaga JA, Moreira A, Poli T, Grandi C, Vigili MG, O’Doherty M, Donner D, Bloemena E, Rahimi S, Gurney B, Haerle SK, Broglie MA, Huber GF, Krogdah AL, Sebbesen LR, Odell E, Gutierrez LMJ, Barbier L, Santamaria-Zuazua J, Jacome M, Nollevaux MC, Bragantini E, Lothaire P, Silini EM, Sesenna E, Dolivet G, Mastronicola R, Leroux A, Sassoon I, Sloan P, Colletti PM, Rubello D, McGurk M (2016) Sentinel node in oral cancer: The nuclear medicine aspects. A survey from the sentinel European node trial. Clin Nucl Med 41(7):534–542
Liebmann F, Roner S, von Atzigen M, Scaramuzza D, Sutter R, Snedeker J, Farshad M, F’’urnstahl P (2019) Pedicle screw navigation using surface digitization on the microsoft hololens. Int J Comput Assist Radiol Surg 14(7):1157–1165
Żelechowski M, Karnam M, Faludi B, Gerig N, Rauter G, Cattin PC (2021) Patient positioning by visualising surgical robot rotational workspace in augmented reality. Comput Meth Biomech Biomed Eng: Imag Visualiz 00(00):1–7
Henrich B, Bergamaschi A, Broennimann C, Dinapoli R, Eikenberry EF, Johnson I, Kobas M, Kraft P, Mozzanica A, Schmitt B (2009) PILATUS: a single photon counting pixel detector for X-ray applications. Nucl Instrum Meth Phys Res, Sect A 607(1):247–249
Abbaspour S, Mahmoudian B, Islamian JP (2017) Cadmium telluride semiconductor detector for improved spatial and energy resolution radioisotopic imaging. World J Nucl Med 16(2):101
von Niederhäusern PA, Seppi C, Pezold S, Nicolas G, Gkoumas S, Haerle SK, Cattin PC (2019) Gamma source location learning from synthetic multi-pinhole collimator data. Lecture Notes in Computer Science, pp. 205–214
Nahum U, Seppi C, von Niederhäusern PA, Pezold S, Haerle SK, Cattin PC (2019) Sentinel lymph node fingerprinting. Phys Med Biol 64(11):115028
Microsoft: HoloLens 2. https://www.microsoft.com/en-us/hololens/hardware. Accessed 25 Mar (2023)
Microsoft: spatial mapping. https://docs.microsoft.com/en-us/windows/mixed-reality/design/spatial-mapping. Accessed 25 Mar (2023)
Microsoft: mixed reality toolkit for unity. https://github.com/microsoft/MixedRealityToolkit-Unity. Accessed 25 Mar (2023)
Seppi C, Nahum U, von Niederhäusern PA, Pezold S, Rissi M, Haerle SK, Cattin PC (2017) Compressed sensing on multi-pinhole collimator spect camera for sentinel lymph node biopsy. Lecture Notes in Computer Science, pp 415–423. Springer
Haber E, Horesh L, Tenorio L (2008) Numerical methods for experimental design of large-scale linear ill-posed inverse problems. Inverse Prob 24(5):055012
Microsoft: HoloLens 2; Drift. https://learn.microsoft.com/en-us/windows/mixed-reality/develop/advanced-concepts/hologram-stability. Accessed 08 Aug (2023)
Wendler T, Herrmann K, Schnelzer A, Lasser T, Traub J, Kutter O, Ehlerding A, Scheidhauer K, Schuster T, Kiechle M, Schwaiger M, Navab N, Ziegler SI, Buck AK (2010) First demonstration of 3-D lymphatic mapping in breast cancer using freehand SPECT. Eur J Nucl Med Mol Imag 37(8):1452–1461
Funding
Open access funding provided by University of Basel. This study received no external funding.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Ethical approval
This article did not involve any studies with human or animal participants conducted by the authors.
Informed consent
This article does not contain patient data.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
A Appendix
A Appendix
This Appendix aims to explain why we settled for the design of our collimator, and how we assessed the quality of the reconstruction of the source at different positions. To do so, we used an Optimal Design algorithm that was introduced in [13], which the authors in [8] applied to find a pinhole pattern for their collimator. We briefly recap of how the authors in [8] used the algorithm. Then we show that our new collimator is superior to theirs, and, in a final step, we explain how we can assess the performance of the collimator for different positions.
A.1 Background
In the approach of [8], they assumed \(N_p=200\) possible pinholes and tried to find the optimal pinholes for a given subspace of u. To this end, they defined
where \(A_n\) projects the subspace u on the detector, through the nth pinhole. We note that \(A_n\) takes the nonzero values of u into account and omits the others. They find the pinholes which are good for the reconstruction of the nonzero entries of u by minimizing over the weights \(w_m\) of the pinholes of the function
where
with
for \(W_m=\text {diag}(w_m,\dots ,w_m)\in {\mathbb {R}}^{N\times N}\) (with N being the number of pixels of the detector), and a specific \(\beta \) and \(\sigma \). In the final step, they chose the 24 pinholes with the highest weight \(w_m\) for their collimator.
A.2 Collimator
In the next step, we would like to improve the design of the collimator in comparison to the design of [8]. Similar to their approach, we compared four collimators with 24 pinholes. The first collimator had a regular pattern of 24 pinholes (\(3 \times 8)\), where each pinhole separated by a septum wall (symmetric collimator w/ septum walls), the second collimator had its septum walls removed (symmetric collimator w/o septum walls), the third one was the design of [8] (non-symmetric collimator SLNF), and the final collimator was our design using random pinholes (random-hole collimator). We computed for each of the collimators the value of Eq. 6, with \(w={\textbf{1}}=(1,\cdots ,1\)) and \(N_p = 24\), for 100 randomly-chosen subspaces (with one, two, three, or four sources of diameter 5 mm). We see in Table 6 that the mean value from \({\mathcal {V}}({\textbf{1}})\) is the lowest for our collimator and, therefore, a better design than the one used in [8].
A.3 Assessment of the source position
To compare the different positions of the sources for a specific collimator, we chose for all weights \(w_m\); hence, we have \({\mathcal {W}}=\text {diag}(1,\dots ,1)=E\) and reformulate Eq. 6 to
To compare the nine positions given in Fig. 4, and assess which positions will be challenging to reconstruct, we assumed that each is a point source. That being the case, all values of the subspace u are 0 except for one. We note that the column of A is a linear combination of \(A_1,\cdots , A_{24}\), where \(A_n\) projects the subspace u onto the detector through the nth pinhole. We can use the column of A corresponding with the nonzero value of u, which is the projection of u onto the detector, instead of \(\mathcal {A}\). To further simplify our equation, we write for the sources \(i=1,\dots ,9\) the vector \(d^{(i)}\) corresponding to the detector image, which is one of the columns of the matrix A. To assess the performance of the algorithm for the reconstruction of the specific source, we replace \(\mathcal {A}\) with each source separately with \(d^{(i)}\). Therefore, we are left with
for \(i=1,\dots ,9\).
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
von Niederhäusern, P.A., Seppi, C., Sandkühler, R. et al. Augmented reality for sentinel lymph node biopsy. Int J CARS 19, 171–180 (2024). https://doi.org/10.1007/s11548-023-03014-w
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11548-023-03014-w