Journal of Digital Imaging

, Volume 31, Issue 6, pp 904–911 | Cite as

Three-Dimensional Surface Point Cloud Ultrasound for Better Understanding and Transmission of Ultrasound Scan Information

  • Joseph Nathaniel StemberEmail author


Ultrasound is notoriously plagued by high user dependence. There is a steep drop-off in information in going from what the sonographer sees during image acquisition and what the interpreting radiologist is able to view at the reading station. One countermeasure is probe localization and tracking. Current implementations are too difficult and expensive to use and/or do not provide adequate detail and perspective. The aim of this work was to demonstrate that a protocol combining surface three-dimensional photographic imaging with traditional ultrasound images may be a solution to the problem of probe localization, this approach being termed surface point cloud ultrasound (SPC-US). Ultrasound images were obtained of major vessels in an ultrasound training phantom, while simultaneously obtaining surface point cloud (SPC) 3D photographic images, with additional scanning performed on the right forearm soft tissues, kidneys, chest, and pelvis. The resulting sets of grayscale/color Doppler ultrasound and SPC images are juxtaposed and displayed for interpretation in a manner analogous to current text-based annotation or computer-generated stick figure probe position illustrations. Clearly demonstrated is that SPC-US better communicates information of probe position and orientation. Overall, it is shown that SPC-US provides much richer image representations of probe position on the patients than the current prevailing schemes. SPC-US turns out to be a rather general technique with many anticipated future applications, though only a few sample applications are illustrated in the present work.


Point cloud Three-dimensional surface Three-dimensional camera Ultrasound probe position Ultrasound navigation 



The author thanks the Roy and Diana Vagelos Education Center at Columbia University Medical Center for generous use of and assistance with their facilities, ultrasound machines, and phantom patients. The author also wishes to thank BluEdge for use of and assistance with the Artec Eva 3D camera.


  1. 1.
    Harris-Love MO, Ismail C, Monfaredi R, Hernandez HJ, Pennington D, Woletz P et al.: Interrater reliability of quantitative ultrasound using force feedback among examiners with varied levels of experience. PeerJ. 4:e2146, 2016CrossRefGoogle Scholar
  2. 2.
    Dhyani M, Roll SC, Gilbertson MW, Orlowski M, Anvari A, Li Q et al.: A pilot study to precisely quantify forces applied by sonographers while scanning: a step toward reducing ergonomic injury. Work. 58(2):241–247, 2017CrossRefGoogle Scholar
  3. 3.
    Gilbertson MW, Anthony BW: An ergonomic, instrumented ultrasound probe for 6-axis force/torque measurement. Conf Proc IEEE Eng Med Biol Soc. 2013:140–143, 2013PubMedGoogle Scholar
  4. 4.
    Du X, Anthony B: Controlled angular and radial scanning for super resolution concentric circular imaging. Opt Express. 24(20):22581–22595, 2016CrossRefGoogle Scholar
  5. 5.
    Sun SY, Gilbertson M, Anthony BW: Probe localization for freehand 3D ultrasound by tracking skin features. Med Image Comput Comput Assist Interv. 17(Pt 2):365–372, 2014PubMedGoogle Scholar
  6. 6.
    Xiang Z, Fincke J, Kuzmin A, Lempitsky V, Anthony B: A single element 3D ultrasound tomography system. Conf Proc IEEE Eng Med Biol Soc. 2015:5541–5544, 2015Google Scholar
  7. 7.
    Beller S, Hunerbein M, Eulenstein S, Lange T, Schlag PM: Feasibility of navigated resection of liver tumors using multiplanar visualization of intraoperative 3-dimensional ultrasound data. Ann Surg. 246(2):288–294, 2007CrossRefGoogle Scholar
  8. 8.
    Kucukkaya F, Aribal E, Tureli D, Altas H, Kaya H: Use of a volume navigation technique for combining real-time ultrasound and contrast-enhanced MRI: accuracy and feasibility of a novel technique for locating breast lesions. AJR Am J Roentgenol. 206(1):217–225, 2016CrossRefGoogle Scholar
  9. 9.
    Muns A, Meixensberger J, Arnold S, Schmitgen A, Arlt F, Chalopin C et al.: Integration of a 3D ultrasound probe into neuronavigation. Acta Neurochir (Wien). 153(7):1529–1533, 2011CrossRefGoogle Scholar
  10. 10.
    Putzer D, Arco D, Schamberger B, Schanda F, Mahlknecht J, Widmann G et al.: Comparison of two electromagnetic navigation systems for CT-guided punctures: a phantom study. Rofo. 188(5):470–478, 2016CrossRefGoogle Scholar
  11. 11.
    Joh JH, Han SA, Kim SH, Park HC: Ultrasound fusion imaging with real-time navigation for the surveillance after endovascular aortic aneurysm repair. Ann Surg Treat Res. 92(6):436–439, 2017CrossRefGoogle Scholar
  12. 12.
    Ma L, Nakamae K, Wang J, Kiyomatsu H, Tsukihara H, Kobayashi E et al.: Image-guided laparoscopic pelvic lymph node dissection using stereo visual tracking free-hand laparoscopic ultrasound. Conf Proc IEEE Eng Med Biol Soc. 2017:3240–3243, 2017PubMedGoogle Scholar
  13. 13.
    Ungi T, Moult E, Schwab JH, Fichtinger G: Tracked ultrasound snapshots in percutaneous pedicle screw placement navigation: a feasibility study. Clin Orthop Relat Res. 471(12):4047–4055, 2013CrossRefGoogle Scholar
  14. 14.
    Takamoto T, Mise Y, Satou S, Kobayashi Y, Miura K, Saiura A et al.: Feasibility of intraoperative navigation for liver resection using real-time virtual sonography with novel automatic registration system. World J Surg., 2017Google Scholar
  15. 15.
    Doba N, Fukuda H, Numata K, Hao Y, Hara K, Nozaki A et al.: A new device for fiducial registration of image-guided navigation system for liver RFA. Int J Comput Assist Radiol Surg., 2017Google Scholar
  16. 16.
    Marin JR, Lewiss RE, American Academy of Pediatrics CoPEM, Society for Academic Emergency Medicine AoEU, American College of Emergency Physicians PEMC, World Interactive Network Focused on Critical U: Point-of-care ultrasonography by pediatric emergency medicine physicians. Pediatrics. 135(4):e1113–e1122, 2015CrossRefGoogle Scholar
  17. 17.
    Chung E, Marchetti MA, Scope A, Dusza SW, Fonseca M, DaSilva D et al.: Towards three-dimensional temporal monitoring of naevi: a comparison of methodologies for assessing longitudinal changes in skin surface area around naevi. Br J Dermatol. 175(6):1376–1378, 2016CrossRefGoogle Scholar
  18. 18.
    Margolin EJ, Mlynarczyk CM, Mulhall JP, Stember DS, Stahl PJ: Three-dimensional photography for quantitative assessment of penile volume-loss deformities in Peyronie’s disease. J Sex Med. 14(6):829–833, 2017CrossRefGoogle Scholar
  19. 19.
    Halula SE, Leino DG, Patel MN, Racadio JM, Lungren MP: Isolated upper extremity posttransplant lymphoproliferative disorder in a child. Case Rep Radiol. 2015:813989, 2015PubMedPubMedCentralGoogle Scholar
  20. 20.
    Hansen KL, Nielsen MB, Ewertsen C: Ultrasonography of the kidney: a pictorial review. Diagnostics (Basel). 6(1), 2015CrossRefGoogle Scholar

Copyright information

© Society for Imaging Informatics in Medicine 2018

Authors and Affiliations

  1. 1.Department of RadiologyColumbia University Medical CenterNew YorkUSA

Personalised recommendations