Organ Localization Using Joint AP/LAT View Landmark Consensus Detection and Hierarchical Active Appearance Models

  • Qi Song
  • Albert MontilloEmail author
  • Roshni Bhagalia
  • V. Srikrishnan
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8331)


Parsing 2D radiographs into anatomical regions is a challenging task with many applications. In the clinic, scans routinely include anterior-posterior (AP) and lateral (LAT) view radiographs. Since these orthogonal views provide complementary anatomic information, an integrated analysis can afford the greatest localization accuracy. To solve this integration we propose automatic landmark candidate detection, pruned by a learned geometric consensus detector model and refined by fitting a hierarchical active appearance organ model (H-AAM). Our main contribution is twofold. First, we propose a probabilistic joint consensus detection model which learns how landmarks in either or both views predict landmark locations in a given view. Second, we refine landmarks by fitting a joint H-AAM that learns how landmark arrangement and image appearance can help predict across views. This increases accuracy and robustness to anatomic variation. All steps require just seconds to compute and compared to processing the scouts separately, joint processing reduces mean landmark distance error from 27.3 mm to 15.7 mm in LAT view and from 12.7 mm to 11.2 mm in the AP view. The errors are comparable to human expert inter-observer variability and suitable for clinical applications such as personalized scan planning for dose reduction. We assess our method using a database of scout CT scans from 93 subjects with widely varying pathology.


Automatic landmark localization Organ localization Image parsing CT Hierarchical active appearance model Rejection cascade 


  1. 1.
    Cootes, T., Edwards, G., Taylor, C.: Active appearance models. IEEE Trans. Pattern Anal. Mach. Intell. 23(6), 681–685 (2001)CrossRefGoogle Scholar
  2. 2.
    Cootes, T.F., Ionita, M.C., Lindner, C., Sauer, P.: Robust and accurate shape model fitting using random forest regression voting. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012, Part VII. LNCS, vol. 7578, pp. 278–291. Springer, Heidelberg (2012)Google Scholar
  3. 3.
    Cootes, T., Taylor, C., Cooper, D., Graham, J.: Active shape models-their training and application. Comput. Vis. Image Underst. 61(1), 38–59 (1995)CrossRefGoogle Scholar
  4. 4.
    Freund, Y., Schapire, R.: Experiments with a new boosting algorithm. In: Saitta, L. (ed.) ICML, pp. 148–156. Morgan Kaufmann, San Francisco (1996)Google Scholar
  5. 5.
    Montillo, A., Song, Q., Liu, X., Miller, J.: Parsing radiographs by integrating landmark set detection and multi-object active appearance models. SPIE Medical Imaging (2013)Google Scholar
  6. 6.
    Potesil, V., Kadir, T., Platsch, G., Brady, M.: Personalization of pictorial structures for anatomical landmark localization. In: Székely, G., Hahn, H.K. (eds.) IPMI 2011. LNCS, vol. 6801, pp. 333–345. Springer, Heidelberg (2011)Google Scholar
  7. 7.
    Seifert, S., Barbu, A., Zhou, S., Liu, D., Feulner, J., Huber, M., Suehling, M., Cavallaro, A., Comaniciu, D.: Hierarchical parsing and semantic navigation of full body CT data. SPIE Med. Imaging 7259, 02:1–8 (2009)Google Scholar
  8. 8.
    Tao, Y., Peng, Z., Krishnan, A., Zhou, X.: Robust learning-based parsing and annotation of medical radiographs. IEEE Trans. Med. Imaging 30(2), 338–350 (2011)CrossRefGoogle Scholar
  9. 9.
    Viola, P., Jones, M.: Robust real-time face detection. IJCV 57(2), 137–154 (2004)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2014

Authors and Affiliations

  • Qi Song
    • 1
  • Albert Montillo
    • 1
    Email author
  • Roshni Bhagalia
    • 1
  • V. Srikrishnan
    • 2
  1. 1.General Electric Global ResearchNiskayunaUSA
  2. 2.General Electric Global ResearchBangaloreIndia

Personalised recommendations