Skip to main content

Visualizing and Understanding Policy Networks of Computer Go

  • 2815 Accesses

Part of the Lecture Notes in Computer Science book series (LNAI,volume 11012)

Abstract

In May 2017, the application of deep learning to the game “Go” enjoyed a tremendous victory when the AlphaGo computer program beat one of the top professional players. However, there is no clear understanding of why deep learning elicits such strong performance. In this paper, we introduce visualization techniques used in image recognition to investigate the functions of the intermediate layers and operations of the Go policy network. Used as a diagnostic tool, these visualization techniques allow us to understand what happens during the training of policy networks. We also introduce a visualization technique that performs a sensitivity analysis of the classifier output by occluding portions of the input Go board, revealing which parts of the board are important for predicting the next move.

Keywords

  • Deep learning
  • Computer Go
  • Visualization

This is a preview of subscription content, access via your institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • DOI: 10.1007/978-3-319-97304-3_20
  • Chapter length: 12 pages
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
eBook
USD   109.00
Price excludes VAT (USA)
  • ISBN: 978-3-319-97304-3
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
Softcover Book
USD   149.99
Price excludes VAT (USA)
Fig. 1.
Fig. 2.
Fig. 3.
Fig. 4.
Fig. 5.
Fig. 6.
Fig. 7.
Fig. 8.
Fig. 9.
Fig. 10.

References

  1. Clark, C., Storkey, A.: Training deep convolutional neural networks to play go. In: Proceedings of the 32nd International Conference on Machine Learning (ICML 2015), pp. 1766–1774 (2015)

    Google Scholar 

  2. Tian, Y., Zhu, Y.: Better computer go player with neural network and long-term prediction. arXiv preprint arXiv:1511.06410 (2015)

  3. Silver, D., Huang, A., Maddison, C.J., Guez, A., Sifre, L., et al.: Mastering the game of go with deep neural networks and tree search. Nature 529(7587), 484–489 (2016)

    CrossRef  Google Scholar 

  4. Maddison, C.J., et al.: Move evaluation in go using deep convolutional neural networks. arXiv preprint arXiv:1412.6564 (2014)

  5. Silver, D., Schrittwieser, J., Simonyan, K., Antonoglou, I., et al.: Mastering the game of Go without human knowledge. Nature 550(7676), 354–359 (2017)

    CrossRef  Google Scholar 

  6. Zeiler, M.D., Fergus, R.: Visualizing and understanding convolutional networks. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds.) ECCV 2014. LNCS, vol. 8689, pp. 818–833. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-10590-1_53

    CrossRef  Google Scholar 

  7. GoGoD. https://gogodonline.co.uk

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Yuanfeng Pang .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and Permissions

Copyright information

© 2018 Springer Nature Switzerland AG

About this paper

Verify currency and authenticity via CrossMark

Cite this paper

Pang, Y., Ito, T. (2018). Visualizing and Understanding Policy Networks of Computer Go. In: Geng, X., Kang, BH. (eds) PRICAI 2018: Trends in Artificial Intelligence. PRICAI 2018. Lecture Notes in Computer Science(), vol 11012. Springer, Cham. https://doi.org/10.1007/978-3-319-97304-3_20

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-97304-3_20

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-97303-6

  • Online ISBN: 978-3-319-97304-3

  • eBook Packages: Computer ScienceComputer Science (R0)