Skip to main content
SpringerLink
Log in

Using IPython for Teaching Web Scraping

  • Chapter
  • First Online:
Social Media Shaping e-Publishing and Academia

Abstract

Web scraping constitutes an indispensable part of information gathering and data intelligence. IPython has been the de facto project for data science since 2001. In this chapter, IPython is employed to support educators in teaching the fundamentals of web scraping. The authors identify providing detailed labs as free online resources together with model answers as the main contribution of this chapter.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
eBook
USD 16.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 54.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    https://github.com/ipython/ipython.

  2. 2.

    https://github.com/ipython/ipython/wiki/A-gallery-of-interesting-IPython-Notebooks.

  3. 3.

    http://jupyter.org/.

  4. 4.

    http://jupyter.readthedocs.org/en/latest/install.html.

  5. 5.

    https://github.com/ashemery/pyScraping.

  6. 6.

    https://docs.python.org/2/library/urllib2.html.

  7. 7.

    http://www.crummy.com/software/BeautifulSoup/.

  8. 8.

    https://docs.python.org/2/library/re.html.

  9. 9.

    https://www.base64encode.org/.

  10. 10.

    https://pypi.python.org/pypi/requests.

References

  1. Le QT, Pishva D (2015) Application of web scraping and Google API service to optimize convenience stores’ distribution. In: 17th International conference on advanced communication technology (ICACT). pp 478–482

    Google Scholar 

  2. Vargiu E, Urru M (2012) Exploiting web scraping in a collaborative filtering-based approach to web advertising. Artif Intell Res 2:44–54. doi:10.5430/air.v2n1p44

    Google Scholar 

  3. Malik SK, Rizvi S (2011) Information extraction using web usage mining, web scraping and semantic annotation. In: Proceedings of the 2011 international conference on computational intelligence and communication networks. IEEE Computer Society, Washington, DC, USA, pp 465–469

    Google Scholar 

  4. Pérez F, Granger BE (2007) IPython: a system for interactive scientific computing. Comput Sci Eng 9:21–29. doi:10.1109/MCSE.2007.53

    Article  Google Scholar 

  5. Rossant C (2014) IPython interactive computing and visualization cookbook. Packt Publishing

    Google Scholar 

  6. Martins LF (2014) IPython notebook essentials. Packt Publishing

    Google Scholar 

  7. Rossant C (2015) Learning IPython for interactive computing and data visualization 2nd edn. Packt Publishing

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. King Hussein Faculty of Computing Sciences, Computer Science Department, Princess Sumaya University for Technology (PSUT), Amman, Jordan

    Ali Hadi

  2. The University of Jordan, Amman, Jordan

    Malek Al-Zewairi

  3. Jordan Information Security and Digital Forensics (JISDF) Research Group, Amman, Jordan

    Ali Hadi & Malek Al-Zewairi

Authors
  1. Ali Hadi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Malek Al-Zewairi
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Ali Hadi .

Editor information

Editors and Affiliations

  1. The University of Jordan, Amman, Jordan

    Nashrawan Taha

  2. The University of Jordan , Amman, Jordan

    Rizik Al-Sayyed

  3. The University of Jordan, Amman, Jordan

    Ja'far Alqatawna

  4. Department of Business Information Technology, King Abdullah II School of Information Technology (KASIT) The University of Jordan, Amman, Jordan

    Ali Rodan

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this chapter

Cite this chapter

Hadi, A., Al-Zewairi, M. (2017). Using IPython for Teaching Web Scraping. In: Taha, N., Al-Sayyed, R., Alqatawna, J., Rodan, A. (eds) Social Media Shaping e-Publishing and Academia. Springer, Cham. https://doi.org/10.1007/978-3-319-55354-2_5

Download citation

Publish with us

Policies and ethics

Search

Navigation