Skip to main content
SpringerLink
Log in

Web crawling and filtering for on-line auctions from a social network perspective

  • Original Article
  • Published:
Information Systems and e-Business Management Aims and scope Submit manuscript

Abstract

The on-line auction is one of the most successful types of electronic marketplace and has been the subject of many academic studies. In recent years, empirical research on on-line auctions has been flourishing because of the availability of large amounts of high-quality bid data from on-line auction sites. However, the increasingly large volumes of bid data have made data collection ever more complex and time consuming, and there are no effective resources that can adequately support this work. So this study focuses on the parallel crawling and filtering of on-line auctions from the social network perspective to help researchers collect and analyze auction data more effectively. The issues raised in this study include parallel crawling architecture, crawling strategies, content filtering strategies, prototype system implementation, and a pilot test of social network analysis. Finally we conduct an empirical experiment on eBay US and Ruten Taiwan to evaluate the performance of our crawling architecture and to understand auction customers’ bidding behavior characteristics. The results of this study show that our parallel crawling and filtering methods are able to work in the real world, and are significantly more effective than manual web crawling. The collected data are useful for drawing social network maps and analyzing bidding problems.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19

Similar content being viewed by others

References

  • Bajari P, Hortacsu A (2003) The winner’s curse, reserve prices and endogenous entry: empirical insight from eBay auctions. Rand J Econ 3(2):329–355

    Article  Google Scholar 

  • Bapna R, Goes P, Gupta A, Jin Y (2004) User heterogeneity and its impact on electronic auction market design: an empirical exploration. MIS Q 28(1):21–43

    Google Scholar 

  • Bichler M, Kalagnanam J, Katircioglu K, King AJ, Lawrence RD, Lee HS, Lin GY, Lu Y (2002) Applications of flexible pricing in business-to-business electronic commerce. IBM Syst J 41(2):287–302

    Article  Google Scholar 

  • Borle S, Boatwright P, Kadane JB (2005) The timing of bid placement and extent of multiple bidding: an empirical investigation using eBay online auctions. Working paper, Rice University

  • Dellarocas CN (2001) Analyzing the economic efficiency of eBay-like online reputation reporting mechanisms. In: Proceedings of the 3rd ACM conference on electronic commerce, Tampa, FL, October 14–16

  • Jank W, Shmueli G (2005) Profiling price dynamics in on-line auctions using curve clustering. Working paper, Smith School of Business, University of Maryland

  • Kauffman RJ, Wood CA (2000) Running up the bid, modeling seller opportunism in internet auctions. In: Proceedings of the AMCIS 2000 conference, Long Beach, CA

  • Lucking-Reiley D (2000) Auctions on the internet: what’s being auctioned and how. J Ind Econ 48(3):227–252

    Article  Google Scholar 

  • Roth AE, Ockenfels A (2002) Last-minute bidding and the rules for ending second-price auctions: evidence from eBay and Amazon auctions on the internet. Am Econ Rev 92(4):1093–1103

    Article  Google Scholar 

  • Scott J (1991) Social network analysis. Sage, London

    Google Scholar 

  • Wasserman Stanley, Faust Katherine (1994) Social network analysis: methods and applications. Cambridge University Press, Cambridge

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. National Central University, Jhongli City, Taoyuan, Taiwan

    Cheng-Hsien Yu & Shi-Jen Lin

  2. China University of Technology, Hukou, Hsinchu, Taiwan

    Cheng-Hsien Yu

Authors
  1. Cheng-Hsien Yu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Shi-Jen Lin
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Cheng-Hsien Yu.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Yu, CH., Lin, SJ. Web crawling and filtering for on-line auctions from a social network perspective. Inf Syst E-Bus Manage 10, 201–218 (2012). https://doi.org/10.1007/s10257-010-0135-3

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10257-010-0135-3

Keywords

Search

Navigation