Skip to main content

Early Churn User Classification in Social Networking Service Using Attention-Based Long Short-Term Memory

Part of the Lecture Notes in Computer Science book series (LNAI,volume 11607)

Abstract

Social networking services (SNSs) see much early churn of new users. SNSs can provide effective interventions by identifying potential early churn users and important factors leading to early churn. The long short-term memory (LSTM) model, whose input is the user behavior event sequence binned at constant intervals, is proposed for this purpose. This model better classifies early churn users than previous machine learning models. We hypothesized that the importance of each temporal part in the event sequence is different for classifying early churn users because user behavior is known to consist of coarse and dense parts and initial behavior influences long-term behavior. To treat this, we proposed attention-based LSTM for classifying early churn users. In an experiment conducted on RoomClip, a general SNS, the proposed model achieved higher classification performance compared to baseline models, thus confirming its effectiveness. We also analyzed the importance of each temporal part and each event. We revealed that the initial temporal part and users’ actions have high importance for classifying early churn users. These results should contribute to providing effective interventions for preventing early churn.

Keywords

  • Identify early churn users
  • Social networking service

This is a preview of subscription content, access via your institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Notes

  1. 1.

    http://roomclip.jp/.

  2. 2.

    https://scikit-learn.org/stable/.

  3. 3.

    https://keras.io/.

References

  1. Barabasi, A.L.: The origin of bursts and heaby tails in human dynamics. Nature 435(7039), 207–211 (2005)

    CrossRef  Google Scholar 

  2. Choi, B., Alexander, K., Kraut, R.E., Levine, J.M.: Socialization tactics in Wikipedia and their effects. In: Proceedings of the 2010 ACM Conference on Computer Supported Cooperative Work, pp. 107–116. ACM (2010)

    Google Scholar 

  3. Dror, G., Pelleg, D., Rokhlenko, O., Szpektor, I.: Churn prediction in new users of Yahoo! answers. In: Proceedings of the 21st International Conference on World Wide Web, pp. 829–834. ACM (2012)

    Google Scholar 

  4. Freyne, J., Jacovi, M., Guy, I., Geyer, W.: Increasing engagement through early recommender intervention. In: Proceedings of the Third ACM Conference on Recommender Systems, pp. 85–92. ACM (2009)

    Google Scholar 

  5. Gers, F.A., Schmidhuber, J.A., Cummins, F.A.: Learning to forget: continual prediction with LSTM. Neural Comput. 12(10), 2451–2471 (2000)

    CrossRef  Google Scholar 

  6. Hochreiter, S., Schmidhuber, J.: Long short-term memory. Neural Comput. 9(8), 1735–1780 (1997)

    CrossRef  Google Scholar 

  7. Joyce, E., Kraut, R.E.: Predicting continued participation in newsgroups. J. Comput.-Mediat. Commun. 11(3), 723–747 (2006)

    CrossRef  Google Scholar 

  8. Karumur, R.P., Nguyen, T.T., Konstan, J.A.: Early activity diversity: assessing newcomer retention from first-session activity. In: Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing, pp. 595–608. ACM (2016)

    Google Scholar 

  9. Pal, A., Chang, S., Konstan, J.A.: Evolution of experts in question answering communities. In: The 6th International AAAI Conference on Weblogs and Social Media, pp. 274–281. AAAI (2012)

    Google Scholar 

  10. Pudipeddi, J.S., Akoglu, L., Tong, H.: User churn in focused question answering sites: characterizations and prediction. In: Proceedings of the 23rd International Conference on World Wide Web, pp. 469–474. ACM (2014)

    Google Scholar 

  11. Reichheld, F.F., Sasser, J.W.: Zero defections: quality comes to services. Harvard Bus. Rev. 68(5), 105–111 (1990)

    Google Scholar 

  12. Rumelhart, D.E., Hinton, G.E., Williams, R.J.: Learning rrepresentations by back-propagating errors. Nature 323(6088), 526–533 (1986)

    CrossRef  Google Scholar 

  13. Schuster, M., Paliwal, K.K.: Bidirectional recurrent neural networks. IEEE Trans. Signal Process. 45(11), 2673–2681 (1997)

    CrossRef  Google Scholar 

  14. Yan, Q., Wu, L., Zheng, L.: Social network based microblog user behavior analysis. Phys. A 392(7), 1712–1723 (2013)

    CrossRef  Google Scholar 

  15. Yang, C., Shi, X., Jie, L., Han, J.: I know you’ll be back: Interpretable new user clustering and churn prediction on a mobile social application. In: Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pp. 914–922. ACM (2018)

    Google Scholar 

  16. Yang, Z., Yang, D., Dyer, C., He, X., Smola, A., Hovy, E.: Hierarchical attention networks for document classification. In: Proceedings of the 14th Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pp. 1480–1489 (2016)

    Google Scholar 

Download references

Acknowledgement

We would like to thank RoomClip Inc. for providing data.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Koya Sato .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and Permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Sato, K., Oka, M., Kato, K. (2019). Early Churn User Classification in Social Networking Service Using Attention-Based Long Short-Term Memory. In: U., L., Lauw, H. (eds) Trends and Applications in Knowledge Discovery and Data Mining. PAKDD 2019. Lecture Notes in Computer Science(), vol 11607. Springer, Cham. https://doi.org/10.1007/978-3-030-26142-9_5

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-26142-9_5

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-26141-2

  • Online ISBN: 978-3-030-26142-9

  • eBook Packages: Computer ScienceComputer Science (R0)