Detection of News Feeds Items Appropriate for Children
Identifying child-appropriate web content is an important yet difficult classification task. This novel task is characterised by attempting to determine age/child appropriateness (which is not necessarily topic-based), despite the presence of unbalanced class sizes and the lack of quality training data with human judgements of appropriateness. Classification of feeds, a subset of web content, presents further challenges due to their temporal nature and short document format. In this paper, we discuss these challenges and present baseline results for this task through an empirical study that classifies incoming news stories as appropriate (or not) for children. We show that while the naïve Bayes approach produces a higher AUC it is vulnerable to the imbalanced data problem, and that support vector machine provides a more robust overall solution. Our research shows that classifying children’s content is a non-trivial task that has greater complexities than standard text based classification. While the F-score values are consistent with other research examining age-appropriate text classification, we introduce a new problem with a new dataset.
KeywordsReadability Measure Readability Feature Open Directory Project News Feed Negative Document
Unable to display preview. Download preview PDF.
- 2.Bouckaert, R.R., Frank, E.: Evaluating the Replicability of Significance Tests for Comparing Learning Algorithms. In: Dai, H., Srikant, R., Zhang, C. (eds.) PAKDD 2004. LNCS (LNAI), vol. 3056, pp. 3–12. Springer, Heidelberg (2004), http://dx.doi.org/10.1007/978-3-540-24775-3%5f3 CrossRefGoogle Scholar
- 3.Druin, A., Foss, E., Hutchinson, H., Golub, E., Hatley, L.: Children’s roles using keyword search interfaces at home. In: CHI 2010, pp. 413–422. ACM, New York (2010)Google Scholar
- 4.Eickhoff, C., Serdyukov, P., de Vries, A.P.: A combined topical/non-topical approach to identifying web sites for children. In: 4th International Conference on Web Search and Data Mining (WSDM). ACM, Hong Kong (2011)Google Scholar
- 6.Gyllstrom, K., Moens, M.F.: A picture is worth a thousand search results: finding child-oriented multimedia results with collage. In: SIGIR, pp. 731–732 (2010)Google Scholar
- 8.Joachims, T.: Making large-Scale SVM Learning Practical. In: Advances in Kernel Methods - Support Vector Learning. MIT-Press, Cambridge (1999)Google Scholar
- 12.Nielsen, J.: Usability of websites for children: Design guidelines for targeting users aged 3-12 years. Web publication (September 2010), http://www.nngroup.com/reports/kids/
- 13.Ofcom: UK children’s media literacy (March 2010), http://stakeholders.ofcom.org.uk/market-data-research/media-literacy/medlitpub/medlitpubrss/ukchildrensml/
- 14.Rideout, V.J., Foeh, U.G., Roberts, D.F.: Report: Generation m2: Media in the lives of 8- to 18-year-olds. Tech. rep., Kaiser Family Foundation (January 2010), http://www.kff.org/entmedia/upload/8010.pdf
- 15.Schwarm, S.E., Ostendorf, M.: Reading level assessment using support vector machines and statistical language models. In: Proceedings of the 43rd Annual Meeting on Association for Computational Linguistics, ACL 2005, pp. 523–530. ACL, Ann Arbour (2005), http://dx.doi.org/10.3115/1219840.1219905 CrossRefGoogle Scholar
- 16.Smith, E., Senter, R.: Automated readability index. Tech. Rep. AMRL-TR-66-220, Cincinnati University, Ohio (1967)Google Scholar