Big Data for Stock Market by Means of Mining Techniques

  • Luciana LimaEmail author
  • Filipe Portela
  • Manuel Filipe Santos
  • António Abelha
  • José Machado
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 353)


Predict and prevent future events are the major advantages to any company. Big Data comes up with huge power, not only by the ability of processes large amounts and variety of data at high velocity, but also by the capability to create value to organizations. This paper presents an approach to a Big Data based decision making in the stock market context. The correlation between news articles and stock variations it is already proved but it can be enriched with other indicators. In this use case they were collected news articles from three different web sites and the stock history from the New York Stock Exchange. In order to proceed to data mining classification algorithms the articles were labeled by their sentiment, the direct relation to a specific company and geographic market influence. With the proposed model it is possible identify the patterns between this indicators and predict stock price variations with accuracies of 100 percent. Moreover the model shown that the stock market could be sensitive to news with generic topics, such as government and society but they can also depend on the geographic cover.


Text Mining Stock Prediction Big Data 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    SanthoshBaboo, L., RenjithKumar, P.: Next Generation Data Warehouse Design with Big data for Big Analytics and Better Insights. Glob. J. Comput. Sci. Technol 13(7) (February 2013)Google Scholar
  2. 2.
    Lima, C.A.R., de Calazans, H.C.J.: Pegadas Digitais:‘Big Data’ E InformaÇão Estratégica Sobre O Consumidor (2013)Google Scholar
  3. 3.
    Manyika, J., Chui, M., Brown, B., Bughin, J., Dobbs, R., Roxburgh, C., Byers, A.H.: Big data: The next frontier for innovation, competition, and productivity (2011)Google Scholar
  4. 4.
    Aase, K.-G.: Text Mining of News Articles for Stock Price Predictions (2011)Google Scholar
  5. 5.
    Turner, D., Michael, S., Rebecca, S.: Analytics: The real-world use of big data in financial services (2013)Google Scholar
  6. 6.
    Mathew, S., Halfon, A., Khanna, A.: Financial Services Data Management: Big Data Technology in Financial Services (2012)Google Scholar
  7. 7.
    Tan, A.-H.: Text Mining: The state of the art and the challenges (2000)Google Scholar
  8. 8.
    Linoff, G.S., Berry, M.J.A.: Data Mining Techniques: For Marketing, Sales, and Customer Relationship Management, 3rd edn. Wiley, Indianapolis (2011)Google Scholar
  9. 9.
    Drury, B.: A Text Mining System for Evaluating the Stock Market’s Response to News. University of Porto (2013)Google Scholar
  10. 10.
    Gidofalvi, G., Gidófalvi, G.: Using News Articles to Predict Stock Price Movements (2001)Google Scholar
  11. 11.
    Agrawal, D., Bernstein, P., Bertino, E., Davidson, S., Dayal, U., Franklin, M., Gehrke, J., Haas, L., Halevy, A., Han, J.: Challenges and Opportunities with Big Data. A community white paper developed by leading researchers across the United States (December 2, 2012), http://cra. org/ccc/docs/init/bigdatawhitepaper. pdfGoogle Scholar
  12. 12.
    Ohsawa, Y., Benson, N.E., Yachida, M.: KeyGraph: Automatic Indexing by Co-occurrence Graph Based on Building Construction Metaphor. In: Proceedings of the Advances in Digital Libraries Conference, Washington, DC, USA, p. 12 (1998)Google Scholar
  13. 13.
    Matsuo, Y., Ishizuka, M.: Keyword extraction from a single document using word co-occurrence statistical information. Int. J. Artif. Intell. ToolsGoogle Scholar
  14. 14.
    Oracle, O.: Data Mining Concepts (December 03, 2011), (accessed: November 23, 2014)

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  • Luciana Lima
    • 1
    Email author
  • Filipe Portela
    • 1
  • Manuel Filipe Santos
    • 1
  • António Abelha
    • 1
  • José Machado
    • 1
  1. 1.Algoritmi Research CentreUniversity of MinhoBragaPortugal

Personalised recommendations