Skip to main content
SpringerLink
Log in

Deep Learning with Attention Mechanism for Cryptocurrency Price Forecasting

  • Conference paper
  • First Online:
Inventive Communication and Computational Technologies (ICICCT 2023)

Part of the book series: Lecture Notes in Networks and Systems ((LNNS,volume 757))

Abstract

Cryptocurrencies are a hot topic in recent years. This study aims to predict the future closing price of Bitcoin and Ethereum using different combinations of Long Short-Term Memory (LSTM), bidirectional-LSTM (Bi-LSTM), and Gated Recurrent Unit (GRU) with attention mechanisms like Bahdanau and Luong. To achieve this, data from different time scales are taken. The tuning of model’s hyperparameters is done to improve the performance, and it is evaluated using the Mean Absolute Error (MAE) and Root Mean Square Error (RMSE) metrics. The best results were observed for Ethereum in the very short term when using GRU with Bahdanau's attention. Similarly, the best results for Bitcoin were found in the very short term, when using Bi-LSTM with Bahdanau's attention. Overall results of the experiments reveal that the tuning of hyperparameters improves the performance of the model, and the use of attention mechanism on Bi-LSTM and GRU gives a better prediction.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 189.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 249.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Hansun S, Wicaksana A, Khaliq AQ (2022) Multivariate cryptocurrency prediction: comparative analysis of three recurrent neural networks approaches. J Big Data 9:50. https://doi.org/10.1186/s40537-022-00601-7

  2. Shin M, Mohaisen D, Kim J (2021) Bitcoin price forecasting via ensemble-based LSTM deep learning networks. In: 2021 ınternational conference on ınformation networking (ICOIN), Jeju Island, Korea (South), pp 603–608. https://doi.org/10.1109/ICOIN50884.2021.9333853

  3. Nakamoto S, Bitcoin A (2008) A peer-to-peer electronic cash system. Bitcoin 4(2). https://bitcoin.org/bitcoin.pdf

  4. Patel MM, Tanwar S, Gupta R, Kumar N (2020) A deep learning-based cryptocurrency price prediction scheme for financial ınstitutions. J Inform Secur Appl 55:102583. ISSN 2214–2126. https://doi.org/10.1016/j.jisa.2020.102583

  5. Stankovic M, Bacanin N, Zivkovic M, Jovanovic L, Mani J, Antonijevic M (2022) Forecasting ethereum price by tuned long short-term memory model. In: 2022 30th telecommunications forum (TELFOR), Belgrade, Serbia, pp 1–4. https://doi.org/10.1109/TELFOR56187.2022.9983702

  6. Rizwan M, Narejo S, Javed M (2019) Bitcoin price prediction using deep learning algorithm. In: 2019 13th ınternational conference on mathematics, actuarial science, computer science and statistics (MACS), Karachi, Pakistan, pp 1–7. https://doi.org/10.1109/MACS48846.2019.9024772

  7. Hamayel MJ, Owda AY (2021) A novel cryptocurrency price prediction model using GRU, LSTM and bi-LSTM machine learning algorithms. AI 2(4):477–496. https://doi.org/10.3390/ai2040030

  8. Vaz de Melo Mendes B, Fluminense Carneiro A (2020) A comprehensive statistical analysis of the six major crypto-currencies from August 2015 through June 2020. J Risk Finan Manage 13:192. https://doi.org/10.3390/jrfm13090192

  9. Patra GR, Mohanty MN (2022) Price prediction of cryptocurrency using a multi-layer gated recurrent unit network with multi features. Comput Econ. https://doi.org/10.1007/s10614-022-10310-1

  10. Kilimci H, Yıldırım M, Kilimci ZH (2021) The prediction of short-term bitcoin dollar rate (BTC/USDT) using deep and hybrid deep learning techniques. In: 2021 5th ınternational symposium on multidisciplinary studies and ınnovative technologies (ISMSIT), Ankara, Turkey, pp 633–637. https://doi.org/10.1109/ISMSIT52890.2021.9604741

  11. Mittal M, Geetha G (2022) Predicting bitcoin price using machine learning. In: 2022 ınternational conference on computer communication and ınformatics (ICCCI), Coimbatore, India, pp 1–7. https://doi.org/10.1109/ICCCI54379.2022.9740772

  12. Bhatt A, Ongsakul W, Singh JG (2022) Sliding window approach with first-order differencing for very short-term solar irradiance forecasting using deep learning models. Sustain Energy Technol Assess 50:101864. https://doi.org/10.1016/j.seta.2021.101864

  13. Hiransha M, Gopalakrishnan EA, Menon VK, Soman KP (2018) NSE stock market prediction using deep-learning models. Procedia Comput Sci 132:1351–1362. ISSN 1877-0509. https://doi.org/10.1016/j.procs.2018.05.050

  14. Nair BB, Kumar PS, Sakthivel NR, Vipin U (2017) Clustering stock price time series data to generate stock trading recommendations: an empirical study. Exp Syst Appl 70:20–36. ISSN 0957-4174. https://doi.org/10.1016/j.eswa.2016.11.002

  15. Balaji AJ, Ram DH, Nair BB (2018) Applicability of deep learning models for stock price forecasting an empirical study on BANKEX data. Procedia Comput Sci 143:947–953. https://doi.org/10.1016/j.procs

  16. Li C, Zhang X, Qaosar M, Ahmed S, Alam KMR, Morimoto Y (2019) Multi-factor based stock price prediction using hybrid neural networks with attention mechanism. In: 2019 IEEE international conference on dependable, autonomic and secure computing, international conference on pervasive intelligence and computing, international conference on cloud and big data computing, international conference on cyber science and technology congress (DASC/PiCom/CBDCom/CyberSciTech), pp 961–966

    Google Scholar 

  17. Zhang S, Zhang H (2020) Prediction of stock closing prices based on attention mechanism. In: 2020 16th Dahe Fortune China Forum and Chinese high-educational management annual academic conference (DFHMC), IEEE Explore. https://doi.org/10.1109/DFHMC52214.2020.00053

  18. Bahdanau D, Cho K, Bengio Y (2015) Neural machine translation by jointly learning to align and translate. ICLR. arXiv 2015, arXiv:1409.0473

  19. Amudha J, Divya KV, Aarthi R (2020) A fuzzy based system for target search using top-down visual attention. J Intell Fuzzy Syst 38(5):6311–6323. https://doi.org/10.3233/JIFS-179712

  20. Luong MT, Pham H, Manning CD (2015) Effective approaches to attention-based neural machine translation. arXiv:1508.04025v5, https://doi.org/10.48550/arXiv.1508.04025

  21. Ganesan S, Ravi V, Krichen M, Sowmya V, Alroobaea R, Soman KP (2021) Robust malware detection using residual attention network. In: 2021 IEEE ınternational conference on consumer electronics (ICCE), Las Vegas, NV, USA, pp 1–6. https://doi.org/10.1109/ICCE50685.2021.9427623

  22. Rahesh R, Sajith Variyar VV, Sivanpillai R, Sowmya V, Soman KP, Brown GK (2022) Segmentation of epiphytes in grayscale ımages using a CNN-transformer hybrid architecture. In: Bhateja V, Khin Wee L, Lin JCW, Satapathy SC, Rajesh TM (eds) Data engineering and ıntelligent computing. Lecture Notes in Networks and Systems, vol 446. Springer, Singapore. https://doi.org/10.1007/978-981-19-1559-8_13

Download references

Author information

Authors and Affiliations

  1. Center for Computational Engineering and Networking, Amrita Vishwa Vidyapeetham, Coimbatore, India

    V. Yazhini, M. Nimal Madhu & B. Premjith

  2. Amrita School of Computing, Amrita Vishwa Vidhyapeetham, Bangalore, India

    E. A. Gopalakrishnan

Authors
  1. V. Yazhini
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. M. Nimal Madhu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. B. Premjith
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. E. A. Gopalakrishnan
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to M. Nimal Madhu .

Editor information

Editors and Affiliations

  1. Department of Electronics and Communication Engineering, Gnanamani College of Technology, Namakkal, Tamil Nadu, India

    G. Ranganathan

  2. Department of Computer Science (HUMAIN-Lab), International Hellenic University, Thessaloniki, Greece

    George A. Papakostas

  3. Information Systems and Operations Management (ISEG), University of Lisbon, Lisboa, Portugal

    Álvaro Rocha

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Yazhini, V., Nimal Madhu, M., Premjith, B., Gopalakrishnan, E.A. (2023). Deep Learning with Attention Mechanism for Cryptocurrency Price Forecasting. In: Ranganathan, G., Papakostas, G.A., Rocha, Á. (eds) Inventive Communication and Computational Technologies. ICICCT 2023. Lecture Notes in Networks and Systems, vol 757. Springer, Singapore. https://doi.org/10.1007/978-981-99-5166-6_32

Download citation

Publish with us

Policies and ethics

Search

Navigation