Design and Development of Artificial Intelligence Framework to Forecast the Security Index Direction and Value in Fusion with Sentiment Analysis of Financial News | SN Computer Science Skip to main content

Advertisement

Springer Nature Link
Log in

Design and Development of Artificial Intelligence Framework to Forecast the Security Index Direction and Value in Fusion with Sentiment Analysis of Financial News

  • Original Research
  • Published:
SN Computer Science Aims and scope Submit manuscript

Abstract

The domain of stock price prediction is extensively researched owing to its complex data structure and numerous influential factors. In the current epoch, many modern financial applications demonstrate non-linear and uncertain characteristics that exhibit temporal variability. As a result, there has been a notable rise in the need for resolutions to highly non-linear and time-variant issues. External factors, including public sentiment and political events, can influence stock market trends. The primary aim of this research is to propose a novel framework for predicting the blue-chip stock price in the future by combining historical stock data corresponding to the financial news published regarding stock in the newspaper. The initial step involves integrating sentiment and situational features into a machine-learning model. This integration aims to evaluate public sentiments’ influence on algorithms’ predictive precision thirty days ahead. Furthermore, regression models are utilized to analyze the inter-dependencies that exist among companies. To facilitate an experimental analysis, the researchers acquired historical data from the stock market through reputable sources such as the National Stock Exchange-India and collected news data about stock from the financial newspaper “EconomicTimes”. A series of machine learning models were tested to facilitate the classification of news sentiments of the stocks, followed by the fusion of resultant polarities with the stock’s historical data on the standard column “DATE” and then tested series of deep learning models to observe the impact of news on stock price and by taking reference of this, the authors successfully predicted the stock price on a random day. The findings unequivocally indicate that the proposed research design produces better results than other state-of-the-art models.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
¥17,985 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price includes VAT (Japan)

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

Availability of data and materials

The data that support the findings of this research are available from the corresponding author upon reasonable request.

Abbreviations

CNN:

Convolutional neural network

GRU:

Gated recurrent unit

RF:

Random forest

SVM:

Support vector machine

EMD:

Empirical mode decomposition

LSTM:

Long-short term memory

CNN:

Convolutional neural network

ALSTM:

Attention-based long-short term memory

MAE:

Mean absolute error

RMSE:

Root mean squared error

SVR:

Support vector regression

BOW:

Bag of words

CPU:

Central processing unit

LDA:

Linear discriminant analysis

TLBO:

Teaching and learning based optimization

GAN:

Generative adversarial networks

PCA:

Principal component analysis

LASSO:

Least absolute shrinkage and selection operator

VADER:

Valence aware dictionary for sentiment reasoning

BERT:

Bidirectional encoder representations from transformers

NSE:

National stock exchange

NB:

Naive Bayes

SGD:

Stochastic gradient descent

KNN:

K-nearest neighbor

GPC:

Gaussian process classification

RFC:

Random forest classifier

MLP:

Multi-layer perceptron

CISI:

Chartered Institute for Securities and Investment

References

  1. Singh H, Malhotra M. Artificial intelligence based hybrid models for prediction of stock prices. In: 2023 2nd International Conference for Innovation in Technology (INOCON); 2023. pp. 1–6. https://doi.org/10.1109/INOCON57975.2023.10101297.

  2. Murphy JJ. Technical analysis of the financial markets: a comprehensive guide to trading methods and applications. London: Penguin; 1999.

    Google Scholar 

  3. Turner T. A beginner’s guide to day trading online. 2nd ed. New York City: Simon and Schuster; 2007.

    Google Scholar 

  4. Nti KO, Adekoya A, Weyori B. Random forest based feature selection of macroeconomic variables for stock market prediction. Am J Appl Sci. 2019;16(7):200–12.

    Article  Google Scholar 

  5. Li M, Li W, Wang F, Jia X, Rui G. Applying bert to analyze investor sentiment in stock market. Neural Comput Appl. 2021;33:4663–76.

    Article  Google Scholar 

  6. Nti IK, Adekoya AF, Weyori BA. A systematic review of fundamental and technical analysis of stock market predictions. Artif Intell Rev. 2020;53(4):3007–57.

    Article  Google Scholar 

  7. Singh H, Malhotra M. A novel approach of stock price direction and price prediction based on investor’s sentiments. SN Comput Sci. 2023;4(6):823.

    Article  Google Scholar 

  8. Singh S, Mittal N, Nayyar A, Singh U, Singh S. A hybrid transient search naked mole-rat optimizer for image segmentation using multilevel thresholding. Expert Syst Appl. 2023;213: 119021.

    Article  Google Scholar 

  9. Singh H, Malhotra M. A time series analysis-based stock price prediction framework using artificial intelligence. In: International Conference on Artificial Intelligence of Things. Springer; 2023. pp. 280–89.

  10. Wang Y. Stock market forecasting with financial micro-blog based on sentiment and time series analysis. J Shanghai Jiaotong Univ (Science). 2017;22:173–9.

    Article  Google Scholar 

  11. Singh H, Malhotra M. Stock market and securities index prediction using artificial intelligence: a systematic review. Multidiscip Rev. 2024;7(4):2024060–2024060.

    Article  Google Scholar 

  12. Wu J-L, Huang M-T, Yang C-S, Liu K-H. Sentiment analysis of stock markets using a novel dimensional valence-arousal approach. Soft Comput. 2021;25:4433–50.

    Article  Google Scholar 

  13. Singh G, Mantri A, Sharma O, Kaur R. Virtual reality learning environment for enhancing electronics engineering laboratory experience. Comput Appl Eng Educ. 2021;29(1):229–43.

    Article  Google Scholar 

  14. Li M, Chen L, Zhao J, Li Q. Sentiment analysis of Chinese stock reviews based on bert model. Appl Intell. 2021;51:5016–24.

    Article  Google Scholar 

  15. Sharma B, Mantri A. Assimilating disruptive technology: a new approach of learning science in engineering education. Procedia Comput Sci. 2020;172:915–21.

    Article  Google Scholar 

  16. Hájek P. Combining bag-of-words and sentiment features of annual reports to predict abnormal stock returns. Neural Comput Appl. 2018;29:343–58.

    Article  Google Scholar 

  17. Jin Z, Yang Y, Liu Y. Stock closing price prediction based on sentiment analysis and lstm. Neural Comput Appl. 2020;32:9713–29.

    Article  Google Scholar 

  18. Finter P, Niessen-Ruenzi A, Ruenzi S. The impact of investor sentiment on the German stock market. Zeitschrift für Betriebswirtschaft. 2012;82:133–63.

    Article  Google Scholar 

  19. Singer N, Laser S, Dreher F. Published stock recommendations as investor sentiment in the near-term stock market. Empir Econ. 2013;45:1233–49.

    Article  Google Scholar 

  20. Zhang G, Xu L, Xue Y. Model and forecast stock market behavior integrating investor sentiment analysis and transaction data. Cluster Comput. 2017;20:789–803.

    Article  Google Scholar 

  21. Sun Y, Fang M, Wang X. A novel stock recommendation system using guba sentiment analysis. Pers Ubiquitous Comput. 2018;22:575–87.

    Article  Google Scholar 

  22. Ji Z, Wu P, Ling C, Zhu P. Exploring the impact of investor’s sentiment tendency in varying input window length for stock price prediction. Multimed Tools Appl. 2023;82:1–35.

    Article  Google Scholar 

  23. Lux T. Sentiment dynamics and stock returns: the case of the German stock market. Empir Econ. 2011;41:663–79.

    Article  Google Scholar 

  24. Balshetwar SV, Rs A. Fake news detection in social media based on sentiment analysis using classifier techniques. Multimed Tools Appl. 2023;82:1–31.

    Google Scholar 

  25. Pagolu VS, Reddy KN, Panda G, Majhi B. Sentiment analysis of twitter data for predicting stock market movements. In: 2016 international conference on signal processing, communication, power and embedded system (SCOPES). IEEE; 2016. pp. 1345–50.

  26. Nguyen TH, Shirai K, Velcin J. Sentiment analysis on social media for stock movement prediction. Expert Syst Appl. 2015;42(24):9603–11.

    Article  Google Scholar 

  27. Vanstone BJ, Gepp A, Harris G. Do news and sentiment play a role in stock price prediction? Appl Intell. 2019;49:3815–20.

    Article  Google Scholar 

  28. Li Y, Pan Y. A novel ensemble deep learning model for stock prediction based on stock prices and news. Int J Data Sci Anal. 2022;13:1–11.

    Article  Google Scholar 

  29. Wu S, Liu Y, Zou Z, Weng T-H. S_i_lstm: stock price prediction based on multiple data sources and sentiment analysis. Connect Sci. 2022;34(1):44–62.

    Article  Google Scholar 

  30. SUN Y. Prediction of shanghai stock index based on investor sentiment and cnn-lstm model. J Syst Sci Inf. 2022;10(6):620–32. https://doi.org/10.21078/JSSI-2022-620-13.

    Article  Google Scholar 

  31. Gao Y, Wang R, Zhou E. Stock prediction based on optimized lstm and gru models. Sci Program. 2021;2021:1–8.

    Google Scholar 

Download references

Funding

The authors did not receive support from any organization for the submitted work.

Author information

Authors and Affiliations

  1. University School of Computing, Rayat Bahra University, SAS Nagar, 140104, Punjab, India

    Harmanjeet Singh

  2. University Institute of Computing, Chandigarh University, SAS Nagar, 140413, Punjab, India

    Manisha Malhotra

  3. School of Computer Science, UPES, Dehradun, 248007, Uttarakhand, India

    Supreet Singh

  4. Chitkara University Institute of Engineering and Technology, Chitkara University, Punjab, India

    Preeti Sharma & Chander Prabha

Authors
  1. Harmanjeet Singh
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Manisha Malhotra
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Supreet Singh
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Preeti Sharma
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Chander Prabha
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

Harmanjeet Singh: conceptualization, methodology, writing—original draft. Manisha Malhotra: investigation, writing—review and editing, supervision. Supreet Singh: Writing—review and editing, software. Preeti Sharma: methodology, writing—review & editing. Chander Prabha: validation, writing—review & editing.

Corresponding author

Correspondence to Preeti Sharma.

Ethics declarations

Conflict of interest

The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.

Ethics approval

This material is the authors’ own original work, which has not been previously published elsewhere.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Singh, H., Malhotra, M., Singh, S. et al. Design and Development of Artificial Intelligence Framework to Forecast the Security Index Direction and Value in Fusion with Sentiment Analysis of Financial News. SN COMPUT. SCI. 5, 787 (2024). https://doi.org/10.1007/s42979-024-03143-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s42979-024-03143-2

Keywords

Search

Navigation