A new ensemble learning method based on learning automata | Journal of Ambient Intelligence and Humanized Computing Skip to main content
Springer Nature Link
Log in

A new ensemble learning method based on learning automata

  • Original Research
  • Published:
Journal of Ambient Intelligence and Humanized Computing Aims and scope Submit manuscript

Abstract

Improving the performance of machine learning algorithms has been always the topic of interest in data mining. The ensemble learning is one of the machine learning methods that, according to the subject literature, it yields better performance than the single base learner in the accuracy parameter. In the ensemble learning, all base learners are considered at the same level in terms of power and separation capabilities. However, whether the ensemble is made of homogeneous based learners or it is made of heterogeneous base learners, in either case, weaknesses and strengths of the base learners are ignored. To overcome this challenge, the stronger coefficient of influence should be assigned to stronger base learners and the lower coefficient of influence should be assigned to weaker base learners. However, given that the data is associated with uncertainty in the real-world issues, it is impossible to determine which base learner performs better than the others under these circumstances. Learning Automata is one of the desirable options of reinforcement learning subject literature to dealing with dynamic environments. The learning automata works by receiving feedback from the environment. In this paper, a method named LAbEL has been proposed which allows the assignment of the coefficient of influence to each base learner in the ensemble dynamically. Due to the use of learning automata, the proposed method works adjusted to the problem space conditions. The LAbEL is based on learning automata and according to its ability to dealing with dynamic environments, it is possible to apply it to issues where data has nonlinear and unpredictable behavior.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
¥17,985 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price includes VAT (Japan)

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

References

  • Alnashwan R, O’Riordan AP, Sorensen H, Hoare C (2016) Improving sentiment analysis through ensemble learning of meta-level features. In: CEUR Workshop Proceedings, 2016. Sun SITE Central Europe (CEUR)/RWTH Aachen University, Aachen

  • AL-Sharuee MT, Liu F, Pratama M (2018) Sentiment analysis: an automatic contextual analysis and ensemble clustering approach and comparison. Data Knowl Eng 115:194–213

    Google Scholar 

  • Bachman P, Alsharif O, Precup D Learning with pseudo-ensembles. In: Advances in neural information processing systems, 2014, pp 3365–3373

  • Barbin JP, Yousefi S, Masoumi B (2020) Efficient service recommendation using ensemble learning in the internet of things (IoT). J Ambient Intell Humaniz Comput 11:1339–1350

    Google Scholar 

  • Basaran K, Özçift A, Kılınç D (2019) A new approach for prediction of solar radiation with using ensemble learning algorithm. Arab J Sci Eng 44:7159–7171

    Google Scholar 

  • Bouazizi M, Ohtsuki T (2017) A pattern-based approach for multi-class sentiment analysis in twitter IEEE. Access 5:20617–20639

    Google Scholar 

  • Cai Y, Liu X, Zhang Y, Cai Z (2018) Hierarchical ensemble of extreme learning machine. Pattern Recogn Lett 116:101–106

    Google Scholar 

  • Chakraborty D, Narayanan V, Ghosh A (2019) Integration of deep feature extraction and ensemble learning for outlier detection. Pattern Recogn 89:161–171

    Google Scholar 

  • Cherubin G (2019) Majority vote ensembles of conformal predictors. Mach Learn 108:475–488

    MathSciNet  MATH  Google Scholar 

  • Dua D, Graff C (2019) UCI Machine Learning Repository [http://archive.ics.uci.edu/ml]. Irvine, CA: University of California, School of Information and Computer Science

  • Ezzat A, Wu M, Li X, Kwoh C-K (2019) Computational prediction of drug-target interactions via ensemble learning. Computational methods for drug repurposing. Springer, New York, pp 239–254

    Google Scholar 

  • Galicia A, Talavera-Llames R, Troncoso A, Koprinska I, Martínez-Álvarez F (2019) Multi-step forecasting for big data time series based on ensemble learning. Knowl-Based Syst 163:830–841

    Google Scholar 

  • Gupta V, Mehta A, Goel A, Dixit U, Pandey AC (2019) Spam detection using ensemble learning. Harmony search and nature inspired optimization algorithms. Springer, New York, pp 661–668

    Google Scholar 

  • Hajewski J, Oliveira S (2019) Distributed SmSVM ensemble learning. INNS big data and deep learning conference. Springer, New York, pp 7–16

    Google Scholar 

  • Hutter F, Kotthoff L, Vanschoren J (2019) Automated machine learning. Springer, New York

    Google Scholar 

  • Igawa RA, Barbon S Jr, Paulo KCS, Kido GS, Guido RC, Júnior MLP, da Silva IN (2016) Account classification in online social networks with LBCA and wavelets. Inf Sci 332:72–83

    Google Scholar 

  • Jiang J, Yu Y, Wang Z, Tang S, Hu R, Ma J (2019) Ensemble super-resolution with a reference dataset IEEE transactions on cybernetics

  • Jianqiang Z, Xiaolin G (2017) Comparison research on text pre-processing methods on twitter sentiment analysis IEEE. Access 5:2870–2879

    Google Scholar 

  • Kang M, Ahn J, Lee K (2018) Opinion mining using ensemble text hidden Markov models for text classification. Expert Syst Appl 94:218–227

    Google Scholar 

  • Kranjc J, Smailović J, Podpečan V, Grčar M, Žnidaršič M, Lavrač N (2015) Active learning for sentiment analysis on data streams: Methodology and workflow implementation in the ClowdFlows platform. Inf Process Manag 51:187–203

    Google Scholar 

  • Krawczyk B, Minku LL, Gama J, Stefanowski J, Woźniak M (2017) Ensemble learning for data stream analysis: a survey. Inf Fusion 37:132–156

    Google Scholar 

  • Kumar A, Jaiswal A (2020) Systematic literature review of sentiment analysis on Twitter using soft computing techniques. Concurr Comput Pract Exp 32:e5107

    Google Scholar 

  • Kumar S, Nezhurina MI (2019) An ensemble classification approach for prediction of user’s next location based on Twitter data. J Ambient Intell Humaniz Comput 10:4503–4513

    Google Scholar 

  • Liang D, Fan G, Lin G, Chen W, Pan X, Zhu H (2019) Three-stream convolutional neural network with multi-task and ensemble learning for 3D action recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition workshops, 2019, pp 0–0

  • Liu S, Cheng X, Li F, Li F (2014) TASC: Topic-adaptive sentiment classification on dynamic tweets. IEEE Trans Knowl Data Eng 27:1696–1709

    Google Scholar 

  • Liu Y, Jiang C, Zhao H (2018) Using contextual features and multi-view ensemble learning in product defect identification from online discussion forums. Decis Support Syst 105:1–12

    Google Scholar 

  • Lo SL, Chiong R, Cornforth D (2016) Ranking of high-value social audiences on Twitter. Decis Support Syst 85:34–48

    Google Scholar 

  • López-Vázquez C, Hochsztain E (2019) Extended and updated tables for the Friedman rank test. Commun Stat-Theory Methods 48:268–281

    MathSciNet  MATH  Google Scholar 

  • Mao S, Chen J-W, Jiao L, Gou S, Wang R (2019) Maximizing diversity by transformed ensemble learning. Appl Soft Comput 82:105580

    Google Scholar 

  • Morton RB, Piovesan M, Tyran J-R (2019) The dark side of the vote: Biased voters, social information, and information aggregation through majority voting. Games Econ Behav 113:461–481

    MathSciNet  MATH  Google Scholar 

  • Narendra KS, Thathachar MA (2012) Learning automata: an introduction. Courier corporation, North Chelmsford

    Google Scholar 

  • Oliveira N, Cortez P, Areal N (2017) The impact of microblogging data for stock market prediction: Using Twitter to predict returns, volatility, trading volume and survey sentiment indices. Expert Syst Appl 73:125–144

    Google Scholar 

  • Onan A, Korukoğlu S, Bulut H (2017) A hybrid ensemble pruning approach based on consensus clustering and multi-objective evolutionary algorithm for sentiment classification. Inf Process Manag 53:814–833

    Google Scholar 

  • Pérez-Gállego P, Quevedo JR, del Coz JJ (2017) Using ensembles for problems with characterizable changes in data distribution: a case study on quantification. Inf Fusion 34:87–100

    Google Scholar 

  • Perikos I, Hatzilygeroudis I (2016) Recognizing emotions in text using ensemble of classifiers. Eng Appl Artif Intell 51:191–201

    Google Scholar 

  • Piri S, Delen D, Liu T, Zolbanin HM (2017) A data analytics approach to building a clinical decision support system for diabetic retinopathy: developing and deploying a model ensemble. Decis Support Syst 101:12–27

    Google Scholar 

  • Rathor S, Jadon R (2019) Acoustic domain classification and recognition through ensemble based multilevel classification. J Ambient Intell Humaniz Comput 10:3617–3627

    Google Scholar 

  • Raza K (2019) Improving the prediction accuracy of heart disease with ensemble learning and majority voting rule. U-Healthcare Monitoring Systems. Elsevier, Amsterdam, pp 179–196

    Google Scholar 

  • Renda A, Barsacchi M, Bechini A, Marcelloni F (2019) Comparing ensemble strategies for deep learning: an application to facial expression recognition. Expert Syst Appl 136:1–11

    Google Scholar 

  • Rezvanian A, Saghiri AM, Vahidipour SM, Esnaashari M, Meybodi MR (2018) Recent advances in learning automata. Springer, New York

    MATH  Google Scholar 

  • Rudra S, Uddin M, Alam MM (2019) Forecasting of breast cancer and diabetes using ensemble learning. Int J Comput Commun Inform 1:1–5

    Google Scholar 

  • Sagi O, Rokach L (2018) Ensemble learning: a survey Wiley interdisciplinary reviews. Data Min Knowl Disc 8:e1249

    Google Scholar 

  • Saini M, Verma S, Sharan A (2019) Multi-view ensemble learning using rough set based feature ranking for opinion spam detection. Advances in computer communication and computational sciences. Springer, New York, pp 3–12

    Google Scholar 

  • Saleena N (2018) An ensemble classification system for twitter sentiment analysis. Procedia Comput Sci 132:937–946

    Google Scholar 

  • Saravanan RA, Rajesh Babu M (2017) Enhanced text mining approach based on ontology for clustering research project selection. J Ambient Intell Humaniz Comput. https://doi.org/10.1007/s12652-017-0637-7

    Article  Google Scholar 

  • Souza MA, Cavalcanti GD, Cruz RM, Sabourin R (2019) Online local pool generation for dynamic classifier selection. Pattern Recogn 85:132–148

    Google Scholar 

  • Tuarob S, Tucker CS, Salathe M, Ram N (2014) An ensemble heterogeneous classification methodology for discovering health-related knowledge in social media messages. J Biomed Inform 49:255–268

    Google Scholar 

  • Wang X, Yan WQ (2019) Cross-view gait recognition through ensemble learning. Neural Comput Appl. https://doi.org/10.1007/s00521-019-04256-z

    Article  Google Scholar 

  • Wang G, Sun J, Ma J, Xu K, Gu J (2014) Sentiment classification: the contribution of ensemble learning. Decis Support Syst 57:77–93

    Google Scholar 

  • Wei Y, Sun S, Ma J, Wang S, Lai KK (2019) A decomposition clustering ensemble learning approach for forecasting foreign exchange rates. J Manag Sci Eng 4:45–54

    Google Scholar 

  • Werbin-Ofir H, Dery L, Shmueli E (2019) Beyond majority: label ranking ensembles based on voting rules. Expert Syst Appl 136:50–61

    Google Scholar 

  • Xiao J (2019) SVM and KNN ensemble learning for traffic incident detection. Phys A 517:29–35

    Google Scholar 

  • Zhang Y, Miao D, Wang J, Zhang Z (2019a) A cost-sensitive three-way combination technique for ensemble learning in sentiment classification. Int J Approx Reason 105:85–97

    MathSciNet  Google Scholar 

  • Zhang Y, Cao G, Wang B, Li X (2019b) A novel ensemble method for k-nearest neighbor. Pattern Recogn 85:13–25

    Google Scholar 

  • Zhang J, Li Z, Nai K, Gu Y, Sallam A (2019c) DELR: a double-level ensemble learning method for unsupervised anomaly detection. Knowl-Based Syst 181:104783

    Google Scholar 

  • Zhou Y, Wang P (2019) An ensemble learning approach for XSS attack detection with domain knowledge and threat intelligence. Comput Secur 82:261–269

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Faculty of Computer and Information Technology Engineering, Qazvin Branch, Islamic Azad University, Qazvin, Iran

    Mohammad Savargiv & Behrooz Masoumi

  2. Department of Computer Engineering, Alzahra University, Tehran, Iran

    Mohammad Reza Keyvanpour

Authors
  1. Mohammad Savargiv
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Behrooz Masoumi
    View author publications

    You can also search for this author inPubMed Google Scholar

  3. Mohammad Reza Keyvanpour
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence to Behrooz Masoumi.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Savargiv, M., Masoumi, B. & Keyvanpour, M.R. A new ensemble learning method based on learning automata. J Ambient Intell Human Comput 13, 3467–3482 (2022). https://doi.org/10.1007/s12652-020-01882-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12652-020-01882-7

Keywords