New machine learning model based on the time factor for e-commerce recommendation systems | The Journal of Supercomputing Skip to main content
Springer Nature Link
Log in

New machine learning model based on the time factor for e-commerce recommendation systems

  • Published:
The Journal of Supercomputing Aims and scope Submit manuscript

Abstract

Nowadays, thanks to the development of e-commerce websites, businesses can capitalize on many benefits, for example, there are many methods of approaching customers online. Customers can interact with the product on the system, leave comments or reviews about the product, and capitalize on these interactions helps a lot to reach target customers. Many authors have studied machine learning models to build recommendation systems. The common point of the recommendation system is to filter out the products that are most relevant to the customer in order to retain them longer and to improve the customer’s product experience. In this paper, a new recommendation model called ML.Recommend combined with Microsoft’s ML.NET machine learning platform is proposed. This model provides a full cycle of recommendation modeling, including the steps of preprocessing, model training, model evaluation, model saving and usage. ML.Recommend uses the matrix factor and time factor combination for product recommendations based on ratings and logistic regression for customer comments about products. In this model, we provide a set of interactive class libraries, data, and class models that are implemented based on user evaluations of each interactive product over time. The model recommends corresponding products based on the expected score for the customer that a user has configured. The data are experimented on the e-commerce website called UEL Store and the UCI sentiment labeled sentences dataset. Measurement parameters such as mean absolute error, mean square error, root-mean-square error, R-squared and area under the curve are applied to evaluate the model. Finally, the ML.Recommend model was published on Microsoft’s NuGet system, so that other researchers could use and extend this model.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
¥17,985 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price includes VAT (Japan)

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20
Fig. 21
Fig. 22
Fig. 23
Fig. 24

Similar content being viewed by others

Availability of data and materials

Please contact the corresponding author for data requests. The C# coding and dataset are available. Duy Thanh Tran, Jun-Ho Huh [47], ‘Dataset for UELStore e-commerce website’ https://github.com/thanhtd32/ML.Recommend/tree/main/Dataset. Duy Thanh Tran, Jun-Ho Huh [48], ‘9 built ML.Recommend models’ available at link https://github.com/thanhtd32/ML.Recommend/tree/main/Models. Duy Thanh Tran, Jun-Ho Huh [49], ‘Full source code of ML.Recommend model’ available at link https://github.com/thanhtd32/ML.Recommend. Duy Thanh Tran, Jun-Ho Huh [51], ML.Recommend model on Microsoft Nuget https://www.nuget.org/packages/ML.Recommend/. We confirm we have included a data availability statement in our main manuscript file.

References

  1. Gilliland M, Tashman L, Sglavo U (2021) Business forecasting: the emerging role of artificial intelligence and machine learning. Wiley, New York

    Book  Google Scholar 

  2. Haenlein M, Kaplan A (2019) A brief history of artificial intelligence: on the past, present, and future of artificial intelligence. Calif Manag Rev 61(4):5–14

    Article  Google Scholar 

  3. Fayyad U, Piatetsky-Shapiro G, Smyth P (1996) From data mining to knowledge discovery in databases. AI Mag 17(3):37–53. https://doi.org/10.1609/aimag.v17i3.1230

    Article  Google Scholar 

  4. Fayyad UM, Piatetsky-Shapiro G, Smyth P (1996) Knowledge discovery and data mining: towards a unifying framework. KDD 96:82–88

    Google Scholar 

  5. Fayyad U (1997) Data mining and knowledge discovery in databases: implications for scientific databases. Ninth International Conference on Scientific and Statistical Database Management, IEEE 1997:2–11. https://doi.org/10.1109/SSDM.1997.621141

    Article  Google Scholar 

  6. Sumiran K (2018) An overview of data mining techniques and their application in industrial engineering. Asian J Appl Sci Technol 2(2):947–953

    Google Scholar 

  7. Covington P, Adams J, Sargin E (2016) Deep neural networks for YouTube recommendations. In: The 10th ACM Conference on Recommender Systems (RecSys'16), Association for Computing Machinery, New York, NY, USA, pp 191–198. https://doi.org/10.1145/2959100.2959190

  8. Linden G, Smith B, York J (2003) Amazon.com recommendations: item-to-item collaborative filtering. IEEE Internet Comput 7(1):76–80. https://doi.org/10.1109/MIC.2003.1167344

    Article  Google Scholar 

  9. Gómez-Losada Á, Duch-Brown N (2019) Time series forecasting by recommendation: an empirical analysis on Amazon marketplace. In: Abramowicz W, Corchuelo R (eds) Business Information Systems, BIS 2019, Lecture Notes in Business Information Processing, LNBIP. Springer, vol 353. pp 45–54. https://doi.org/10.1007/978-3-030-20485-3_4

  10. Shapira B, Rokach L, Freilikhman S (2013) Facebook single and cross domain data for recommendation systems. User Model User-Adapted Interact 23(2):211–247. https://doi.org/10.1007/s11257-012-9128-x

    Article  Google Scholar 

  11. Gomez-Uribe CA, Hunt N (2016) The Netflix recommender system: algorithms, business value, and innovation. ACM Trans Manag Inf Syst 6(4):1–19. https://doi.org/10.1145/2843948

    Article  Google Scholar 

  12. Pedregosa F et al (2021) Scikit-learn: machine learning in Python. J Mach Learn Res 12:2825–2830

    MathSciNet  MATH  Google Scholar 

  13. https://scikit-learn.org/. Accessed 5 Sept 2022

  14. Chary D, Singh RP (2020) Review on advanced machine learning model: Scikit-Learn. Int J Sci Res Eng Dev 3(4):526–529. Available at SSRN: https://ssrn.com/abstract=3694350

  15. https://www.nuget.org/. Accessed 5 Sept 2022

  16. Nierstrasz O (1989) A survey of object-oriented concepts. Object-Oriented Concepts, Databases, and Applications, ACM Digital Library Book, pp 3–21. https://doi.org/10.1145/63320.66468

  17. Pereira Ó, Aguiar R, Santos M (2011) CRUD-DOM: a model for bridging the gap between the object-oriented and the relational paradigms—an enhanced performance assessment based on a case study. Int J Adv Softw 4:158–180

    Google Scholar 

  18. Torgersen M (2007) Querying in C#: how language integrated query (LINQ) works. In: Companion to the 22nd ACM SIGPLAN Conference on Object-Oriented Programming Systems and Applications Companion, ACM, pp 852–853. https://doi.org/10.1145/1297846.1297922

  19. Lops P, Jannach D, Musto C, Bogers T, Koolen M (2019) Trends in content-based recommendation. User Model User-Adapted Interact 29:239–249. https://doi.org/10.1007/s11257-019-09231-w

    Article  Google Scholar 

  20. Zhang R, Liu Q, Chun-Gui J-XW, Ma H (2014) Collaborative filtering for recommender systems. In: 2014 Second International Conference on Advanced Cloud and Big Data, IEEE, pp 301–308. https://doi.org/10.1109/CBD.2014.47

  21. Zhao Z, Shang M (2010) User-based collaborative-filtering recommendation algorithms on Hadoop. In: 2010 Third International Conference on Knowledge Discovery and Data Mining, IEEE, pp 478–481. https://doi.org/10.1109/WKDD.2010.54

  22. Shi Y, Larson M, Hanjalic A (2014) Collaborative filtering beyond the user-item matrix: a survey of the state of the art and future challenges. ACM Comput Surv 47(1):1–45. https://doi.org/10.1145/2556270

    Article  Google Scholar 

  23. Wasid M, Ali R (2018) An improved recommender system based on multi-criteria clustering approach. Procedia Comput Sci 131(2018):93–101. https://doi.org/10.1016/j.procs.2018.04.190

    Article  Google Scholar 

  24. Das C, Sahoo AK, Pradhan C (2022) Multicriteria recommender system using different approaches. In: Cognitive Data Science in Sustainable Computing, Cognitive Big Data Intelligence with a Metaheuristic Approach. Academic Press, Elsevier, pp 259–277. https://doi.org/10.1016/B978-0-323-85117-6.00011-X

  25. Singh P, Pramanik PD, Dey A, Choudhury P (2021) Recommender systems: an overview, research trends, and future directions. Int J Bus Syst Res 15:14–52

    Article  Google Scholar 

  26. Himeur Y et al (2022) Blockchain-based recommender systems: applications, challenges and future opportunities. Comput Sci Rev 43:1–21. https://doi.org/10.1016/j.cosrev.2021.100439

    Article  MathSciNet  Google Scholar 

  27. Gunasekar G, Iqubal S, Chelladurai F, Saranya D (2018) A hybrid approach using collaborative filtering and content based filtering for recommender system. J Phys Conf Ser 1000(1):1–7. https://doi.org/10.1088/1742-6596/1000/1/012101

    Article  Google Scholar 

  28. Jannach D, Pu P, Ricci F, Zanker M (2021) Recommender systems: past, present, future. AI Mag 42(3):3–6. https://doi.org/10.1609/aimag.v42i3.18139

    Article  Google Scholar 

  29. Rodpysh KV, Mirabedini SJ, Banirostam T (2021) Resolving cold start and sparse data challenge in recommender systems using multi-level singular value decomposition. Comput Electr Eng 94:1–14. https://doi.org/10.1016/j.compeleceng.2021.107361

    Article  Google Scholar 

  30. Song YT, Sheng Wu (2020) Slope one recommendation algorithm based on user clustering and scoring preferences. Procedia Comput Sci 166:539–545. https://doi.org/10.1016/j.procs.2020.02.042

    Article  Google Scholar 

  31. Aghdam MH (2022) A novel constrained non-negative matrix factorization method based on users and items pairwise relationship for recommender systems. Expert Syst Appl 195:116593. https://doi.org/10.1016/j.eswa.2022.116593

    Article  Google Scholar 

  32. Collins et al (2020) Per-instance algorithm selection for recommender systems via instance clustering. https://doi.org/10.48550/arxiv.2012.15151

  33. Anwar T, Vijayasundaram U, Hussain Md, Pantula M (2022) Collaborative filtering and kNN based recommendation to overcome cold start and sparsity issues: a comparative analysis. Multimed Tools Appl. https://doi.org/10.1007/s11042-021-11883-z

    Article  Google Scholar 

  34. Anand R, Beel J (2020) Auto-surprise: an automated recommender-system (AutoRecSys) library with tree of parzens estimator (TPE) optimization. In: Fourteenth ACM conference on recommender systems, ACM, pp 585–587. https://doi.org/10.1145/3383313.3411467

  35. ChennaKeshava M, NarendraReddy P, Srinivasulu S, DineshNaik B (2020) Machine learning model for movie recommendation system. Int J Eng Res Technol 9(4):800–805. https://doi.org/10.17577/IJERTV9IS040741

    Article  Google Scholar 

  36. Ahmed Z et al (2019) Machine learning at Microsoft with ML.NET. In: The 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining (KDD 19). ACM, pp 2448–2458. https://doi.org/10.1145/3292500.3330667

  37. https://dotnet.microsoft.com/en-us/apps/machinelearning-ai/ml-dotnet. Accessed 5 Sept 2022

  38. Abadi M et al (2016) TensorFlow: a system for large-scale machine learning. In: 12th USENIX Symposium on Operating Systems Design and Implementation, OSDI 16, USENIX, pp 265–283

  39. Lin W et al (2019) ONNC: a compilation framework connecting ONNX to proprietary deep learning accelerators. In: 2019 IEEE International Conference on Artificial Intelligence Circuits and Systems, AICAS, IEEE, pp 214–218. https://doi.org/10.1109/AICAS.2019.8771510

  40. Wang W, Lu Y (2018) Analysis of the mean absolute error (MAE) and the root mean square error (RMSE) in assessing rounding model. IOP Conf Ser Mater Sci Eng 324:1–10. https://doi.org/10.1088/1757-899X/324/1/012049

    Article  Google Scholar 

  41. Torabi M, Rao JNK (2013) Estimation of mean squared error of model-based estimators of small area means under a nested error linear regression model. J Multivar Anal 117:76–87. https://doi.org/10.1016/j.jmva.2013.02.008

    Article  MathSciNet  MATH  Google Scholar 

  42. Chai T, Draxler RR (2014) Root mean square error (RMSE) or mean absolute error (MAE)? Arguments against avoiding RMSE in the literature. Geosci Model Dev 7:1247–1250. https://doi.org/10.5194/gmd-7-1247-2014

    Article  Google Scholar 

  43. Chicco D, Warrens MJ, Jurman G (2021) The coefficient of determination R-squared is more informative than SMAPE, MAE, MAPE, MSE and RMSE in regression analysis evaluation. PeerJ Comput Sci 7:1–24. https://doi.org/10.7717/peerj-cs.623

    Article  Google Scholar 

  44. Kumari R, Srivastava S (2017) Machine learning: a review on binary classification. Int J Comput Appl 160(17):11–15. https://doi.org/10.5120/ijca2017913083

    Article  Google Scholar 

  45. Bradley AP (1997) The use of the area under the ROC curve in the evaluation of machine learning algorithms. Pattern Recognit 30(7):1145–1159. https://doi.org/10.1016/S0031-3203(96)00142-2

    Article  Google Scholar 

  46. Sokolova M, Japkowicz N, Szpakowicz S (2006) Beyond accuracy, F-score and ROC: a family of discriminant measures for performance evaluation. AI 2006: Advances in Artificial Intelligence. Lecture Notes in Computer Science, LNCS, Springer 4304:1015–1021. https://doi.org/10.1007/11941439_114

    Article  Google Scholar 

  47. Duy Thanh Tran, Jun-Ho Huh. Dataset for UELStore e-Commerce website. https://github.com/thanhtd32/ML.Recommend/tree/main/Dataset

  48. Duy Thanh Tran, Jun-Ho Huh. 9 built ML.Recommend models. https://github.com/thanhtd32/ML.Recommend/tree/main/Models

  49. Duy Thanh Tran, Jun-Ho Huh. Full source code of ML.Recommend model. https://github.com/thanhtd32/ML.Recommend

  50. UCI Sentiment Labeled Sentences dataset, Kotzias et al. KDD 2015 Irvine, CA: University of California, School of Information and Computer Science. https://archive.ics.uci.edu/ml/machine-learning-databases/00331

  51. Duy Thanh Tran, Jun-Ho Huh, ML.Recommend model on Microsoft Nuget: https://www.nuget.org/packages/ML.Recommend/

Download references

Funding

No funding.

Author information

Authors and Affiliations

  1. Faculty of Information Systems, University of Economics and Law, Vietnam National University Ho Chi Minh City, Ho Chi Minh, Vietnam

    Duy Thanh Tran

  2. Department of Data Informatics, (National) Korea Maritime and Ocean University, Busan, 49112, Republic of Korea

    Duy Thanh Tran

  3. Department of Data Science, (National) Korea Maritime and Ocean University, Busan, 49112, Republic of Korea

    Jun-Ho Huh

Authors
  1. Duy Thanh Tran
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jun-Ho Huh
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jun-Ho Huh.

Ethics declarations

Conflict of interest

The authors declare that they have no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Tran, D.T., Huh, JH. New machine learning model based on the time factor for e-commerce recommendation systems. J Supercomput 79, 6756–6801 (2023). https://doi.org/10.1007/s11227-022-04909-2

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11227-022-04909-2

Keywords

Search

Navigation