{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,2,21]],"date-time":"2025-02-21T16:55:11Z","timestamp":1740156911059,"version":"3.37.3"},"reference-count":41,"publisher":"MDPI AG","issue":"5","license":[{"start":{"date-parts":[[2021,5,13]],"date-time":"2021-05-13T00:00:00Z","timestamp":1620864000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["62002321"],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Zhejiang Provincial Natural Science Foundation of China","award":["Y18E050014"]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JTAER"],"abstract":"Traditional user research methods are challenged for the decision-making in product design and improvement with the updating speed becoming faster, considering limited survey scopes, insufficient samples, and time-consuming processes. This paper proposes a novel approach to acquire useful online reviews from E-commerce platforms, build a product evaluation indicator system, and put forward improvement strategies for the product with opinion mining and sentiment analysis with online reviews. The effectiveness of the method is validated by a large number of user reviews for smartphones wherein, with the evaluation indicator system, we can accurately predict the bad review rate for the product with only 9.9% error. And improvement strategies are proposed after processing the whole approach in the case study. The approach can be applied for product evaluation and improvement, especially for the products with needs for iterative design and sailed online with plenty of user reviews.<\/jats:p>","DOI":"10.3390\/jtaer16050090","type":"journal-article","created":{"date-parts":[[2021,5,13]],"date-time":"2021-05-13T15:10:06Z","timestamp":1620918606000},"page":"1598-1611","source":"Crossref","is-referenced-by-count":19,"title":["Online User Review Analysis for Product Evaluation and Improvement"],"prefix":"10.3390","volume":"16","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1783-4760","authenticated-orcid":false,"given":"Cheng","family":"Yang","sequence":"first","affiliation":[{"name":"College of Creativity and Art Design, Zhejiang University City College, Hangzhou 310015, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2301-9199","authenticated-orcid":false,"given":"Lingang","family":"Wu","sequence":"additional","affiliation":[{"name":"College of Computer Science and Technology, Zhejiang University, Hangzhou 310058, China"}]},{"given":"Kun","family":"Tan","sequence":"additional","affiliation":[{"name":"College of Computer Science and Technology, Zhejiang University, Hangzhou 310058, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8864-0106","authenticated-orcid":false,"given":"Chunyang","family":"Yu","sequence":"additional","affiliation":[{"name":"College of Creativity and Art Design, Zhejiang University City College, Hangzhou 310015, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7390-6597","authenticated-orcid":false,"given":"Yuliang","family":"Zhou","sequence":"additional","affiliation":[{"name":"College of Computer Science and Technology, Zhejiang University, Hangzhou 310058, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9152-7793","authenticated-orcid":false,"given":"Ye","family":"Tao","sequence":"additional","affiliation":[{"name":"College of Creativity and Art Design, Zhejiang University City College, Hangzhou 310015, China"}]},{"given":"Yu","family":"Song","sequence":"additional","affiliation":[{"name":"College of Creativity and Art Design, Zhejiang University City College, Hangzhou 310015, China"}]}],"member":"1968","published-online":{"date-parts":[[2021,5,13]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"84","DOI":"10.2307\/2393701","article-title":"Accelerating Adaptive Processes: Product Innovation in the Global Computer Industry","volume":"40","author":"Eisenhardt","year":"1995","journal-title":"Adm. Sci. Q."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"231","DOI":"10.1111\/1540-5885.1630231","article-title":"Speeding up the pace of new product development","volume":"16","author":"Kessler","year":"1999","journal-title":"J. Prod. Innov. Manag."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1016\/j.technovation.2014.07.010","article-title":"Antecedents of innovation impacts in publicly funded collaborative R&D projects","volume":"36","author":"Spanos","year":"2015","journal-title":"Technovation"},{"key":"ref_4","first-page":"1","article-title":"Iterative innovation design methods of internet products in the era of big data","volume":"37","author":"Tao","year":"2016","journal-title":"Packag. Eng."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"474","DOI":"10.1016\/j.cie.2015.11.007","article-title":"Customer-oriented product collaborative customization based on design iteration for tablet personal computer configuration","volume":"99","author":"Dou","year":"2016","journal-title":"Comput. Ind. Eng."},{"key":"ref_6","first-page":"908","article-title":"Multidimensional customer requirements acquisition based on ontology","volume":"22","author":"Wang","year":"2016","journal-title":"Jisuanji Jicheng Zhizao Xitong\/Comput. Integr. Manuf. Syst."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1891","DOI":"10.1109\/TII.2017.2650204","article-title":"Next-generation big data analytics: State of the art, challenges, and future research topics","volume":"13","author":"Lv","year":"2017","journal-title":"IEEE Trans. Ind. Inform."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"897","DOI":"10.1016\/j.jbusres.2015.07.001","article-title":"Big Data consumer analytics and the transformation of marketing","volume":"69","author":"Erevelles","year":"2016","journal-title":"J. Bus. Res."},{"key":"ref_9","unstructured":"Gharajeh, M.S. (2017). Biological Big Data Analytics. Adv. Comput., 1\u201335."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"850","DOI":"10.1016\/j.net.2016.12.015","article-title":"Big Data Analysis of Public Acceptance of Nuclear Power in Korea","volume":"49","author":"Roh","year":"2017","journal-title":"Nucl. Eng. Technol."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"010801","DOI":"10.1115\/1.4041087","article-title":"Review on recent advances in information mining from big consumer opinion data for product design","volume":"19","author":"Jin","year":"2019","journal-title":"J. Comput. Inf. Sci. Eng."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"144","DOI":"10.1145\/1562764.1562800","article-title":"Overcoming the J-shaped distribution of product reviews","volume":"52","author":"Hu","year":"2009","journal-title":"Commun. ACM"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"205","DOI":"10.1016\/j.elerap.2011.10.003","article-title":"Evaluating content quality and helpfulness of online product reviews: The interplay of review helpfulness vs. review content","volume":"11","author":"Korfiatis","year":"2012","journal-title":"Electron. Commer. Res. Appl."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s42979-020-00416-4","article-title":"Data-Driven Requirements Elicitation: A Systematic Literature Review","volume":"2","author":"Lim","year":"2021","journal-title":"SN Comput. Sci."},{"key":"ref_15","first-page":"96","article-title":"Product features extraction of online reviews based on LDA model","volume":"20","author":"Baizhang","year":"2014","journal-title":"Comput. Integr. Manuf. Syst."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"381","DOI":"10.1057\/ejis.2013.10","article-title":"\u2018Datafication\u2019: Making sense of (big) data in a complex world","volume":"22","author":"Lycett","year":"2013","journal-title":"Eur. J. Inf. Syst."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"17","DOI":"10.1016\/j.dss.2017.01.006","article-title":"Whose online reviews to trust? Understanding reviewer trustworthiness and its impact on business","volume":"96","author":"Banerjee","year":"2017","journal-title":"Decis. Support Syst."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1016\/j.dss.2017.02.001","article-title":"Online review helpfulness: Impact of reviewer profile image","volume":"96","author":"Karimi","year":"2017","journal-title":"Decis. Support Syst."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"291","DOI":"10.1287\/isre.1080.0193","article-title":"Examining the relationship between reviews and sales: The role of reviewer identity disclosure in electronic markets","volume":"19","author":"Forman","year":"2008","journal-title":"Inf. Syst. Res."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Dave, K., Lawrence, S., and Pennock, D.M. (2003, January 20\u201324). Mining the peanut gallery: Opinion extraction and semantic classification of product reviews. Proceedings of the 12th International Conference on World Wide Web, WWW 2003, Budapest, Hungary.","DOI":"10.1145\/775152.775226"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"10283","DOI":"10.1016\/j.eswa.2012.02.166","article-title":"Weakness Finder: Find product weakness from Chinese reviews by using aspects based sentiment analysis","volume":"39","author":"Zhang","year":"2012","journal-title":"Expert Syst. Appl."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Novgorodov, S., Guy, I., Elad, G., and Radinsky, K. (2019, January 13\u201317). Generating product descriptions from user reviews. Proceedings of the World Wide Web Conference, San Francisco, CA, USA.","DOI":"10.1145\/3308558.3313532"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"316","DOI":"10.1080\/10919392.2015.1058125","article-title":"How Service-Related Factors Affect the Survival of B2T Providers: A Sentiment Analysis Approach","volume":"25","author":"Jing","year":"2015","journal-title":"J. Organ. Comput. Electron. Commer."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1041","DOI":"10.1016\/j.eswa.2013.07.101","article-title":"Review-based measurement of customer satisfaction in mobile service: Sentiment analysis and VIKOR approach","volume":"41","author":"Kang","year":"2014","journal-title":"Expert Syst. Appl."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"23522","DOI":"10.1109\/ACCESS.2020.2969854","article-title":"Sentiment analysis for E-commerce product reviews in Chinese based on sentiment lexicon and deep learning","volume":"8","author":"Yang","year":"2020","journal-title":"IEEE Access"},{"key":"ref_26","first-page":"993","article-title":"Latent dirichlet allocation","volume":"3","author":"Blei","year":"2003","journal-title":"J. Mach. Learn. Res."},{"key":"ref_27","first-page":"1781","article-title":"A Method of Adaptively Selecting Best LDA Model Based on Density","volume":"31","author":"Juan","year":"2008","journal-title":"Chin. J. Comput."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Dong, Z., and Dong, Q. (2006). Hownet and the Computation of Meaning (with Cd-rom), World Scientific.","DOI":"10.1142\/5935"},{"key":"ref_29","unstructured":"(2021, May 13). Textblob Documentation. Available online: https:\/\/buildmedia.readthedocs.org\/media\/pdf\/textblob\/latest\/textblob.pdf."},{"key":"ref_30","unstructured":"(2021, March 20). iPhone\u2014Apple. Available online: https:\/\/www.apple.com\/iphone\/."},{"key":"ref_31","unstructured":"(2021, March 20). HUAWEI Phones. Available online: https:\/\/consumer.huawei.com\/cn\/phones\/?ic_medium=hwdc&ic_source=corp_header_consumer."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1016\/0169-7439(87)80084-9","article-title":"Principal component analysis","volume":"2","author":"Wold","year":"1987","journal-title":"Chemom. Intell. Lab. Syst."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Benesty, J., Chen, J., Huang, Y., and Cohen, I. (2009). Pearson correlation coefficient. Noise Reduction in Speech Processing, Springer.","DOI":"10.1007\/978-3-642-00296-0_5"},{"key":"ref_34","unstructured":"Moore, D.S., and Kirkland, S. (2007). The Basic Practice of Statistics, WH Freeman."},{"key":"ref_35","first-page":"500","article-title":"Using the R-MAPE index as a resistant measure of forecast accuracy","volume":"25","author":"Palmer","year":"2013","journal-title":"Psicothema"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"136","DOI":"10.1016\/j.jbusres.2020.02.030","article-title":"The value of online user generated content in product development","volume":"112","year":"2020","journal-title":"J. Bus. Res."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"87","DOI":"10.1016\/j.inffus.2020.02.007","article-title":"Processes and methods of information fusion for ranking products based on online reviews: An overview","volume":"60","author":"Fan","year":"2020","journal-title":"Inf. Fusion"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"103281","DOI":"10.1016\/j.im.2020.103281","article-title":"Can online user reviews be more helpful? Evaluating and improving ranking approaches","volume":"57","author":"Wang","year":"2020","journal-title":"Inf. Manag."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"111","DOI":"10.1016\/j.ijhm.2018.03.017","article-title":"Predicting overall customer satisfaction: Big data evidence from hotel online textual reviews","volume":"76","author":"Zhao","year":"2019","journal-title":"Int. J. Hosp. Manag."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1007\/s10660-017-9279-2","article-title":"Product innovation based on online review data mining: A case study of Huawei phones","volume":"18","author":"Zhang","year":"2018","journal-title":"Electron. Commer. Res."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1016\/j.dss.2019.03.002","article-title":"A text analytics approach for online retailing service improvement: Evidence from Twitter","volume":"121","author":"Ibrahim","year":"2019","journal-title":"Decis. Support Syst."}],"container-title":["Journal of Theoretical and Applied Electronic Commerce Research"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/0718-1876\/16\/5\/90\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,1,14]],"date-time":"2025-01-14T21:19:24Z","timestamp":1736889564000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/0718-1876\/16\/5\/90"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,5,13]]},"references-count":41,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2021,8]]}},"alternative-id":["jtaer16050090"],"URL":"https:\/\/doi.org\/10.3390\/jtaer16050090","relation":{},"ISSN":["0718-1876"],"issn-type":[{"type":"electronic","value":"0718-1876"}],"subject":[],"published":{"date-parts":[[2021,5,13]]}}}