{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,7,13]],"date-time":"2024-07-13T04:37:25Z","timestamp":1720845445121},"reference-count":52,"publisher":"MDPI AG","issue":"12","license":[{"start":{"date-parts":[[2020,11,25]],"date-time":"2020-11-25T00:00:00Z","timestamp":1606262400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Symmetry"],"abstract":"As part of the study, the problem of developing and applying a metric for assessing the degree of similarity of time series is considered, which makes it possible to consider the assumptions about the model of a series when comparing, as well as to compare the values of the corresponding characteristics of the series. Characteristics can be values that describe the structure of a series, or directly the values of the approximating function, which can be obtained using nonparametric statistics methods. One of the directions in which this approach can be applied to assessing the similarity of time series is the study of vocal performances. In practice, the degree of similarity in the performance of melodies by several speakers was analyzed. It was determined that, using the synchronicity metric, it is possible to implement an exercise in which students need to repeat the melody after the teacher. In addition, this approach was applied in the segment identification module with an abrupt change in the sounding of the fundamental frequency. This work is devoted to the modification of the program complex for vocal recognition in order to identify notes with a sharp change in the fundamental frequency. The complex is aimed at carrying out additional independent training in teaching vocals. The use of the software package will allow, in real time, providing feedback to the user with an assessment of the quality of their singing. This should allow students to study not only under the supervision of a teacher, but also independently in the early stages of learning. The basic algorithm of the program recognizes notes without sharp changes in frequencies with high accuracy, which is confirmed by experiments. In order to recognize by the algorithms of the program notes sung vibrato and glissando in singing, a new analysis method based on the metric of time series synchronicity is proposed.<\/jats:p>","DOI":"10.3390\/sym12121943","type":"journal-article","created":{"date-parts":[[2020,11,26]],"date-time":"2020-11-26T02:55:06Z","timestamp":1606359306000},"page":"1943","source":"Crossref","is-referenced-by-count":1,"title":["Metric of Highlighting the Synchronicity of Time Series and Its Application in Analyzing the Fundamental Frequencies of the Speaker\u2019s Speech Signal"],"prefix":"10.3390","volume":"12","author":[{"ORCID":"http:\/\/orcid.org\/0000-0002-2329-457X","authenticated-orcid":false,"given":"Elena","family":"Kataeva","sequence":"first","affiliation":[{"name":"Department of Security, Tomsk State University of Control Systems and Radioelectronics, 40 Lenina Prospect, 634050 Tomsk, Russia"}]},{"ORCID":"http:\/\/orcid.org\/0000-0001-9736-7658","authenticated-orcid":false,"given":"Alexey","family":"Yakimuk","sequence":"additional","affiliation":[{"name":"Department of Security, Tomsk State University of Control Systems and Radioelectronics, 40 Lenina Prospect, 634050 Tomsk, Russia"}]},{"ORCID":"http:\/\/orcid.org\/0000-0002-3222-9956","authenticated-orcid":false,"given":"Anton","family":"Konev","sequence":"additional","affiliation":[{"name":"Department of Security, Tomsk State University of Control Systems and Radioelectronics, 40 Lenina Prospect, 634050 Tomsk, Russia"}]},{"given":"Alexander","family":"Shelupanov","sequence":"additional","affiliation":[{"name":"Department of Security, Tomsk State University of Control Systems and Radioelectronics, 40 Lenina Prospect, 634050 Tomsk, Russia"}]}],"member":"1968","published-online":{"date-parts":[[2020,11,25]]},"reference":[{"key":"ref_1","first-page":"40","article-title":"Sociolinguistic conditions of functioning of the welsh variety of the English language (Wenglish)","volume":"3","author":"Emelianova","year":"2014","journal-title":"Lang. Cult."},{"key":"ref_2","first-page":"233","article-title":"Melodic structure of rising-descending tones as a marker of Welsh accent in English","volume":"607","author":"Fedotova","year":"2011","journal-title":"Bull. Mosc. State Linguist. Univ."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Zharovskaya, E.V. (2018). Prosodic features of youth\u2019s speech. Philol. Sci. Issues Theory Pract., 95\u201399.","DOI":"10.30853\/filnauki.2018-8-1.22"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"638","DOI":"10.1016\/j.specom.2010.02.012","article-title":"Vocal aging effects on F0 and the first formant: A longitudinal analysis in adult speakers","volume":"52","author":"Reubold","year":"2010","journal-title":"Speech Commun."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Pozdeeva, D., Shevchenko, T., and Abyzov, A. (2019, January 20\u201325). New Perspectives on Canadian English Digital Identity Based on Word Stress Patterns in Lexicon and Spoken Corpus. Proceedings of the SPECOM 2019 Speech and Computer, Istanbul, Turkey.","DOI":"10.1007\/978-3-030-26061-3_41"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Shevchenko, T., and Pozdeeva, D. (2017, January 12\u201316). Canadian English Word Stress: A Corpora-Based Study of National Identity in a Multilingual Community. Proceedings of the SPECOM 2017 Speech and Computer, Hertfordshire, UK.","DOI":"10.1007\/978-3-319-66429-3_21"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1805","DOI":"10.1121\/1.5002886","article-title":"The expression of emotion in the singing voice: Acoustic patterns in vocal performance","volume":"142","author":"Scherer","year":"2017","journal-title":"J. Acoust. Soc. Am."},{"key":"ref_8","first-page":"78","article-title":"Acoustic cues of negative and positive reporter\u2019s attitude in British radio reports","volume":"10","author":"Shuk","year":"2011","journal-title":"Vestn. Polotsk State Univ. Part A Humanit."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Shelupanov, A., Evsyutin, O., Konev, A., Kostyuchenko, E., Kruchinin, D., and Nikiforov, D. (2019). Information Security Methods\u2014Modern Research Directions. Symmetry, 11.","DOI":"10.3390\/sym11020150"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Kostyuchenko, E., Novokhrestova, D., Tirskaya, M., Shelupanov, A., Nemirovich-Danchenko, M., Choynzonov, E., and Balatskaya, L. (2019, January 20\u201325). The Evaluation Process Automation of Phrase and Word Intelligibility Using Speech Recognition Systems. Proceedings of the SPECOM 2019 Speech and Computer, Istanbul, Turkey.","DOI":"10.1007\/978-3-030-26061-3_25"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1741","DOI":"10.30534\/ijatcse\/2019\/103842019","article-title":"Fusion of BiLSTM and GMM-UBM Systems for Audio Spoofing Detection","volume":"6","author":"Rakhmanenko","year":"2019","journal-title":"Int. J. Adv. Trends Comput. Sci. Eng."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Kostuchenko, E., Novokhrestova, D., Pekarskikh, S., Shelupanov, A., Nemirovich-Danchenko, M., Choynzonov, E., and Balatskaya, L. (2019, January 20\u201325). Assessment of Syllable Intelligibility Based on Convolutional Neural Networks for Speech Rehabilitation After Speech Organs Surgical Interventions. Proceedings of the SPECOM 2019 Speech and Computer, Istanbul, Turkey.","DOI":"10.1007\/978-3-030-26061-3_37"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Kharchenko, S.S., Mescheryakov, R.V., Volf, D.A., Balatskaya, L.N., and Choinzonov, E.L. (2015). Fundamental frequency evaluation subsystem for natural speech rehabilitation software calculation module for cancer patients after larynx resection. SIBIRCON, 197\u2013200.","DOI":"10.1109\/SIBIRCON.2015.7361882"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"308","DOI":"10.1111\/j.1365-2729.2006.00178.x","article-title":"Development of real-time visual feedback assistance in singing training: A review","volume":"22","author":"Hoppe","year":"2006","journal-title":"J. Comput. Assist. Learn."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1233","DOI":"10.1109\/TASL.2011.2174224","article-title":"Automatic evaluation of karaoke singing based on pitch, volume, and rhythm features","volume":"20","author":"Tsai","year":"2011","journal-title":"IEEE Trans. Audio Speech Lang. Proc."},{"key":"ref_16","first-page":"157","article-title":"Learning to sing in tune: Does real-time visual feedback help?","volume":"2","author":"Wilson","year":"2008","journal-title":"J. Interdiscip. Music Stud."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"891","DOI":"10.1016\/j.neubiorev.2016.06.012","article-title":"A psychoengineering paradigm for the neurocognitive mechanisms of biofeedback and neurofeedback","volume":"68","author":"Gaume","year":"2016","journal-title":"Neurosci. Biobehav. Rev."},{"key":"ref_18","unstructured":"Barber, T.X. (1976). Biofeedback & Self\u2013Control: An Aldine Annual on the Regulation of Bodily Processing and Consciousness, Aldine Publishing Company."},{"key":"ref_19","first-page":"1","article-title":"Adults\u2019 Implicit Associations to Infant Positive and Negative Acoustic Cues: Moderation by Empathy and Gender","volume":"70","author":"Senese","year":"2016","journal-title":"Q. J. Exp. Psychol."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"338","DOI":"10.1038\/240338a0","article-title":"Evidence for Global Synchronism in Mantle Plume Convection, and Possible Significance for Geology","volume":"240","author":"Vogt","year":"1972","journal-title":"Nature"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Landscheidt, T. (1984). Cycles of solar flares and weather. Climatic Changes on a Yearly to Millennial Basis, Springer.","DOI":"10.1007\/978-94-015-7692-5_47"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"224","DOI":"10.1038\/067224a0","article-title":"The similarity of the short period barometric pressure variations over large areas","volume":"67","author":"Lockyer","year":"1903","journal-title":"Nature"},{"key":"ref_23","unstructured":"Storch, H., and Zwiers, F.W. (1999). Statistical Analysis in Climate Research, Cambridge University Press."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"10304","DOI":"10.18287\/JBPE19.05.010304","article-title":"Optoacoustic Gas-Analysis for Diagnostics of Biosystems","volume":"5","author":"Ageev","year":"2019","journal-title":"J. Biomed. Photonics Eng."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"275","DOI":"10.1134\/S1024856019030023","article-title":"Comparison of Residual Gas Characteristics in Annual Rings of Scots Pine Trees","volume":"32","author":"Ageev","year":"2019","journal-title":"Atmos. Ocean. Opt."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"114","DOI":"10.1016\/j.dendro.2018.12.003","article-title":"Siberian spruce tree ring anatomy: Imprint of development processes and their high-temporal environmental regulation","volume":"53","author":"Babushkina","year":"2019","journal-title":"Dendrochronologia"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"251","DOI":"10.2307\/1913236","article-title":"Co-Integration and Error Correction: Representation, Estimation, and Testing","volume":"55","author":"Engle","year":"1987","journal-title":"Econometrica"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Hennig, C., Meila, M., Murtagh, F., and Rocci, R. (2015). Handbook of Cluster Analysis, CRC Press.","DOI":"10.1201\/b19706"},{"key":"ref_29","unstructured":"Sankoff, D., and Kruskal, J. (1983). Time Warps, String Edits, and Macromolecules: The Theory and Practice of Sequence Comparison, Addison Wesley Publishing Company."},{"key":"ref_30","first-page":"359","article-title":"Using dynamic time warping to find patterns in time series","volume":"10","author":"Berndt","year":"1994","journal-title":"KDD Workshop Knowl. Discov. Databases"},{"key":"ref_31","first-page":"1","article-title":"Adaptive dissimilarity index for measuring time series proximity","volume":"1","author":"Nagabhushan","year":"2007","journal-title":"Adv. Data Anal. Classif."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Bure, V., and Staroverova, K. (2017, January 22\u201327). Methods of Cluster Analysis for Detection of Homogeneous Groups of Healthcare Time Series. Proceedings of the Constructive Nonsmooth Analysis and Related Topics (CNSA), Saint Petersburg, Russia.","DOI":"10.1109\/CNSA.2017.7973944"},{"key":"ref_33","first-page":"51","article-title":"Characteristics based dissimilarity measure for time series","volume":"13","author":"Staroverova","year":"2017","journal-title":"Appl. Math. Comput. Sci. Control Process."},{"key":"ref_34","first-page":"78","article-title":"Approach to clustering objects","volume":"326","author":"Botygin","year":"2015","journal-title":"Bull. Tomsk Polytech. Univ. Geo Assets Eng."},{"key":"ref_35","first-page":"1471","article-title":"Time series classification algorithm using combined feature description","volume":"1","author":"Kuznetsov","year":"2014","journal-title":"J. Mach. Learn. Data Anal."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"990","DOI":"10.1198\/016214504000001574","article-title":"CATS: Clustering After Transformation and Smoothing","volume":"100","author":"Serban","year":"2005","journal-title":"J. Am. Stat. Assoc."},{"key":"ref_37","first-page":"1275","article-title":"Synchronicity as an essential property of solar\u2013terrestrial relations: Latent components","volume":"2","author":"Tartakovsky","year":"2015","journal-title":"Nonlin. Proc. Geophys. Dis."},{"key":"ref_38","first-page":"012002","article-title":"Application of a principle of synchronicity to an analysis of climatic processes","volume":"48","author":"Tartakovsky","year":"2016","journal-title":"Earth Environ. Sci."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"10237","DOI":"10.1038\/srep10237","article-title":"VoICE: A semi-automated pipeline for standardizing vocal analysis across models","volume":"5","author":"Burkett","year":"2015","journal-title":"Sci. Rep."},{"key":"ref_40","first-page":"1734","article-title":"Song adjustments by an open habitat bird to anthropogenic noise, urban structure, and vegetation","volume":"27","author":"Job","year":"2016","journal-title":"Behav. Ecol."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Damos, P. (2016). Using multivariate cross correlations, Granger causality and graphical models to quantify spatiotemporal synchronization and causality between pest populations. BMC Ecol., 16.","DOI":"10.1186\/s12898-016-0087-7"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"115","DOI":"10.1016\/j.conb.2014.07.002","article-title":"The role of ultrasonic vocalizations in mouse communication","volume":"28","author":"Portfors","year":"2014","journal-title":"Curr. Opin. Neurobiol."},{"key":"ref_43","first-page":"48","article-title":"Parametric diagnostics based on synchronization and asynchrony of changing parameters of gas turbine engines of one aircraft","volume":"208","author":"Ngenge","year":"2014","journal-title":"Sci. Her. Mosc. State Tech. Univ."},{"key":"ref_44","first-page":"123","article-title":"Correlation analysis of ensemble singing","volume":"29","author":"Bakaev","year":"2014","journal-title":"Eng. Bull. Don."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"012077","DOI":"10.1088\/1742-6596\/803\/1\/012077","article-title":"The program complex for vocal recognition","volume":"803","author":"Konev","year":"2017","journal-title":"J. Phys. Conf. Ser."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"361","DOI":"10.3103\/S8756699018040076","article-title":"Speech Signal Segmentation into Vocalized and Unvocalized Segments on the Basis of Simultaneous Masking","volume":"54","author":"Konev","year":"2018","journal-title":"Optoelectron. Instrum. Data Proc."},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Bierens, H.J. (1994). The Nadaraya\u2013Watson kernel regression function estimator. Top. Adv. Econom., 212\u2013247.","DOI":"10.1017\/CBO9780511599279.011"},{"key":"ref_48","first-page":"85","article-title":"New coefficients of econometrics models quality estimation","volume":"24","author":"Svetunkov","year":"2011","journal-title":"Appl. Econom."},{"key":"ref_49","first-page":"229","article-title":"The application of synchronism identification algorithm to meteorological time","volume":"56","author":"Kataeva","year":"2015","journal-title":"Russ. Phys. J."},{"key":"ref_50","unstructured":"Kholopova, V.N. (2014). Music as a kind of Art; Textbook, Publishing Company \u00abPlanet of Music\u00bb."},{"key":"ref_51","unstructured":"Shvetsov, A.G. (2006). Anatomy, Physiology, and Pathology of Hearing, Vision, and Speech, Nelson Education."},{"key":"ref_52","first-page":"012072","article-title":"Applying the principle of distribution in the program complex for vocal recognition","volume":"597","author":"Yakimuk","year":"2019","journal-title":"Mater. Sci. Eng."}],"container-title":["Symmetry"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2073-8994\/12\/12\/1943\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,7,5]],"date-time":"2024-07-05T21:13:59Z","timestamp":1720214039000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2073-8994\/12\/12\/1943"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,11,25]]},"references-count":52,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2020,12]]}},"alternative-id":["sym12121943"],"URL":"https:\/\/doi.org\/10.3390\/sym12121943","relation":{},"ISSN":["2073-8994"],"issn-type":[{"value":"2073-8994","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,11,25]]}}}