Abstract
In this paper, the comparison of 2,3,4-gram language models with various lexicon sizes is presented. The text data forming the training corpus has been collected from recent Internet news sites; total size of the corpus is about 350 million words (2.4 GB data). The language models were built using the recognition lexicons of 110K, 150K, 219K, and 303K words. For evaluation of these models such characteristics as perplexity, OOV words rate and n-gram hit rate were computed. Experimental results on continuous Russian speech recognition are also given in the paper.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Ircing, P., Hoidekr, J., Psutka, J.: Exploiting linguistic knowledge in language modeling of Czech spontaneous speech. In: Proceedings of Int. Conf. on Language Resources and Evaluation, LREC 2006, Genoa, Italy, pp. 2600–2603 (2006)
Kurimo, M., et al.: Unlimited vocabulary speech recognition for agglutinative languages. In: Proceedings of Human Language Technology Conference of the North American Chapter of the ACL, New York, USA, pp. 487–494 (2006)
Vaičiūnas, A.: Statistical Language Models of Lithuanian and Their Application to Very Large Vocabulary Speech Recognition. PhD thesis, Vytautas Magnus University, Kaunas (2006)
Whittaker, E.W.D., Woodland, P.C.: Efficient class-based language modelling for very large vocabularies. In: Proceedings of ICASSP 2001, Salt Lake City, USA, pp. 545–548 (2001)
Whittaker, E.W.D.: Statistical language modelling for automatic speech recognition of Russian and English. PhD thesis, Cambridge Univ., 140 p. (2000)
Vazhenina, D., Kipyatkova, I., Markov, K., Karpov, A.: State-of-the-art Speech Recognition Technologies for Russian Language. In: Proceedings of the Joint International Conference on Human-Centered Computer Environments, HCCE 2012, Aizu-Wakamatsu, Japan, pp. 59–63 (2012)
Viktorov, A., Gramnitskiy, S., Gordeev, S., Eskevich, M., Klimina, E.: Universal technique for preparing components for training of a speech recognition system. Speech Technologies 2, 39–55 (2009) (in Rus.)
Oparin, I., Talanov, A.: Stem-Based Approach to Pronunciation Vocabulary Construction and Language Modeling for Russian. In: Proceedings of SPECOM 2005, Patras, Greece, pp. 575–578 (2005)
Pylypenko, V.: Extra Large Vocabulary Continuous Speech Recognition Algorithm based on Information Retrieval. In: Proceedings of Interspeech 2007, Antwerp, Belgium, pp. 1809–1812 (2007)
Zablotskiy, S., Shvets, A., Sidorov, M., Semenkin, E., Minker, W.: Speech and Language Recources for LVCSR of Russia. In: Proceedings of LREC 2012, Istanbul, Turkey, pp. 3374–3377 (2012)
Lamel, L., Courcinous, S., Gauvain, J.-L., Josse, Y., Le, V.B.: Transcription of Russian Conversational Speech. In: Proceedings of SLTU 2012, Cape Town, RSA, pp. 156–161 (2012)
Lamel, L., et al.: Speech Recognition for Machine Translation in Quaero. In: Proceedings of International Workshop on Spoken Language Translation, IWSLT 2011, San Francisco, USA, pp. 121–128 (2011)
Schalkwyk, J., Beeferman, D., Beaufays, F., Byrne, B., Chelba, C., Cohen, M., Kamvar, M., Strope, B.: Google Search by Voice: A Case Study. Advances in Speech Recognition: Mobile Environments, Call Centers and Clinics, 61–90 (2010)
Kipyatkova, I., Karpov, A., Verkhodanova, V., Zelezny, M.: Analysis of Long-distance Word Dependencies and Pronunciation Variability at Conversational Russian Speech Recognition. In: Proceedings of Federated Conference on Computer Science and Information Systems, FedCSIS 2012, Wroclaw, Poland, pp. 719–725 (2012)
Vazhenina, D., Markov, K.: Phoneme Set Selection for Russian Speech Recognition. In: Proceedings of 7th Int. Conf. on NLP and Knowledge Engineering, NLP-KE 2011, Japan, pp. 475–478 (2011)
Karpov, A., Kipyatkova, I., Ronzhin, A.: Speech Recognition for East Slavic Languages: The Case of Russian. In: Proceedings of the 3rd International Workshop on Spoken Languages Technologies for Under-resourced Languages, SLTU 2012, Cape Town, RSA, pp. 84–89 (2012)
Karpov, A., Kipyatkova, I., Ronzhin, A.: Very Large Vocabulary ASR for Spoken Russian with Syntactic and Morphemic Analysis. In: Proceedings of Interspeech 2011, Florence, Italy, pp. 3161–3164 (2011)
Stolcke, A., Zheng, J., Wang, W., Abrash, V.: SRILM at Sixteen: Update and Outlook. In: Proceedings of IEEE Automatic Speech Recognition and Understanding Workshop, ASRU 2011, Waikoloa, Hawaii, USA (2011)
Jokisch, O., Wagner, A., Sabo, R., Jaeckel, R., Cylwik, N., Rusko, M., Ronzhin, A., Hoff-mann, R.: Multilingual speech data collection for the assessment of pronunciation and prosody in a language learning system. In: Proceedings of SPECOM 2009, St. Peterburg, Russia, pp. 515–520 (2009)
Rabiner, L., Juang, B.-H.: Fundamentals of Speech Recognition, 496 p. Prentice Hall (1995)
Lee, A., Kawahara, T.: Recent Development of Open-Source Speech Recognition Engine Julius. In: Proceedings of Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC 2009), Sapporo, Japan, pp.131–137 (2009)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer International Publishing Switzerland
About this paper
Cite this paper
Kipyatkova, I., Karpov, A. (2013). Lexicon Size and Language Model Order Optimization for Russian LVCSR. In: Železný, M., Habernal, I., Ronzhin, A. (eds) Speech and Computer. SPECOM 2013. Lecture Notes in Computer Science(), vol 8113. Springer, Cham. https://doi.org/10.1007/978-3-319-01931-4_29
Download citation
DOI: https://doi.org/10.1007/978-3-319-01931-4_29
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-01930-7
Online ISBN: 978-3-319-01931-4
eBook Packages: Computer ScienceComputer Science (R0)