CoNLL 2017 Shared Task - Automatically Annotated Raw Texts and Word Embeddings

  Authors

Ginter, Filip ; Hajič, Jan ; Luotolahti, Juhani ; Straka, Milan and Zeman, Daniel

  Item identifier

http://hdl.handle.net/11234/1-1989

 Date issued

2017-03-15

 Type

languageDescription, text

 Size

90663834463 words, 5920786582 sentences, 630 gb

 Language(s)

Multiple languages

 Description

Automatic segmentation, tokenization and morphological and syntactic annotations of raw texts in 45 languages, generated by UDPipe (http://ufal.mff.cuni.cz/udpipe), together with word embeddings of dimension 100 computed from lowercased texts by word2vec (https://code.google.com/archive/p/word2vec/). For each language, automatic annotations in CoNLL-U format are provided in a separate archive. The word embeddings for all languages are distributed in one archive. Note that the CC BY-SA-NC 4.0 license applies to the automatically generated annotations and word embeddings, not to the underlying data, which may have different license and impose additional restrictions. Update 2018-09-03 =============== Added data in the 4 “surprise languages” from the 2017 ST: Buryat, Kurmanji, North Sami and Upper Sorbian. This has been promised before, during CoNLL-ST 2018 we gave the participants a link to this record saying the data was here. It wasn't, sorry. But now it is.

 Publisher

Charles University, Faculty of Mathematics and Physics, Institute of Formal and Applied Linguistics (UFAL)

 Subject(s)

CoNLL 2017 word embeddings automatic annotation

 Collection(s)

LINDAT / CLARIAH-CZ Data & Tools

Show full item record