Differences

This shows you the differences between two versions of the page.

--- 01_corpus:01_subcorpora [2020/04/15 08:37] – ↷ Page name changed from 01_corpus:subcorpora to 01_corpus:01_subcorpora simone
+++ 01_corpus:01_subcorpora [2020/05/04 13:42] – [Definitions for sub-corpora] simone
@@ Line 6: / Line 6: @@
 ===== Definitions for sub-corpora =====
-  * Each chat was to be assigned to only one language-sub-corpus. As mentioned in the section [[01_corpus:03_preprocessing:04_language_per_chat|languages per chat]], each chat has an annotation for languages that occur in 100 and more messages (meta::lang_100_and_more). However, there are chats with e.g. more than 100 messages in French and in German. In that case, the language that provides most chats is used for the chat to be assigned to a language-sub-corpus. Example: if a chat is built up of 150 messages in French and 120 messages in German, it appears in the main corpus (WUS) as well as in the French sub-corpora (WUS_FRA and WUS_FRA_DEMOG) but not in any of the German sub-corpora.
+  * Each chat was to be assigned to only one language-sub-corpus.
   * Additionally, we differentiate between chats where we have demographic information for all participants and those where we do not. In the former case, the sub-corpus gets the extension _DEMOG.
-  * Where additional tasks were performed on individual chats (e.g. normalization or part-of-speech tagging) we created additional sub-corpora exist per language.
+  * Where additional tasks were performed on individual chats (e.g. normalization or part-of-speech tagging) we created additional sub-corpora per language.