User Tools

Site Tools


01_corpus:01_subcorpora

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
Next revision
Previous revision
01_corpus:subcorpora [2020/04/14 17:19] – [Smaller corpora] simone01_corpus:01_subcorpora [2022/06/27 09:21] (current) – external edit 127.0.0.1
Line 1: Line 1:
-====== 1.Sub-corpora ======+====== 1.Sub-corpora ======
 Based on the annotation of the languages per chat, different sub-corpora were created.   Based on the annotation of the languages per chat, different sub-corpora were created.  
  
Line 6: Line 6:
 ===== Definitions for sub-corpora ===== ===== Definitions for sub-corpora =====
  
-  * Each chat was to be assigned to only one language-sub-corpus. As mentioned in the section [[01_corpus:03_preprocessing:03_language_per_chat|languages per chat]], each chat has an annotation for languages that occur in 100 and more messages (meta::lang_100_and_more). However, there are chats with e.g. more than 100 messages in French and in German. In that case, the language that provides most chats is used for the chat to be assigned to a language-sub-corpus. Example: if a chat is built up of 150 messages in French and 120 messages in German, it appears in the main corpus (WUS) as well as in the French sub-corpora (WUS_FRA and WUS_FRA_DEMOG) but not in any of the German sub-corpora.+  * Each chat was to be assigned to only one language-sub-corpus. 
   * Additionally, we differentiate between chats where we have demographic information for all participants and those where we do not. In the former case, the sub-corpus gets the extension _DEMOG.   * Additionally, we differentiate between chats where we have demographic information for all participants and those where we do not. In the former case, the sub-corpus gets the extension _DEMOG.
-  * Where additional tasks were performed on individual chats (e.g. normalization or part-of-speech tagging) we created additional sub-corpora exist per language.+  * Where additional tasks were performed on individual chats (e.g. normalization or part-of-speech tagging) we created additional sub-corpora per language.
  
  
Line 25: Line 25:
   * WUS_ROH_DEMOG: A subgroup thereof where we have demographic information from all communication partners.   * WUS_ROH_DEMOG: A subgroup thereof where we have demographic information from all communication partners.
  
 +Additionally to these corpora, you also see corpora with lowercase letters in the browser (e.g. deu-rftagged, ita-tagged, roh etc.). These corpora contain data from our [[https://wiki.linguistik.uzh.ch/sms4science|SMS project]].
 ===== Smaller corpora ===== ===== Smaller corpora =====
  
Line 32: Line 32:
   * WUS_SMALL_DEMOG: A subgroup thereof where we have demographic information from all communication partners.   * WUS_SMALL_DEMOG: A subgroup thereof where we have demographic information from all communication partners.
   * WUSdemographics: Only demographic data per person. This sub-corpus is much faster if you want to look up demographic data only.   * WUSdemographics: Only demographic data per person. This sub-corpus is much faster if you want to look up demographic data only.
-  * WUS_ARGDROP and WUS_ARGDROP_language: Sub-corporafor which argument drop has been manually annotated. For the architecture of the annotations and scientific considerations behind it see [[http://www.unige.ch/lettres/linge/syntaxe/journal/volume_onze_2018.html|Stuntebeck, Franziska (2018): "Annotating Argument Drop in the Swiss WhatsApp Corpus". In: Generative Grammar in Geneva (GG@G) XI, 175-187.]]+  * WUS_ARGDROP and WUS_ARGDROP_language: Sub-corpora for which argument drop has been manually annotated. For the architecture of the annotations and scientific considerations behind it see [[http://www.unige.ch/lettres/linge/syntaxe/journal/Volume11/11_Stuntebeck_2018.pdf|Stuntebeck, Franziska (2018): "Annotating Argument Drop in the Swiss WhatsApp Corpus". In: Generative Grammar in Geneva (GG@G) XI, 175-187.]] 
  
 +===== Other corpora in the browsing tool =====
 +Additionally to these corpora, you also see corpora with lowercase letters in the browser (e.g. deu-rftagged, ita-tagged, roh etc.). These corpora contain data from our [[https://wiki.linguistik.uzh.ch/sms4science|SMS project]].
  
 ===== More information about the subcorpora ===== ===== More information about the subcorpora =====
01_corpus/01_subcorpora.1586877572.txt.gz · Last modified: 2022/06/27 09:21 (external edit)

Donate Powered by PHP Valid HTML5 Valid CSS Driven by DokuWiki