Documentation

What's up, Switzerland?

User Tools

Site Tools


01_corpus:02_preprocessing:07_normalization

1.2.7 Normalization

Normalization is the task of "translating" non-standard language data into standard language. It can be performed manually or automatically with computational linguistics tools.

In the case of our corpus, we have manually normalized some data in the Swiss German dialect, resulting in the corpus WUS_DIALOG_GSW (5 chats, 34,683 tokens).

01_corpus/02_preprocessing/07_normalization.txt · Last modified: 2020/05/11 08:56 (external edit)