Skip to content

thhepp/cov2words-worldlist-knime

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

6 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

COV2WORDS! Word list

This repository takes care of the generation of word lists using the open source version of KNIME. Text files are read in and processed for this purpose. The resulted wordlist is the json file in the root of the repository.

Contents

  • corpus contains all textual pre-processed input files
  • manual contains manually defined words that are easy to remember, e.g. colors
  • stopwords contains words that are removed from the corpus
  • CovappWordList.knwf is the data processing workflow of KNIME

About corpus

The corpus contains the german most frequent words according to researchers from University of Leipzig. Additionally the corpus extended by the biggest geographic terms such as the biggest cities in Germany and neighboring countries. These information was crawled from Wikipedia and News Articles, that were crawled with Newsplease.

Contributors:

  • Thomas Hepp

License

MIT 2.0