Skip to content

juanantoniodelgado/StopWords

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

67 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

StopWords

Codacy Badge

PHP StopWords removal library with support for multiple languages.

Installation

composer require juanantoniodelgado/stopwords

Usage

use StopWords/StopWords;

$stopwords = new StopWords('en');
$stopwords->clean('your text to clean');

Supported languages

Arabic, Armenian, Basque, Bulgarian, Catalan, Cebuano, Chinese, Czech, Danish, Dutch, English, Estonian, Finnish, French, German, Greek, Gujarati, Hebrew, Hindi, Hungarian, Indonesian, Italian, Japanese, Latvian, Malay, Norwegian, Persian, Portuguese, Romanian, Russian, Slovak, Spanish, Swedish, Thai, Turkish, Ukrainian, and Vietnamese.

Notes

Language files are set according to ISO 639-2.

Sources

Language Source
Arabic https://github.com/Alir3z4/stop-words/blob/master/arabic.txt
Armenian https://docs.google.com/viewer?a=v&pid=sites&srcid=ZGVmYXVsdGRvbWFpbnxrZXZpbmJvdWdlfGd4OmM1NzgyOTk3NDA4NGJhZQ
Basque http://www.ranks.nl/stopwords/basque
Bulgarian https://github.com/Alir3z4/stop-words/blob/master/bulgarian.txt
Catalan http://www.ranks.nl/stopwords/catalan http://latel.upf.edu/morgana/altres/pub/ca_stop.htm
Cebuano https://github.com/digitalheir/cebuano-dictionary-js/blob/master/stop-words/stop-words.ts
Chinese https://docs.google.com/viewer?a=v&pid=sites&srcid=ZGVmYXVsdGRvbWFpbnxrZXZpbmJvdWdlfGd4OjRmZjlhYTNkNWZjMTc3NWI
Czech https://github.com/Alir3z4/stop-words/blob/master/czech.txt
Danish https://github.com/Alir3z4/stop-words/blob/master/danish.txt
Dutch https://github.com/Alir3z4/stop-words/blob/master/dutch.txt
English http://www.ranks.nl/stopwords
Estonian https://github.com/stopwords-iso/stopwords-et
Finnish https://github.com/Alir3z4/stop-words/blob/master/finnish.txt
French http://www.ranks.nl/stopwords/french https://github.com/Alir3z4/stop-words/blob/master/french.txt
German https://github.com/Alir3z4/stop-words/blob/master/german.txt
Greek https://docs.google.com/viewer?a=v&pid=sites&srcid=ZGVmYXVsdGRvbWFpbnxrZXZpbmJvdWdlfGd4OjI5MzI4MDRjMzk3M2Y2OWU
Gujarati https://github.com/Alir3z4/stop-words/blob/master/gujarati.txt
Hebrew https://github.com/Alir3z4/stop-words/blob/master/hebrew.txt
Hindi https://github.com/Alir3z4/stop-words/blob/master/hindi.txt
Hungarian https://github.com/Alir3z4/stop-words/blob/master/hungarian.txt
Indonesian https://github.com/Alir3z4/stop-words/blob/master/indonesian.txt
Italian https://raw.githubusercontent.com/Alir3z4/stop-words/master/italian.txt
Japanese https://docs.google.com/viewer?a=v&pid=sites&srcid=ZGVmYXVsdGRvbWFpbnxrZXZpbmJvdWdlfGd4OjdhNWQxZGQwOTE3ZjVkY2M
Latvian https://docs.google.com/viewer?a=v&pid=sites&srcid=ZGVmYXVsdGRvbWFpbnxrZXZpbmJvdWdlfGd4OjNiNGI5YTVmYjkxOWEwYmQ
Malay https://github.com/Alir3z4/stop-words/blob/master/malaysian.txt
Norwegian https://raw.githubusercontent.com/Alir3z4/stop-words/master/norwegian.txt
Persian https://docs.google.com/viewer?a=v&pid=sites&srcid=ZGVmYXVsdGRvbWFpbnxrZXZpbmJvdWdlfGd4OjY0MWMxMDBjZTc2Y2ZmZjk
Portuguese https://raw.githubusercontent.com/Alir3z4/stop-words/master/portuguese.txt
Romanian https://raw.githubusercontent.com/Alir3z4/stop-words/master/romanian.txt
Russian https://raw.githubusercontent.com/Alir3z4/stop-words/master/russian.txt
Slovak https://github.com/Alir3z4/stop-words/blob/master/slovak.txt
Spanish http://www.ranks.nl/stopwords/spanish http://snowball.tartarus.org/algorithms/spanish/stop.txt https://github.com/Alir3z4/stop-words/blob/master/spanish.txt
Swedish https://raw.githubusercontent.com/Alir3z4/stop-words/master/swedish.txt
Tagalog https://github.com/stopwords-iso/stopwords-tl
Thai https://github.com/stopwords-iso/stopwords-th
Turkish https://raw.githubusercontent.com/Alir3z4/stop-words/master/turkish.txt
Ukrainian https://raw.githubusercontent.com/Alir3z4/stop-words/master/ukrainian.txt
Vietnamese https://github.com/Alir3z4/stop-words/blob/master/vietnamese.txt

License

Contents of this repository are available under Attribution 4.0 International (CC BY 4.0).