initial vault

This commit is contained in:
Nicolay Sukhanovskii
2026-08-16 17:15:36 +03:00
commit 652761fb7b
41 changed files with 21777 additions and 0 deletions
@@ -0,0 +1,13 @@
#ml #учеба [[data mining]]
![[Pasted image 20260719174012.png]]
Main function to reduce word to it's original (root) form - stem (lemma).
### Lovins stemmer
Rules only, remove suffixes, main problem is over removal of suffixes the, those, them - the, love - lov and so on.
### Porter stemmer
Classify characters as vowels and consonant. Group sequential v and c and remove them by some rules (have rules, so still have some errors) Implementation in nltk.
### Snowball stemmer
Updated porter with new rules, stop word and including other languages (including Russian) also have stop words list, such as  _the_, _a_, _being_, and the like. Also has implementation in nltk.
Source: https://www.ibm.com/think/topics/stemming?regionCode=us&languageCode=en&cm-history=us-en