/h.SSKrSSKJr SSKJr SSKJr SSKJr "SS\R5r "SS \R5r g) N)closing)data) PorterStemmer)SnowballStemmerc2\rSrSrSrSrSrSrSrSr g) SnowballTest cX[SS5nURS5S:XdeURS5S:XdeURS5S:XdeURS5S :XdeURS 5S :XdeURS 5S :XdeURS 5S :XdeURS 5S :XdeURS5S:Xde[SS5nURS 5S:XdeURS5S :XdeURS5S:Xde[S5nURS5S:XdeURS5S:XdeURS5S:XdeURS5S :XdeURS5S:Xdeg)zl this unit testing for test the snowball arabic light stemmer this stemmer deals with prefixes and suffixes arabicTu&الْعَرَبِــــــيَّةuعربuالعربيةu فقالواuقالuالطالباتuطالبuفالطالباتuوالطالباتuالطالبونu اللذانuمنFuاللذuالكلماتuكلمNrstem)self ar_stemmers P/var/www/auris/envauris/lib/python3.13/site-packages/nltk/test/unit/test_stem.py test_arabicSnowballTest.test_arabic s %Xt4 GHHTTT/0H<<<~.(:::12j@@@34 BBB34 BBB12j@@@~..@@@v&&000$Xu5 ~.*<<<12j@@@/0H<<<$X. GHHTTT/0H<<<~.(:::12j@@@/0H<<<cH[S5nURS5S:Xdeg)Nrussianuавантненькаяuавантненькr )rstemmer_russians r test_russianSnowballTest.test_russian's'))4##$>?CYYYYrc[S5n[SSS9nURS5S:XdeURS5S:XdeURS5S:XdeURS5S:Xdeg)NgermanT)ignore_stopwordsu Schränkeschrankkeinenkeinr )rstemmer_germanstemmer_german2s r test_germanSnowballTest.test_german+s|(2)(TJ""=1Y>>>##M2i???""8,666##H-999rcv[S5nURS5S:XdeURS5S:Xdeg)Nspanish Visionadovisionalguealgur rstemmers r test_spanishSnowballTest.test_spanish5s<!),||K(H444||G$...rcH[S5nURS5S:Xdeg)Nenglishzy'syr r)s rtest_short_strings_bug#SnowballTest.test_short_strings_bug=s#!),||E"c)))rN) __name__ __module__ __qualname____firstlineno__rrr!r+r0__static_attributes__r2rrrr s=:Z:/*rrc>\rSrSrSrSrSrSrSrSr Sr S r g ) PorterTestBc[[R"S5RSS95nUR 5R 5sSSS5 $!,(df  g=f)Nz*stemmers/porter_test/porter_vocabulary.txtutf-8encoding)rrfindopenread splitlinesrfps r _vocabularyPorterTest._vocabularyCsR  IIB C H H  I  779'')    s A A#c[US9n[UR5U5H4upEURU5nXe:XaMSR UUUU55e g)N)modez*{} should stem to {} in {} mode but got {})rziprEr format)r stemmer_modeexpected_stemsr*word true_stemour_stems r_test_against_expected_output(PorterTest._test_against_expected_outputKsd\2"4#3#3#5~FOD||D)H% ;BB  % Grc[[R"S5RSS95nUR [ R UR5R55 SSS5 g!,(df  g=f)aJTests all words from the test vocabulary provided by M Porter The sample vocabulary and output were sourced from https://tartarus.org/martin/PorterStemmer/voc.txt and https://tartarus.org/martin/PorterStemmer/output.txt and are linked to from the Porter Stemmer algorithm's homepage at https://tartarus.org/martin/PorterStemmer/ z-stemmers/porter_test/porter_martin_output.txtr<r=N) rrr?r@rPrMARTIN_EXTENSIONSrArBrCs rtest_vocabulary_martin_mode&PorterTest.test_vocabulary_martin_modeXsj IIE F K K  L    . .//1E1E1G     =A33 Bc[[R"S5RSS95nUR [ R UR5R55 SSS5 g!,(df  g=f)Nz+stemmers/porter_test/porter_nltk_output.txtr<r=) rrr?r@rPrNLTK_EXTENSIONSrArBrCs rtest_vocabulary_nltk_mode$PorterTest.test_vocabulary_nltk_modejsh  IIC D I I  J    . .--rwwy/C/C/E     rVc[[R"S5RSS95nUR [ R UR5R55 SSS5 UR [ R [R"S5RSS9R5R55 g!,(df  Nl=f)Nz/stemmers/porter_test/porter_original_output.txtr<r=) rrr?r@rPrORIGINAL_ALGORITHMrArBrCs rtest_vocabulary_original_mode(PorterTest.test_vocabulary_original_modets IIG H M M  N    . .00"'')2F2F2H    **  , , IIG H T7T # TV Z\    s =C CcB[5RS5S:Xdeg)ztTest for bug https://github.com/nltk/nltk/issues/1581 Ensures that 'oed' can be stemmed without throwing an error. oedoNrr )rs r test_oed_bugPorterTest.test_oed_bugs ##E*c111rc[5nURS5S:XdeURS5S:XdeURSSS9S:XdeURS5S:XdeURSSS9S:Xdeg ) z}Test for improvement on https://github.com/nltk/nltk/issues/2507 Ensures that stems are lowercased when `to_lowercase=True` OnonIiF) to_lowercaseGithubgithubNrb)rporters rtest_lowercase_option PorterTest.test_lowercase_options {{4 D((({{33&&&{{3U{3s:::{{8$000{{8%{8HDDDrr2N) r3r4r5r6rErPrTrYr]rcrnr7r2rrr9r9Bs&* $ 02 Err9) unittest contextlibrnltkrnltk.stem.porterrnltk.stem.snowballrTestCaserr9r2rrrvs=*.6*8$$6*r[E""[Er