/hSSKrSSKrSSKJr SSKJr "SS5r"SS5r"SS \5r"S S \5r "S S \5r "SS\5r "SS\5r "SS\5r "SS\5r"SS\5r\R "SR#SS55rSr"SS\5r"SS\5rS rS!r\S":Xa\"5 gg)#N) ChunkParserITreec\rSrSrSrSrS\-rSrSrS\-r S\-r \ R"S \-5r \ R"S 5r\ R"S 5rSS jrS rSrSSjrSrSrSrSrg) ChunkStringa A string-based encoding of a particular chunking of a text. Internally, the ``ChunkString`` class uses a single string to encode the chunking of the input text. This string contains a sequence of angle-bracket delimited tags, with chunking indicated by braces. An example of this encoding is:: {
}{
}<.>{
}<.> ``ChunkString`` are created from tagged texts (i.e., lists of ``tokens`` whose type is ``TaggedType``). Initially, nothing is chunked. The chunking of a ``ChunkString`` can be modified with the ``xform()`` method, which uses a regular expression to transform the string representation. These transformations should only add and remove braces; they should *not* modify the sequence of angle-bracket delimited tags. :type _str: str :ivar _str: The internal string representation of the text's encoding. This string representation contains a sequence of angle-bracket delimited tags, with chunking indicated by braces. An example of this encoding is:: {
}{
}<.>{
}<.> :type _pieces: list(tagged tokens and chunks) :ivar _pieces: The tagged tokens and chunks encoded by this ``ChunkString``. :ivar _debug: The debug level. See the constructor docs. :cvar IN_CHUNK_PATTERN: A zero-width regexp pattern string that will only match positions that are in chunks. :cvar IN_STRIP_PATTERN: A zero-width regexp pattern string that will only match positions that are in strips. z [^\{\}<>]z(<%s+?>)z (?=[^\{]*\})z(?=[^\}]*(\{|$))z (\{%s+?\})+?z(%s+?)+?z^(\{?%s\}?)*?$z[^\{\}]+z(\{\})*$cUR5UlUSSUlURVs/sHo0RU5PM nnSSR U5-S-UlX lgs snf)a Construct a new ``ChunkString`` that encodes the chunking of the text ``tagged_tokens``. :type chunk_struct: Tree :param chunk_struct: The chunk structure to be further chunked. :type debug_level: int :param debug_level: The level of debugging which should be applied to transformations on the ``ChunkString``. The valid levels are: - 0: no checks - 1: full check on to_chunkstruct - 2: full check on to_chunkstruct and cursory check after each transformation. - 3: full check on to_chunkstruct and full check after each transformation. We recommend you use at least level 1. You should probably use level 3 if you use any non-standard subclasses of ``RegexpChunkRule``. N<>)label _root_label_pieces_tagjoin_str_debug)self chunk_struct debug_leveltoktagss I/var/www/auris/envauris/lib/python3.13/site-packages/nltk/chunk/regexp.py__init__ChunkString.__init__Hsa.(--/#A *.,,7,3 #,7$))D/)C/ ! 8sA-c[U[5(aUS$[U[5(aUR5$[ S5e)Nz4chunk structures must contain tagged tokens or trees) isinstancetuplerr ValueError)rrs rrChunkString._tages= c5 ! !q6M T " "99; VW Wc([RRU5(d[SU-5e[RR SU5n[ S[U5S--5HBnX4S-US-S-n[RRU5(aM6[SU-5e US::ag[R"SU5SSnURVs/sHopRU5PM nnXh:wa [S 5egs snf) a4 Check to make sure that ``s`` still corresponds to some chunked version of ``_pieces``. :type verify_tags: bool :param verify_tags: Whether the individual tags should be checked. If this is false, ``_verify`` will check to make sure that ``_str`` encodes a chunked version of *some* list of tokens. If this is true, then ``_verify`` will check to make sure that the tags in ``_str`` match those in ``_pieces``. :raise ValueError: if the internal string representation of this ``ChunkString`` is invalid or not consistent with _pieces. z2Transformation generated invalid chunkstring: %srirNz [\{\}<>]+z9Transformation generated invalid chunkstring: tag changed) r_VALIDmatchr _BRACKETSsubrangelen_BALANCED_BRACKETSresplitrr) rs verify_tagsbracketsisubstrtags1piecetags2s r_verifyChunkString._verifyms "!!''**H1L ((,,R3q3x=D001A$hTD9F1177?? LqP2 !  ,*Ab1/3||<|e5!|< >N  =s"DcURS:aURURS5 /nSnSn[R"SUR5HVnUR S5nUR X3U-nU(aUR[X55 OX'- nX6- nU(+nMX [URU5$)z Return the chunk structure encoded by this ``ChunkString``. :rtype: Tree :raise ValueError: If a transformation has generated an invalid chunkstring. rr[{}]r ) rr6rr,r-countrappendrr )r chunk_labelpiecesindexpiece_in_chunkr4length subsequences rto_chunkstructChunkString.to_chunkstructs ;;? LLA &XXfdii0E[[%F,,uv~>K d;<=% OE!//N1D$$f--r!c[R"XUR5n[R"SSU5nURS:aUR X0RS- 5 X0lg)a Apply the given transformation to the string encoding of this ``ChunkString``. In particular, find all occurrences that match ``regexp``, and replace them using ``repl`` (as done by ``re.sub``). This transformation should only add and remove braces; it should *not* modify the sequence of angle-bracket delimited tags. Furthermore, this transformation may not result in improper bracketing. Note, in particular, that bracketing may not be nested. :type regexp: str or regexp :param regexp: A regular expression matching the substring that should be replaced. This will typically include a named group, which can be used by ``repl``. :type repl: str :param repl: An expression specifying what should replace the matched substring. Typically, this will include a named replacement group, specified by ``regexp``. :rtype: None :raise ValueError: If this transformation generated an invalid chunkstring. z\{\}r#rN)r,r(rrr6)rregexpreplr.s rxformChunkString.xformsT4 FF6 + FF7B " ;;? LLKK!O , r!c2S[UR5-$)z Return a string representation of this ``ChunkString``. It has the form:: }{
}'> :rtype: str z)reprrrs r__repr__ChunkString.__repr__s#T$))_44r!c[R"SSUR5n[R"SSU5nUSS:XaSU-nU$)z Return a formatted representation of this ``ChunkString``. This representation will include extra spaces to ensure that tags will line up with the representation of other ``ChunkStrings`` for the same text, regardless of the chunking. :rtype: str z>(?!\})z> z([^\{])}'->''> Note that this representation does not include the description string; that string can be accessed separately with the ``descr()`` method. :rtype: str zr )rKrhpatternrfrLs rrMRegexpChunkRule.__repr__KsH !4<<''( ) 4::    r!c[R"SU5nURS5R5nURS5=(d SSSR5nU(d [ S5eUSS :XaUS S :Xa[ USS U5$USS :XaUS S :Xa[ USS U5$S U;aURS 5upE[XEU5$S U;aURS 5upE[XEU5$[R"SU5(a&[R"SU5upFn[XFXS5$[ SU-5e![[R4an[ SU-5UeSnAff=f)a Create a RegexpChunkRule from a string description. Currently, the following formats are supported:: {regexp} # chunk rule }regexp{ # strip rule regexp}{regexp # split rule regexp{}regexp # merge rule Where ``regexp`` is a regular expression for the rule. Any text following the comment marker (``#``) will be used as the rule's description: >>> from nltk.chunk.regexp import RegexpChunkRule >>> RegexpChunkRule.fromstring('{
?+}') ?+'> z&(?P(\\.|[^#])*)(?P#.*)?rulecommentr#rNzEmpty chunk patternr{r$}z}{z{}z[^{}]*{[^{}]*}[^{}]*r9zIllegal chunk pattern: %s) r,r&groupstripr ChunkRule StripRuler- SplitRule MergeRuleChunkRuleWithContexterror)r.mrurvleftrightchunkes r fromstringRegexpChunkRule.fromstring_sn( HH> Bwwv$$&779%+QR0668 H !677Aw#~$r(c/ aW55aCDHO aW55"jj.  g66"jj.  g660$77%'XXfd%;"U+DHH !)z {\g}N)_patternr,r`tag_pattern2re_patternrr]rdrr tag_patternrirFs rrChunkRule.__init__sA$ %k2K4P4P R    ~uEr!c8S[UR5-S-$)z Return a string representation of this rule. It has the form:: '> Note that this representation does not include the description string; that string can be accessed separately with the ``descr()`` method. :rtype: str z rz }\g{N)rr,r`rrr\rdrrs rrStripRule.__init__sA$ %k2K4P4P R    ~uEr!c8S[UR5-S-$)z Return a string representation of this rule. It has the form:: '> Note that this representation does not include the description string; that string can be accessed separately with the ``descr()`` method. :rtype: str z %s)\}z \gN)rr,r`rrdrrs rrUnChunkRule.__init__s5$ 03I+3VVW  |UCr!c8S[UR5-S-$)z Return a string representation of this rule. It has the form:: '> Note that this representation does not include the description string; that string can be accessed separately with the ``descr()`` method. :rtype: str zz)}{(?=rz\gNr,r`r_left_tag_pattern_right_tag_patternrdrrleft_tag_patternright_tag_patternrirFs rrMergeRule.__init__sq2 )*:;< )*;<=!1"3''78&'89     {EBr!cjS[UR5-S-[UR5-S-$)a Return a string representation of this rule. It has the form:: ', ''> Note that this representation does not include the description string; that string can be accessed separately with the ``descr()`` method. :rtype: str z }{Nrrs rrSplitRule.__init___sq0 )*:;< )*;<=!1"3''78&'89     }eDr!cjS[UR5-S-[UR5-S-$)z Return a string representation of this rule. It has the form:: ', '
'> Note that this representation does not include the description string; that string can be accessed separately with the ``descr()`` method. :rtype: str z rz{\g\gNrrs rrExpandLeftRule.__init__r2 )*:;< )*;<=!1"3''78&'89     /DeLr!cjS[UR5-S-[UR5-S-$)a  Return a string representation of this rule. It has the form:: ', ''> Note that this representation does not include the description string; that string can be accessed separately with the ``descr()`` method. :rtype: str zrz\g\g}Nrrs rrExpandRightRule.__init__rr!cjS[UR5-S-[UR5-S-$)a  Return a string representation of this rule. It has the form:: ', ''> Note that this representation does not include the description string; that string can be accessed separately with the ``descr()`` method. :rtype: str zz )(?Prz\g{\g}\gN) r,r`r_left_context_tag_pattern_chunk_tag_pattern_right_context_tag_patternrr]rdr)rleft_context_tag_patternchunk_tag_patternright_context_tag_patternrirF replacements rrChunkRuleWithContext.__init__6s8 )*BCD )*;<= )*CDE)A&"3*C'''?@&'89&'@A,,   6   {Br!cdSRURURUR5$)a Return a string representation of this rule. It has the form:: ', '', '
'> Note that this representation does not include the description string; that string can be accessed separately with the ``descr()`` method. :rtype: str z))formatrrrrLs rrMChunkRuleWithContext.__repr__es2;AA  * *  # #  + +  r!)rrrNrrbr!rrr&s -C^ r!rz^(({}|<{}>)*)$z"([^\{\}<>]|\{\d+,?\}|\{\d*,\d+\})+z [^\{\}<>]+cf[R"SSU5n[R"SSU5n[R"SSU5n[RU5(d[ SU-5eSnU"[ R 5nU"U5n[R"S X#5nU"U5nU$) a Convert a tag pattern to a regular expression pattern. A "tag pattern" is a modified version of a regular expression, designed for matching sequences of tags. The differences between regular expression patterns and tag patterns are: - In tag patterns, ``'<'`` and ``'>'`` act as parentheses; so ``'+'`` matches one or more repetitions of ``''``, not ``''``. - Whitespace in tag patterns is ignored. So ``'
| '`` is equivalent to ``'
|'`` - In tag patterns, ``'.'`` is equivalent to ``'[^{}<>]'``; so ``''`` matches any single tag starting with ``'NN'``. In particular, ``tag_pattern2re_pattern`` performs the following transformations on the given pattern: - Replace '.' with '[^<>{}]' - Remove any whitespace - Add extra parens around '<' and '>', to make '<' and '>' act like parentheses. E.g., so that in '+', the '+' has scope over the entire ''; and so that in '', the '|' has scope over 'NN' and 'IN', but not '<' or '>'. - Check to make sure the resulting pattern is valid. :type tag_pattern: str :param tag_pattern: The tag pattern to convert to a regular expression pattern. :raise ValueError: If ``tag_pattern`` is not a valid tag pattern. In particular, ``tag_pattern`` should not include braces; and it should not contain nested or mismatched angle-brackets. :rtype: str :return: A regular expression pattern corresponding to ``tag_pattern``. z\sr#r z(<(r z)>)zBad tag pattern: %rcZ[U5nUR5 SRU5$)Nr#)listreverser)rQlsts r reverse_str+tag_pattern2re_pattern..reverse_strs"3i wws|r!z\.(?!\\(\\\\)*($|[^\\])))r,r(CHUNK_TAG_PATTERNr&rrrZ)rrtc_revreverseds rrrsJ&&K0K&&uk2K&&uk2K  " "; / /.<== 33 4F;'Hvv16DHh'K r!cJ\rSrSrSrS SjrSrSrS SjrSr S r S r S r g)RegexpChunkParseria. A regular expression based chunk parser. ``RegexpChunkParser`` uses a sequence of "rules" to find chunks of a single type within a text. The chunking of the text is encoded using a ``ChunkString``, and each rule acts by modifying the chunking in the ``ChunkString``. The rules are all implemented using regular expression matching and substitution. The ``RegexpChunkRule`` class and its subclasses (``ChunkRule``, ``StripRule``, ``UnChunkRule``, ``MergeRule``, and ``SplitRule``) define the rules that are used by ``RegexpChunkParser``. Each rule defines an ``apply()`` method, which modifies the chunking encoded by a given ``ChunkString``. :type _rules: list(RegexpChunkRule) :ivar _rules: The list of rules that should be applied to a text. :type _trace: int :ivar _trace: The default level of tracing. c4XlX@lX lX0lg)a Construct a new ``RegexpChunkParser``. :type rules: list(RegexpChunkRule) :param rules: The sequence of rules that should be used to generate the chunking for a tagged text. :type chunk_label: str :param chunk_label: The node value that should be used for chunk subtrees. This is typically a short string describing the type of information contained by the chunk, such as ``"NP"`` for base noun phrases. :type root_label: str :param root_label: The node value that should be used for the top node of the chunk structure. :type trace: int :param trace: The level of tracing that should be used when parsing a text. ``0`` will generate no tracing output; ``1`` will generate normal tracing output; and ``2`` or higher will generate verbose tracing output. N)_rules_trace _chunk_labelr )rrulesr< root_labeltraces rrRegexpChunkParser.__init__s*  '%r!c0[S5 [U5 URHpnURU5 U(a-[SUR5S-[ U5-S-5 O[SUR5S-5 [U5 Mr g)af Apply each rule of this ``RegexpChunkParser`` to ``chunkstr``, in turn. Generate trace output between each rule. If ``verbose`` is true, then generate verbose output. :type chunkstr: ChunkString :param chunkstr: The chunk string to which each rule should be applied. :type verbose: bool :param verbose: Whether output should be verbose. :rtype: None z# Input:#z (z)::N)printrrmrirK)rrlverboserus r _trace_applyRegexpChunkParser._trace_applyso j hKKD JJx c4::<$.d;dBCc4::<#-. (O  r!cLURHnURU5 M g)z Apply each rule of this ``RegexpChunkParser`` to ``chunkstr``, in turn. :param chunkstr: The chunk string to which each rule should be applied. :type chunkstr: ChunkString :rtype: None N)rrm)rrlrus r_notrace_apply RegexpChunkParser._notrace_applysKKD JJx  r!Nc[U5S:Xa![S5 [UR/5$UR 5 Uc UR n[U5nU(aUS:nURX45 OURU5 URUR5$![ a [URU5nNf=f)a :type chunk_struct: Tree :param chunk_struct: the chunk structure to be (further) chunked :type trace: int :param trace: The level of tracing that should be used when parsing a text. ``0`` will generate no tracing output; ``1`` will generate normal tracing output; and ``2`` or higher will generate verbose tracing output. This value overrides the trace level value that was given to the constructor. :rtype: Tree :return: a chunk structure that encodes the chunks in a given tagged sentence. A chunk is a non-overlapping linguistic group, such as a noun phrase. The set of chunks identified in the chunk structure depends on the rules used to define this ``RegexpChunkParser``. rzWarning: parsing empty textr) r*rrr r AttributeErrorrrrrrBr)rrrrlrs rparseRegexpChunkParser.parses$ |  ! / 0(("- - @    =KKE|, aiG   h 0    )&&t'8'899# @ 0 0,?L @sB&& C C cUR$)z] :return: the sequence of rules used by ``RegexpChunkParser``. :rtype: list(RegexpChunkRule) )rrLs rrRegexpChunkParser.rulesHs {{r!c2S[UR5-$)zY :return: a concise string representation of this ``RegexpChunkParser``. :rtype: str z!)r*rrLs rrMRegexpChunkParser.__repr__Os 3S5EEEr!cNS[UR5-nSnURH&n[U[UR555nM( US:aS[ US-*5-S-nOSnURH#nXUR5[ U54-- nM% USS $) zU :return: a verbose string representation of this ``RegexpChunkParser``. :rtype: str z!RegexpChunkParser with %d rules: r#z %zs%s z %s %s Nr$)r*rmaxrirK)rr.marginrurs rrRRegexpChunkParser.__str__Ws 13t{{3C CKKDTZZ\!23F B;tfqjM22W} # chunk determiners and adjectives }<[\.VI].*>+{ # strip any tag beginning with V, I, or . <.*>}{
# split a chunk at a determiner {} # merge chunk ending with det/adj # with one starting with a noun The patterns of a clause are executed in order. An earlier pattern may introduce a chunk boundary that prevents a later pattern from executing. Sometimes an individual pattern will match on multiple, overlapping extents of the input. As with regular expression substitution more generally, the chunker will identify the first match possible, then continue looking for matches after this one has ended. The clauses of a grammar are also executed in order. A cascaded chunk parser is one having more than one clause. The maximum depth of a parse tree created by this chunk parser is the same as the number of clauses in the grammar. When tracing is turned on, the comment portion of a line is displayed each time the corresponding pattern is applied. :type _start: str :ivar _start: The start symbol of the grammar (the root node of resulting trees) :type _stages: int :ivar _stages: The list of parsing stages corresponding to the grammar c<X@l/UlXlX0l[ U[ 5(aUR XU5 gSn[U5nUH#n[ U[5(aM[U5e Xlg![an[U5UeSnAff=f)ag Create a new chunk parser, from the given start state and set of chunk patterns. :param grammar: The grammar, or a list of RegexpChunkParser objects :type grammar: str or list(RegexpChunkParser) :param root_label: The top node of the tree being created :type root_label: str or Nonterminal :param loop: The number of times to run through the patterns :type loop: int :type trace: int :param trace: The level of tracing that should be used when parsing a text. ``0`` will generate no tracing output; ``1`` will generate normal tracing output; and ``2`` or higher will generate verbose tracing output. z>Expected string or list of RegexpChunkParsers for the grammar.N) r_stages_grammar_looprrQ _read_grammarr BaseException TypeErrorr)rgrammarrlooprtype_errrelts rrRegexpParser.__init__s"    gs # #   wE :T  1w-!#'899#H--#L ! 1)q0 1s B B BBc/nSn[R"S5nURS5HnUR5nUR U5nU(aRUR XEX#5 UR S5R5n/nUR S5R5nUS:XdURS5(aMUR[RU55 M UR XEX#5 g)zC Helper function for __init__: read the grammar if it is a string. Nz*(?P(\.|[^:])*)(:(?P.*)) nonterminalrur#r) regexr`r-rzr& _add_stagery startswithr;rdr) rr rrrlhsrrliners rrRegexpParser._read_grammars -- MNMM$'D::ggm,224wwv,,.rzT__S11 LL33D9 :%(* J6r!cU/:wa8U(d [S5e[XX4S9nURRU5 gg)z> Helper function for __init__: add a new stage to the parser. zExpected stage marker (eg NP:))r<rrN)rrrr;)rrrrrparsers rrRegexpParser._add_stagesB B; !ABB&:F LL   ' r!NcUc URn[UR5H%nURHnUR XS9nM M' U$)a+ Apply the chunk parser to this input. :type chunk_struct: Tree :param chunk_struct: the chunk structure to be (further) chunked (this tree is modified, and is also returned) :type trace: int :param trace: The level of tracing that should be used when parsing a text. ``0`` will generate no tracing output; ``1`` will generate normal tracing output; and ``2`` or higher will generate verbose tracing output. This value overrides the trace level value that was given to the constructor. :return: the chunked output. :rtype: Tree r)rr)rrr)rrrr1rs rrRegexpParser.parsesK" =KKEtzz"A,,%||L|F '#r!c2S[UR5-$)zV :return: a concise string representation of this ``chunk.RegexpParser``. :rtype: str z#r*rrLs rrMRegexpParser.__repr__s 5s4<<7HHHr!cvS[UR5-nSnURH nUSU-- nM USS$)zT :return: a verbose string representation of this ``RegexpParser``. :rtype: str z#chunk.RegexpParser with %d stages: rz%s Nr$r)rr.rrs rrRRegexpParser.__str__sC 3S5F FllF & A#"v r!)rrrr)rrrr) rUrVrWrXrYrrrrrMrRrarbr!rrrns('R$#L7> (0I r!rc SSKJn SSKJn UR 5nUR S5Hzn[ U5 UR5nU(dM'URU5nUR5nURU"SU5SS9nURXh5 [ 5 M| [ S5 [ S U5 [ S 5 [ S UR5S --S SS9 [ SUR5S --SSS9 [ SUR5S --5 UR5(ax[ S5 UR5n U SSH,n[ SSR![#[$U555 M. ['UR55S:a [ S5 UR)5(ax[ S5 UR)5n U SSH,n[ SSR![#[$U555 M. ['UR)55S:a [ S5 [ S5 [ 5 g)a Demonstration code for evaluating a chunk parser, using a ``ChunkScore``. This function assumes that ``text`` contains one sentence per line, and that each sentence has the form expected by ``tree.chunk``. It runs the given chunk parser on each sentence in the text, and scores the result. It prints the final score (precision, recall, and f-measure); and reports the set of chunks that were missed and the set of chunks that were incorrect. (At most 10 missing chunks and 10 incorrect chunks are reported). :param chunkparser: The chunkparser to be tested :type chunkparser: ChunkParserI :param text: The chunked tagged text that should be used for evaluation. :type text: str r)rrrrrrzM/===========================================================================\ScoringzM-----------------------------------------------------------------------------zPrecision: %5.1f%%dz rP)endzRecall: %5.1f%%z zF-Measure: %5.1f%%zMissed:N z z ...z Incorrect:zM\===========================================================================/)nltkr nltk.treer ChunkScorer-rrz tagstr2treeleavesrscore precisionrecall f_measuremissedrmaprQr* incorrect) chunkparsertextrr chunkscoresentencegoldtokenstestr1r3s r demo_evalr;s"!!#JJJt$ h>>#   *  c6!2! <$ % !" )[! (O *"6"6"83"> ?cR z002S8 97L *"6"6"83"> ?@ i""$CR[E $S%1 2! z  " #b ( 'N l((* s^E $S%1 2$ z##% & + 'N !" Gr!c LSSKJnJn Sn[S5 [S5 [U5 [S5 [5 SnUR U5n[ XB5 SnUR U5n[ XB5 SnUR U5n[ XB5 S nUR U5n[ XB5 SS KJn [5 [S 5 UR S 5n[URXERS SS955 [5 [S5 SnUR U5n[URXERS 5SS55 [5 [S5 S nUR U5n[UR/SQ55 g)z A demonstration for the ``RegexpChunkParser`` class. A single text is parsed with four different chunk parsers, using a variety of rules and strategies. r)rrz [ the/DT little/JJ cat/NN ] sat/VBD on/IN [ the/DT mat/NN ] ./. [ John/NNP ] saw/VBD [the/DT cats/NNS] [the/DT dog/NN] chased/VBD ./. [ John/NNP ] thinks/VBZ [ Mary/NN ] saw/VBD [ the/DT cat/NN ] sit/VB on/IN [ the/DT mat/NN ]./. zK***************************************************************************zEvaluation text:z NP: # NP stage {
?*} # chunk determiners, adjectives and nouns {+} # chunk proper nouns z NP: {<.*>} # start by chunking each tag }<[\.VI].*>+{ # unchunk any verbs, prepositions or periods {} # merge det/adj with nouns zy NP: {
?*} # chunk determiners, adjectives and nouns VP: {?} # VP = verb words a6 NP: {<.*>*} # start by chunking everything }<[\.VI].*>+{ # strip any verbs, prepositions or periods <.*>}{
# separate on determiners PP: {} # PP = preposition + noun phrase VP: {*} # VP = verb words + NPs and PPs ) conll2000zDemonstration of empty grammar:r#ztest.txt)r) chunk_typesz6Demonstration of accuracy evaluation using CoNLL tags:Nz#Demonstration of tagged token input)theDT)littleJJ)catNN)satVBD)onINr@)matrF).rL) r(rrrrr; nltk.corpusr=accuracy chunked_sentsr)rrr5r cpr=s rdemorQYs! D  (O  $K (O GG   G $B bG   G $B bG   G $B bG   G $B b& G +,   B B %..44ZW4U VW G BCG   G $B %..44Z@!D EF G /0G   G $B     r!__main__)r,rnltk.chunk.apirr)rrrdr{r|rr~r}rrrr`rrrrrr;rQrUrbr!rrTs 'ddXJHJHZ):):X*:*:Z%