o rZŽh5%ã@sdZddlZddlmZddlmZmZmZmZddl m Z ddl m Z e  d¡Ze  d¡Ze  d ¡Ze  d ej¡Ze  d ej¡Ze  d ej¡Ze  d ¡ZGdd„dƒZGdd„dƒZdd„Zdd„Zdd„Zdd„Zdd„Zd%dd„Zd&dd „Ze d!ƒd"d#„ƒZed$ƒZ dS)'z CCG Lexicons éN)Ú defaultdict)ÚCCGVarÚ DirectionÚFunctionalCategoryÚPrimitiveCategory)Ú deprecated)Ú Expressionz([A-Za-z]+)(\[[A-Za-z,]+\])?z"([A-Za-z]+(?:\[[A-Za-z,]+\])?)(.*)z([\\/])([.,]?)([.,]?)(.*)z([\S_]+)\s*(::|[-=]+>)\s*(.+)z([^{}]*[^ {}])\s*(\{[^}]+\})?z \{([^}]+)\}z([^#]*)(?:#.*)?c@s:eZdZdZd dd„Zdd„Zdd„Zd d „Zd d „ZdS)ÚTokenzÄ Class representing a token. token => category {semantics} e.g. eat => S\var[pl]/var {\x y.eat(x,y)} * `token` (string) * `categ` (string) * `semantics` (Expression) NcCs||_||_||_dS©N)Ú_tokenÚ_categÚ _semantics)ÚselfÚtokenÚcategÚ semantics©rú?/var/www/auris/lib/python3.10/site-packages/nltk/ccg/lexicon.pyÚ__init__9s zToken.__init__cCó|jSr )r ©rrrrr>óz Token.categcCrr )r rrrrrArzToken.semanticscCs2d}|jdurdt|jƒd}dt|jƒ|S)NÚz {Ú})r Ústrr )rÚ semantics_strrrrÚ__str__Ds z Token.__str__cCs*t|tƒsdSt|j|jf| ¡| ¡ƒS)Néÿÿÿÿ)Ú isinstancer Úcmpr r rr)rÚotherrrrÚ__cmp__Js z Token.__cmp__r ) Ú__name__Ú __module__Ú __qualname__Ú__doc__rrrrr!rrrrr -s  r c@s0eZdZdZdd„Zdd„Zdd„Zdd „Zd S) Ú CCGLexiconzâ Class representing a lexicon for CCG grammars. * `primitives`: The list of primitive categories for the lexicon * `families`: Families of categories * `entries`: A mapping of words to possible categories cCs t|ƒ|_||_||_||_dSr )rÚ_startZ _primitivesZ _familiesÚ_entries)rÚstartÚ primitivesÚfamiliesÚentriesrrrrYs  zCCGLexicon.__init__cCs |j|S)z@ Returns all the possible categories for a word )r()rÚwordrrrÚ categories_s zCCGLexicon.categoriescCr)z; Return the target category for the parser )r'rrrrr)eszCCGLexicon.startcCsfd}d}t|jƒD]'}|s|d}||d}d}|j|D]}|s'|d}nd}|d|}qq |S)zK String representation of the lexicon. Used for debugging. rTÚ z => z | Fz%s)Úsortedr()rÚstringÚfirstÚidentÚcatrrrrks  ûzCCGLexicon.__str__N)r"r#r$r%rr.r)rrrrrr&Ps  r&cCsš|dd…}d}|dkr6| d¡s6| d¡r!t|ƒ\}}||}n ||d}|dd…}|dkr6| d¡r| d¡rE|d|dd…fStd|dƒ‚) zb Separate the contents matching the first set of brackets from the rest of the input. éNú(rú)rzUnmatched bracket in string 'ú')Ú startswithÚ matchBracketsÚAssertionError)r1ÚrestZinsideÚpartrrrr:…s      ú r:cCs | d¡r t|ƒSt |¡ ¡S)zb Separate the string for the next portion of the category from the rest of the string r6)r9r:Ú NEXTPRIM_REÚmatchÚgroups)r1rrrÚ nextCategory™s rAcCst|d|dd…ƒS)z' Parse an application operator rr5N)r)ÚapprrrÚparseApplication£srCcCs|r |dd… d¡SgS)z7 Parse the subscripts for a primitive category r5rú,)Úsplit)ZsubscrrrrÚparseSubscriptsªsrFcCs¨|ddkr|ddur|durtƒ}||fS|d}||vr;||\}}|dur/|}||fS| ||fg¡}||fS||vrLt|dƒ}t||ƒ|fStd|dƒ‚)zƒ Parse a primitive category If the primitive is the special category 'var', replace it with the correct `CCGVar`. rÚvarr5NzString 'z-' is neither a family nor primitive category.)rÚ substituterFrr;)Úchunksr*r+rGÚcatstrr4ZcvarZsubscrsrrrÚparsePrimitiveCategory³s&   ÿ  ÿrKc Csæt|ƒ\}}| d¡rt|dd…|||ƒ\}}ntt |¡ ¡|||ƒ\}}|dkrot |¡ ¡}t|dd…ƒ}|d}t|ƒ\}}| d¡rWt|dd…|||ƒ\} }ntt |¡ ¡|||ƒ\} }t || |ƒ}|dks+||fS)z{ Parse a string representing a category, and returns a tuple with (possibly) the CCG variable for the category r6r5rrré) rAr9ÚaugParseCategoryrKÚPRIM_REr?r@ÚAPP_RErCr) Úliner*r+rGZ cat_stringr<ÚresrBÚ directionÚargrrrrMÑs&  ÿ  ÿ ôrMFcCs"t ¡g}i}ttƒ}| ¡D]w}t |¡ ¡d ¡}|dkr"q|  d¡r:|dd„|dd… ¡  d¡Dƒ}qt  |¡ ¡\}}}t  |¡ ¡\} } t | ||ƒ\} } |d kr`| | f||<qd} |d ur|| durpt|d ƒ‚t t | ¡ ¡d¡} || t|| | ƒ¡qt|d|||ƒS) z@ Convert string representation into a lexicon for CCGs. rrz:-cSsg|]}| ¡‘qSr)Ústrip)Ú.0ZprimrrrÚ sÿzfromstring..éNrDz::Tz@ must contain semantics because include_semantics is set to True)rZreset_idrÚlistÚ splitlinesÚ COMMENTS_REr?r@rTr9rEÚLEX_REÚRHS_RErMr;rÚ fromstringÚ SEMANTICS_REÚappendr r&)Úlex_strZinclude_semanticsr*r+r,rPr3ÚsepÚrhsrJrr4rGrrrrr]ñs<   ÿÿÿÿr]zUse fromstring() instead.cCst|ƒSr )r])r`rrrÚ parseLexicon"srca¡ # Rather minimal lexicon based on the openccg `tinytiny' grammar. # Only incorporates a subset of the morphological subcategories, however. :- S,NP,N # Primitive categories Det :: NP/N # Determiners Pro :: NP IntransVsg :: S\NP[sg] # Tensed intransitive verbs (singular) IntransVpl :: S\NP[pl] # Plural TransVsg :: S\NP[sg]/NP # Tensed transitive verbs (singular) TransVpl :: S\NP[pl]/NP # Plural the => NP[sg]/N[sg] the => NP[pl]/N[pl] I => Pro me => Pro we => Pro us => Pro book => N[sg] books => N[pl] peach => N[sg] peaches => N[pl] policeman => N[sg] policemen => N[pl] boy => N[sg] boys => N[pl] sleep => IntransVsg sleep => IntransVpl eat => IntransVpl eat => TransVpl eats => IntransVsg eats => TransVsg see => TransVpl sees => TransVsg r )F)!r%ÚreÚ collectionsrZ nltk.ccg.apirrrrZnltk.internalsrZnltk.sem.logicrÚcompilerNr>rOÚUNICODEr[r\r^rZr r&r:rArCrFrKrMr]rcZopenccg_tinytinyrrrrÚs6       #5   1 ÿ