o ŽZŽhIã@sŠddlmZejZejZejZejZejZejZejZej Z ej Z ej Z ej Z ej Z ejZejZejZeeeedœZdedefdd„ZdS)é)Ú normalizers)ZnfcÚnfdZnfkcZnfkdÚ normalizerÚreturncCs&|tvrtd |t ¡¡ƒ‚t|ƒS)Nz6{} is not a known unicode normalizer. Available are {})Ú NORMALIZERSÚ ValueErrorÚformatÚkeys)r©r úN/var/www/auris/lib/python3.10/site-packages/tokenizers/normalizers/__init__.pyÚunicode_normalizer_from_strs ÿ r N)ÚrZ NormalizerZBertNormalizerZNFDZNFKDÚNFCÚNFKCÚSequenceZ LowercaseZPrependZStripZ StripAccentsZNmtZ PrecompiledZReplaceZ ByteLevelrÚstrr r r r r Ús$