iddlmZddlZddlZddlZddlmZddlmZddl m Z ddl m Z m Z mZejeZdZd Zd Zd Zd Zd ZdZdZddZddZdZdZdZdZddZ ddZ!ddZ"y))CounterN)registry) get_setting) autodiscover)LanguageCodeErrorLanguageDetectionErrorLanguagePackNotFoundztransliterate.utilszArtur Barseghyanz2013-2018 Artur BarseghyanzGPL 2.0/LGPL 2.1)detect_languageget_available_language_codesget_available_language_packsget_translit_functionslugifysuggesttranslitc|S)zFake translation wrapper.)vals o/home/developers/rajanand/mypropertyqr-fmb-refixing-v2/venv/lib/python3.12/site-packages/transliterate/utils.py_r s Jc:tjs tyy)zEnsure autodiscover.N)rrrrrensure_autodiscoverr%s    rcttj|}|tt d|z|}|j S)zjReturn translit function for the language given. :param str language_code: :return callable: 'Language pack for code %s is not found.)rrgetr rr) language_codecls language_packs rrr,sM  ,,} %C {" 7-G H  EM  ! !!rct||durttd| t|d}t j |}|t td|z|}|j|||S)aTransliterate the text for the language given. Language code is optional in case of reversed translations (from some script to latin). :param str value: :param str language_code: :param bool reversed: If set to True, reversed translation is made. :param bool strict: If given, all that are not found in the transliteration pack, are simply stripped out. :return str: FA``language_code`` is optional with ``reversed`` set to True only.) fail_silentlyr)reversedstrict)rrrr rrr r)valuerr#r$rrs rrr>sU!2    'UC ,,} %C {" 7-G H  EM  ! !%(6 ! JJrct||durttdtj|}|t td|z|}|j |||S)zSuggest possible variants. :param str value: :param str language_code: :param bool reversed: If set to True, reversed translation is made. :param int limit: Limit number of suggested variants. :return list: Fr!r)r#limit)rrrrrr r)r%rr#r'rrs rrrasU!2    ,,} %C {" 7-G H  EM   GGrcttjjDcgc]\}}| c}}Scc}}w)zQGet list of language codes for registered language packs. :return list: rritemskeyrs rr r ~1 "*"3"3"9"9"; Get list of registered language packs. :return list: r)r+s rr r r-r.cVttjj|dS)zGet registered language pack by language code given. :param str language_code: :return transliterate.base.TranslitLanguagePack: Returns None on failure. N)rrr)rs rget_language_packr1s#      55rc:djtd|S)zStrip numbers from text.c$|j SN)isdigit)us rzstrip_numbers..s Or)joinfilter)texts r strip_numbersr<s 7763T: ;;rc| td}t|}t}|jdD]}t |dkDs||xxdz cc< |j |S)zeExtract most common words. :param unicode text: :param int num_words: :return list: #LANGUAGE_DETECTION_MAX_NUM_KEYWORDS r)rr<rsplitlen most_common)r; num_wordscounterwords rextract_most_common_wordsrFsi EF  DiG 3 t9q= DMQ M   y ))rct| td}t||}t}t }|D]I\}}|D]?} |D]8} | j s| j | s"|| jxxdz cc<:AK |jdddS#t$r3} tdrtjt| Yd} ~ nd} ~ wwxYw|sttd|zy)a\Detect the language from the value given. Detect the language from the value given based on ranges defined in active language packs. :param unicode value: Input string. :param int num_words: Number of words to base decision on. :param bool fail_silently: :param bool heavy_check: If given, heavy checks would be applied when simple checks don't give any results. Heavy checks are language specific and do not apply to a common logic. Heavy language detection is defined in the ``detect`` method of each language pack. :return str: Language code. Nr>)rCrrDEBUGz.Can't detect language for the text "%s" given.)rrrFrr detectablecontainsrrB ExceptionLOGGERdebugstrr r) r;rCr" heavy_checkmost_common_wordsrDavailable_language_packsrE occurrencesletterrerrs rr r s  EF 1$)LiG;=.k F!9   ++ 0F0Fv0NM778A=8   #""1%a(++ # w  LLS "# $ B Cd J   sB C()CCc<|s t|}|rt||d}tjd|j ddj d}t jdd|jj}t jdd |Sy ) zSlugify the given text. If no ``language_code`` is given, auto-detect the language code from text given. :param str text: :param str language_code: :return str: T)r#NFKDasciiignorez[^\w\s-]r3z[-\s]+-N) r r unicodedata normalizeencodedecoderesubstriplower)r;rtransliterated_textslugs rrrs '- &t]TJ$$V-@A!6'84!6'? vvk2t,224::<vvid++ r)NFF)NFNr5)NTF)# collectionsrloggingr^rZbaserconfrdiscoverr exceptionsrr r getLogger__name__rL __title__ __author__ __copyright__ __license____all__rrrrrr r r1r<rFr rrrrrqs "   8 $ !  ,    "$ KFH:==6< *$9= %* Z,r