Edit File: utf8prober.cpython-36.pyc
3 �Pf� � @ sH d dl mZ d dlmZmZ d dlmZ d dlmZ G dd� de�Z dS )� )� CharSetProber)� ProbingState� MachineState)�CodingStateMachine)� UTF8_SM_MODELc sT e Zd ZdZ� fdd�Z� fdd�Zedd� �Zedd � �Zd d � Z d d � Z � Z S )� UTF8Proberg �?c s* t t| �j� tt�| _d | _| j� d S )N)�superr �__init__r r � coding_sm� _num_mb_chars�reset)�self)� __class__� � /usr/lib/python3.6/utf8prober.pyr & s zUTF8Prober.__init__c s" t t| �j� | jj� d| _d S )N� )r r r r r )r )r r r r , s zUTF8Prober.resetc C s dS )Nzutf-8r )r r r r � charset_name1 s zUTF8Prober.charset_namec C s dS )N� r )r r r r �language5 s zUTF8Prober.languagec C s� xj|D ]b}| j j|�}|tjkr,tj| _P q|tjkrBtj| _P q|tj kr| j j � dkr| j d7 _ qW | j tj kr�| j� | jkr�tj| _| j S )N� r )r Z next_stater ZERRORr ZNOT_MEZ_stateZITS_MEZFOUND_ITZSTARTZget_current_charlenr �stateZ DETECTING�get_confidenceZSHORTCUT_THRESHOLD)r Zbyte_str�cZ coding_stater r r �feed9 s zUTF8Prober.feedc C s. d}| j dk r&|| j| j 9 }d| S |S d S )Ng�G�z��?� g �?)r � ONE_CHAR_PROB)r Zunliker r r r L s zUTF8Prober.get_confidence) �__name__� __module__� __qualname__r r r �propertyr r r r � __classcell__r r )r r r # s r N) Z charsetproberr Zenumsr r Zcodingstatemachiner Zmbcssmr r r r r r �<module> s
Back to File Manager