Edit File: eucjpprober.cpython-36.pyc
3 �Pf� � @ s` d dl mZmZ d dlmZ d dlmZ d dlmZ d dl m Z d dl m Z G dd� de�Z d S ) � )� ProbingState� MachineState)�MultiByteCharSetProber)�CodingStateMachine)�EUCJPDistributionAnalysis)�EUCJPContextAnalysis)�EUCJP_SM_MODELc sP e Zd Z� fdd�Z� fdd�Zedd� �Zedd� �Zd d � Zd d � Z � Z S ) � EUCJPProberc s4 t t| �j� tt�| _t� | _t� | _ | j � d S )N) �superr �__init__r r � coding_smr �distribution_analyzerr �context_analyzer�reset)�self)� __class__� �!/usr/lib/python3.6/eucjpprober.pyr % s zEUCJPProber.__init__c s t t| �j� | jj� d S )N)r r r r )r )r r r r , s zEUCJPProber.resetc C s dS )NzEUC-JPr )r r r r � charset_name0 s zEUCJPProber.charset_namec C s dS )NZJapaneser )r r r r �language4 s zEUCJPProber.languagec C s6 x�t t|��D ]�}| jj|| �}|tjkrN| jjd| j| j |� t j | _ P q|tj krdt j| _ P q|tjkr| jj� }|dkr�|d | jd< | jj| j|� | jj| j|� q| jj||d |d � |� | jj||d |d � |� qW |d | jd< | jt jk�r0| jj� �r0| j� | jk�r0t j| _ | jS )Nz!%s %s prober hit error at byte %s� r ���)�range�lenr Z next_stater ZERRORZlogger�debugr r r ZNOT_MEZ_stateZITS_MEZFOUND_ITZSTARTZget_current_charlenZ _last_charr �feedr �stateZ DETECTINGZgot_enough_data�get_confidenceZSHORTCUT_THRESHOLD)r Zbyte_str�iZ coding_stateZchar_lenr r r r 8 s4 zEUCJPProber.feedc C s | j j� }| jj� }t||�S )N)r r r �max)r Z context_confZ distrib_confr r r r Y s zEUCJPProber.get_confidence) �__name__� __module__� __qualname__r r �propertyr r r r � __classcell__r r )r r r $ s !r N)Zenumsr r Zmbcharsetproberr Zcodingstatemachiner Zchardistributionr Zjpcntxr Zmbcssmr r r r r r �<module> s
Back to File Manager