Edit File: streaming_iterator.cpython-36.pyc
3 �P\� � @ sD d Z ddlmZ ddlmZmZ G dd� de�ZG dd� de�Zd S ) a requests_toolbelt.streaming_iterator ==================================== This holds the implementation details for the :class:`StreamingIterator`. It is designed for the case where you, the user, know the size of the upload but need to provide the data as an iterator. This class will allow you to specify the size and stream the data without using a chunked transfer-encoding. � )� super_len� )� CustomBytesIO� encode_withc @ s$ e Zd ZdZd dd�Zd dd�ZdS ) �StreamingIteratora This class provides a way of allowing iterators with a known size to be streamed instead of chunked. In requests, if you pass in an iterator it assumes you want to use chunked transfer-encoding to upload the data, which not all servers support well. Additionally, you may want to set the content-length yourself to avoid this but that will not work. The only way to preempt requests using a chunked transfer-encoding and forcing it to stream the uploads is to mimic a very specific interace. Instead of having to know these details you can instead just use this class. You simply provide the size and iterator and pass the instance of StreamingIterator to requests via the data parameter like so: .. code-block:: python from requests_toolbelt import StreamingIterator import requests # Let iterator be some generator that you already have and size be # the size of the data produced by the iterator r = requests.post(url, data=StreamingIterator(size, iterator)) You can also pass file-like objects to :py:class:`StreamingIterator` in case requests can't determize the filesize itself. This is the case with streaming file objects like ``stdin`` or any sockets. Wrapping e.g. files that are on disk with ``StreamingIterator`` is unnecessary, because requests can determine the filesize itself. Naturally, you should also set the `Content-Type` of your upload appropriately because the toolbelt will not attempt to guess that for you. �utf-8c C sR t |�| _| jdk r td��| j| _|| _|| _t|d�rB|| _n t||�| _d S )Nr z1The size of the upload must be a positive integer�read) �int�size� ValueError�len�encoding�iterator�hasattr�_file�_IteratorAsBinaryFile)�selfr r r � r �(/usr/lib/python3.6/streaming_iterator.py�__init__7 s zStreamingIterator.__init__r c C s t | jj|�| j�S )N)r r r r )r r r r r r O s zStreamingIterator.readN)r ���)r )�__name__� __module__� __qualname__�__doc__r r r r r r r s # r c @ s0 e Zd Zd dd�Zdd� Zdd� Zdd d �Zd S )r �utf-8c C s || _ || _t� | _d S )N)r r r �_buffer)r r r r r r r T s z _IteratorAsBinaryFile.__init__c C s, yt t| j�| j�S tk r& dS X d S )N� )r �nextr r � StopIteration)r r r r � _get_bytes_ s z _IteratorAsBinaryFile._get_bytesc C sJ | j j� |t| j � }d}x(|dkrD|rD| j� }|| j j|�8 }q W d S )NTr )r Zsmart_truncater r �append)r r Zamount_to_loadZbytes_to_appendr r r � _load_bytese s z!_IteratorAsBinaryFile._load_bytesr c C s2 t |�}|dkr dj| j�S | j|� | jj|�S )Nr r r )r �joinr r" r r )r r r r r r n s z_IteratorAsBinaryFile.readN)r r )r )r r r r r r" r r r r r r S s r N) r Zrequests.utilsr Zmultipart.encoderr r �objectr r r r r r �<module> s A
Back to File Manager