D7net
Home
Console
Upload
information
Create File
Create Folder
About
Tools
:
/
lib
/
python3.9
/
site-packages
/
urllib3
/
contrib
/
__pycache__
/
Filename :
securetransport.cpython-39.pyc
back
Copy
a t~�`q� � @ s� d Z ddlmZ ddlZddlZddlZddlZddlZddl Z ddl Z ddl Z ddl Z ddl Z ddlZddlmZ ddlmZ ddlmZmZmZ dd lmZmZmZmZm Z m Z zdd l m Z W n" e y� dZ dd l m!Z! Y n0 d d gZ"dZ#ej#Z$ej%j&Z'e �(� Z)e �*� Z+dZ,ej-ej.ej/ej0ej1ej2ej3ej4ej5ej6ej7ej8ej9ej:ej;ej<ej=ej>ej?ej@ejAejBejCejDejEejFejGejHejIejJg ZKejLejMejNfeejMejNfiZOePe d��r�ejQejQfeOe jR< ePe d��r�ejSejSfeOe jT< ePe d��r ejMejMfeOe jU< ePe d��r(ejVejVfeOe jW< ePe d��rFejNejNfeOe jX< dd � ZYdd � ZZdd� Z[dd� Z\e�]e[�Z^e�_e\�Z`G dd � d ea�Zbe �r�d$d d �Zcn d%d!d �Zceceb_cG d"d#� d#ea�ZddS )&a� SecureTranport support for urllib3 via ctypes. This makes platform-native TLS available to urllib3 users on macOS without the use of a compiler. This is an important feature because the Python Package Index is moving to become a TLSv1.2-or-higher server, and the default OpenSSL that ships with macOS is not capable of doing TLSv1.2. The only way to resolve this is to give macOS users an alternative solution to the problem, and that solution is to use SecureTransport. We use ctypes here because this solution must not require a compiler. That's because pip is not allowed to require a compiler either. This is not intended to be a seriously long-term solution to this problem. The hope is that PEP 543 will eventually solve this issue for us, at which point we can retire this contrib module. But in the short term, we need to solve the impending tire fire that is Python on Mac without this kind of contrib module. So...here we are. To use this module, simply import and inject it:: import urllib3.contrib.securetransport urllib3.contrib.securetransport.inject_into_urllib3() Happy TLSing! This code is a bastardised version of the code found in Will Bond's oscrypto library. An enormous debt is owed to him for blazing this trail for us. For that reason, this code should be considered to be covered both by urllib3's license and by oscrypto's: .. code-block:: Copyright (c) 2015-2016 Will Bond <will@wbond.net> Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the "Software"), to deal in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions: The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software. THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE. � )�absolute_importN� )�util)�PROTOCOL_TLS_CLIENT� )�CoreFoundation�Security� SecurityConst)�_assert_no_error�_build_tls_unknown_ca_alert�_cert_array_from_pem�_create_cfstring_array�_load_client_cert_chain�_temporary_keychain)� _fileobject��backport_makefile�inject_into_urllib3�extract_from_urllib3Ti @ �PROTOCOL_SSLv2�PROTOCOL_SSLv3�PROTOCOL_TLSv1�PROTOCOL_TLSv1_1�PROTOCOL_TLSv1_2c C s. t t_t tj_tt_ttj_dt_dtj_dS )zG Monkey-patch urllib3 with SecureTransport-backed SSL-support. TN)�SecureTransportContextr � SSLContext�ssl_�HAS_SNI�IS_SECURETRANSPORT� r r �C/usr/lib/python3.9/site-packages/urllib3/contrib/securetransport.pyr � s c C s. t t_t tj_tt_ttj_dt_dtj_dS )z> Undo monkey-patching by :func:`inject_into_urllib3`. FN)�orig_util_SSLContextr r r �orig_util_HAS_SNIr r r r r r r � s c C s� d}�zPt �| �}|du r"tjW S |j}|d }|�� }d}d}z|||k r�|du sZ|dkrtt�||�stt�t j d��|| } t j | � || �} |�| | �} || 7 }| sB|s�tjW W S q�qBW nz tj�y6 } z^| j }|du�r"|t j k�r"||d< |t jk�s |t jk�r tjW Y d} ~ W S � W Y d} ~ n d} ~ 0 0 ||d< ||k�rRtjW S W dS t�y� } z"|du�rx| |_tjW Y d} ~ S d} ~ 0 0 dS )zs SecureTransport read callback. This is called by ST to request that data be returned from the socket. Nr � timed out)�_connection_refs�getr �errSSLInternal�socket� gettimeoutr Z wait_for_read�error�errno�EAGAIN�ctypes�c_charZ from_address� recv_into�errSSLClosedGraceful� ECONNRESET�EPIPE�errSSLClosedAbort�errSSLWouldBlock� Exception� _exception) � connection_id� data_buffer�data_length_pointer�wrapped_socket� base_socketZrequested_length�timeoutr) Z read_countZ remaining�bufferZ chunk_size�er r r �_read_callback� sP � r> c C s| d}�z4t �| �}|du r"tjW S |j}|d }t�||�}|�� }d}d} zV| |k r�|du sf|dkr�t� ||�s�t� t j d��|� |�} | | 7 } || d� }qNW nx tj �y } z\| j }|du�r|t j k�r| |d< |t jks�|t jk�rtjW Y d} ~ W S � W Y d} ~ n d} ~ 0 0 | |d< | |k�r6tjW S W dS t�yv } z"|du�r\| |_tjW Y d} ~ S d} ~ 0 0 dS )zx SecureTransport write callback. This is called by ST to request that data actually be sent on the network. Nr r# )r$ r% r r& r' r, � string_atr( r Zwait_for_writer) r* r+ �sendr0 r1 r2 r3 r4 r5 ) r6 r7 r8 r9 r: Zbytes_to_write�datar; r) �sentZ chunk_sentr= r r r �_write_callback sD rC c @ s� e Zd ZdZdd� Zejdd� �Zdd� Zdd � Z d d � Z d d � Z dd� Z dd� Z dd� Zdd� Zd.dd�Zdd� Zdd � Zd d � Zd d � Zd!d"� Zd#d$� Zd/d&d'�Zd(d)� Zd*d+� Zd,d-� ZdS )0� WrappedSocketz� API-compatibility wrapper for Python's OpenSSL wrapped socket object. Note: _makefile_refs, _drop(), and _reuse() are needed for the garbage collector of PyPy. c C sL || _ d | _d| _d| _d | _d | _d | _d | _| j �� | _ | j � d� d S �Nr F) r' �context�_makefile_refs�_closedr5 � _keychain� _keychain_dir�_client_cert_chainr( �_timeout� settimeout)�selfr' r r r �__init__N s zWrappedSocket.__init__c c s4 d| _ dV | j dur0| j d }| _ | �� |�dS )a] A context manager that can be used to wrap calls that do I/O from SecureTransport. If any of the I/O callbacks hit an exception, this context manager will correctly propagate the exception after the fact. This avoids silently swallowing those exceptions. It also correctly forces the socket closed. N)r5 �close)rN � exceptionr r r �_raise_on_error` s z WrappedSocket._raise_on_errorc C s2 t jtt� t� }t �| j|tt��}t|� dS )a4 Sets up the allowed ciphers. By default this matches the set in util.ssl_.DEFAULT_CIPHERS, at least as supported by macOS. This is done custom and doesn't allow changing at this time, mostly because parsing OpenSSL cipher strings is going to be a freaking nightmare. N)r ZSSLCipherSuite�len� CIPHER_SUITESZSSLSetEnabledCiphersrF r )rN �ciphers�resultr r r � _set_ciphersu s �zWrappedSocket._set_ciphersc C sF |sdS t |�}z$t�| j|�}t|� W t�|� n t�|� 0 dS )z< Sets up the ALPN protocols on the context. N)r r �SSLSetALPNProtocolsrF r r � CFRelease)rN � protocolsZ protocols_arrrV r r r �_set_alpn_protocols� s z!WrappedSocket._set_alpn_protocolsc C s� |sdS t jt jf}z&| �|�}||v r.W dS d|f }W n. tyh } zd|f }W Y d}~n d}~0 0 t| �� �}| j�|� t � ddd�}| j� tj tj |� | �� t�d| ��dS )z� Called when we have set custom validation. We do this in two cases: first, when cert validation is entirely disabled; and second, when using a custom trust DB. Raises an SSLError if the connection is not trusted. Nzerror code: %dz exception: %r�iir r z certificate verify failed, %s)r ZkSecTrustResultUnspecifiedZkSecTrustResultProceed�_evaluate_trustr4 r �versionr' �sendall�struct�packZ setsockoptZ SOL_SOCKETZ SO_LINGERrP �ssl�SSLError) rN �verify� trust_bundleZ successes� trust_result�reasonr= ZrecZoptsr r r �_custom_validate� s$ � z WrappedSocket._custom_validatec C s t j�|�r>t|d��}|�� }W d � n1 s40 Y d }t�� }z�t|�}t�| j t � |��}t |� |s~t �d��t�||�}t |� t�|d�}t |� t�� }t�|t � |��}t |� W |r�t�|� |d ur�t�|� n$|r�t�|� |d u�rt�|� 0 |jS )N�rbz Failed to copy trust referenceT)�os�path�isfile�open�readr � SecTrustRefr �SSLCopyPeerTrustrF r, �byrefr rb rc Z SecTrustSetAnchorCertificatesZ!SecTrustSetAnchorCertificatesOnlyZSecTrustResultTypeZSecTrustEvaluater rY �value)rN re �fZ cert_array�trustrV rf r r r r] � s6 & � z WrappedSocket._evaluate_trustc C s t �dtjtj�| _t �| jtt�} t | � t �: t | �d } | t v rT| d d } q>| t | < W d � n1 sp0 Y t � | j| �} t | � |r�t|t�s�|�d�}t �| j|t|��} t | � | �� | �| � t �| j|�} t | � t �| j|�} t | � |�r|du�r,t �| jtjd�} t | � |�rht� \| _| _t | j||�| _ t � | j| j �} t | � | � � �v t � | j�} | tj!k�r�t"�#d��nB| tj$k�r�| �%||� W d � �qhnt | � W d � �q�W d � n1 �s�0 Y �qhdS )z� Actually performs the TLS handshake. This is run automatically by wrapped socket, and shouldn't be needed in user code. Ni���r zutf-8Tzhandshake timed out)&r ZSSLCreateContextr ZkSSLClientSideZkSSLStreamTyperF Z SSLSetIOFuncs�_read_callback_pointer�_write_callback_pointerr �_connection_ref_lock�idr$ ZSSLSetConnection� isinstance�bytes�encodeZSSLSetPeerDomainNamerS rW r[ ZSSLSetProtocolVersionMinZSSLSetProtocolVersionMaxZSSLSetSessionOptionZ"kSSLSessionOptionBreakOnServerAuthr rI rJ r rK ZSSLSetCertificaterR Z SSLHandshaker3 r' r; ZerrSSLServerAuthCompletedrh ) rN �server_hostnamerd re Z min_versionZ max_versionZ client_certZ client_keyZclient_key_passphraseZalpn_protocolsrV Zhandler r r � handshake� s` �� & � �� zWrappedSocket.handshakec C s | j �� S �N)r' �fileno�rN r r r r 7 s zWrappedSocket.filenoc C s* | j dkr| j d8 _ | jr&| �� d S )Nr r )rG rH rP r� r r r �_decref_socketios; s z WrappedSocket._decref_socketiosc C s& t �|�}| �||�}|d |� }|S r~ )r, Zcreate_string_bufferr. )rN Zbufsizr< Z bytes_readrA r r r �recvA s zWrappedSocket.recvNc C s� | j r dS |d u rt|�}tj| �|�}t�d�}| �� �( t�| j ||t� |��}W d � n1 sj0 Y |t j kr�|j dkr�t�d��n"|t jt jfv r�| �� nt|� |j S )Nr zrecv timed out)rH rS r, r- Z from_buffer�c_size_trR r ZSSLReadrF rq r r3 rr r' r; r/ ZerrSSLClosedNoNotifyrP r )rN r< �nbytes�processed_bytesrV r r r r. G s( �" � zWrappedSocket.recv_intoc C s || _ d S r~ �rL )rN r; r r r rM r s zWrappedSocket.settimeoutc C s | j S r~ r� r� r r r r( u s zWrappedSocket.gettimeoutc C s| t �d�}| �� �, t�| j|t|�t �|��}W d � n1 sD0 Y |tj krn|j dkrnt � d��nt |� |j S )Nr zsend timed out)r, r� rR r ZSSLWriterF rS rq r r3 rr r' r; r )rN rA r� rV r r r r@ x s �" zWrappedSocket.sendc C s4 d}|t |�k r0| �|||t � �}||7 }qd S �Nr )rS r@ �SSL_WRITE_BLOCKSIZE)rN rA Z total_sentrB r r r r_ � s zWrappedSocket.sendallc C s8 | � � � t�| j� W d � n1 s*0 Y d S r~ )rR r ZSSLCloserF r� r r r �shutdown� s zWrappedSocket.shutdownc C s� | j dk r�d| _| jr(t�| j� d | _| jr@t�| j� d | _| jrvt�| j� t�| j� t � | j � d | _| _ | j � � S | j d8 _ d S )Nr T)rG rH rF r rY rK rI r ZSecKeychainDelete�shutil�rmtreerJ r' rP r� r r r rP � s zWrappedSocket.closeFc C s |s t d��t�� }d }d }z�t�| jt�|��}t|� |s`W |rNt� |� |r\t� |� d S t� |�}|s�W |r~t� |� |r�t� |� d S t� |d�}|s�J �t� |�}|s�J �t� |�}t�|�} t�| |�}W |r�t� |� |r�t� |� n"|�rt� |� |�rt� |� 0 |S )Nz2SecureTransport only supports dumping binary certsr )� ValueErrorr ro rp rF r, rq r r rY ZSecTrustGetCertificateCountZ SecTrustGetCertificateAtIndexZSecCertificateCopyDataZCFDataGetLengthZCFDataGetBytePtrr? ) rN Z binary_formrt ZcertdataZ der_bytesrV Z cert_countZleafZ data_lengthr7 r r r � getpeercert� sN � � � zWrappedSocket.getpeercertc C s� t �� }t �| jt�|��}t|� |jtj kr<t � d��n^|jtj krLdS |jtj kr\dS |jtjkrldS |jtjkr|dS |jtjkr�dS t � d| ��d S )Nz(SecureTransport does not support TLS 1.3zTLSv1.2zTLSv1.1ZTLSv1ZSSLv3ZSSLv2zUnknown TLS version: %r)r Z SSLProtocolZ SSLGetNegotiatedProtocolVersionrF r, rq r rr r ZkTLSProtocol13rb rc �kTLSProtocol12�kTLSProtocol11� kTLSProtocol1� kSSLProtocol3� kSSLProtocol2)rN �protocolrV r r r r^ � s$ � zWrappedSocket.versionc C s | j d7 _ d S �Nr )rG r� r r r �_reuse� s zWrappedSocket._reusec C s& | j dk r| �� n| j d8 _ d S r� )rG rP r� r r r �_drop� s zWrappedSocket._drop)N)F)�__name__� __module__� __qualname__�__doc__rO � contextlib�contextmanagerrR rW r[ rh r] r} r r� r� r. rM r( r@ r_ r� rP r� r^ r� r� r r r r rD F s. #(] + :rD ���c C s | j d7 _ t| ||dd�S )Nr T)rP )rG r )rN �mode�bufsizer r r �makefile s r� �rc O s d}t | ||g|�R i |��S r� r )rN r� � buffering�args�kwargsr r r r� s c @ s� e Zd ZdZdd� Zedd� �Zejdd� �Zedd� �Zejd d� �Zed d � �Z e jd d � �Z d d� Z dd� Z dd� Z d dd�Z d dd�Zdd� Zd d d �ZdS )!r z� I am a wrapper class for the SecureTransport library, to translate the interface of the standard library ``SSLContext`` object to calls into SecureTransport. c C s> t | \| _| _d| _d| _d | _d | _d | _d | _d | _ d S rE ) �_protocol_to_min_max� _min_version� _max_version�_options�_verify� _trust_bundle� _client_cert� _client_key�_client_key_passphrase�_alpn_protocols)rN r� r r r rO s z SecureTransportContext.__init__c C s dS )�� SecureTransport cannot have its hostname checking disabled. For more, see the comment on getpeercert() in this file. Tr r� r r r �check_hostname# s z%SecureTransportContext.check_hostnamec C s dS )r� Nr �rN rr r r r r� + s c C s | j S r~ �r� r� r r r �options3 s z SecureTransportContext.optionsc C s || _ d S r~ r� r� r r r r� = s c C s | j r tjS tjS r~ )r� rb � CERT_REQUIREDZ CERT_NONEr� r r r � verify_modeB s z"SecureTransportContext.verify_modec C s |t jkrdnd| _d S )NTF)rb r� r� r� r r r r� F s c C s d S r~ r r� r r r �set_default_verify_pathsJ s z/SecureTransportContext.set_default_verify_pathsc C s | � � S r~ )r� r� r r r �load_default_certsV s z)SecureTransportContext.load_default_certsc C s |t jjkrtd��d S )Nz5SecureTransport doesn't support custom cipher strings)r r ZDEFAULT_CIPHERSr� )rN rU r r r � set_ciphersY s z"SecureTransportContext.set_ciphersNc C sN |d urt d��|d ur@t|�� W d � n1 s60 Y |pF|| _d S )Nz1SecureTransport does not support cert directories)r� rm r� )rN ZcafileZcapathZcadatar r r �load_verify_locations^ s z,SecureTransportContext.load_verify_locationsc C s || _ || _|| _d S r~ )r� r� Z_client_cert_passphrase)rN ZcertfileZkeyfile�passwordr r r �load_cert_chainj s z&SecureTransportContext.load_cert_chainc C s& t td�std��dd� |D �| _dS )z� Sets the ALPN protocols that will later be set on the context. Raises a NotImplementedError if ALPN is not supported. rX z2SecureTransport supports ALPN only in macOS 10.12+c S s g | ]}t �|��qS r )�sixZ ensure_binary)�.0�pr r r � <listcomp>y � z=SecureTransportContext.set_alpn_protocols.<locals>.<listcomp>N)�hasattrr �NotImplementedErrorr� )rN rZ r r r �set_alpn_protocolso s �z)SecureTransportContext.set_alpn_protocolsFTc C sN |rJ �|sJ �|sJ �t |�}|�|| j| j| j| j| j| j| j| j � |S r~ ) rD r} r� r� r� r� r� r� r� r� )rN ZsockZ server_sideZdo_handshake_on_connectZsuppress_ragged_eofsr| r9 r r r � wrap_socket{ s � z"SecureTransportContext.wrap_socket)NNN)NN)FTTN)r� r� r� r� rO �propertyr� �setterr� r� r� r� r� r� r� r� r� r r r r r s2 �r )r� )r� N)er� Z __future__r r� r, r* Zos.pathrj r� r' rb r` � threading�weakrefr� � r Z util.ssl_r Z_securetransport.bindingsr r r Z_securetransport.low_levelr r r r r r r � ImportErrorZpackages.backports.makefiler �__all__r r" r r r! �WeakValueDictionaryr$ �Lockrw r� Z'TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384Z'TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256Z%TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384Z%TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256Z-TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305_SHA256Z+TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305_SHA256Z#TLS_DHE_RSA_WITH_AES_256_GCM_SHA384Z#TLS_DHE_RSA_WITH_AES_128_GCM_SHA256Z'TLS_ECDHE_ECDSA_WITH_AES_256_CBC_SHA384Z$TLS_ECDHE_ECDSA_WITH_AES_256_CBC_SHAZ'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256Z$TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHAZ%TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384Z"TLS_ECDHE_RSA_WITH_AES_256_CBC_SHAZ%TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256Z"TLS_ECDHE_RSA_WITH_AES_128_CBC_SHAZ#TLS_DHE_RSA_WITH_AES_256_CBC_SHA256Z TLS_DHE_RSA_WITH_AES_256_CBC_SHAZ#TLS_DHE_RSA_WITH_AES_128_CBC_SHA256Z TLS_DHE_RSA_WITH_AES_128_CBC_SHAZTLS_AES_256_GCM_SHA384ZTLS_AES_128_GCM_SHA256Z TLS_RSA_WITH_AES_256_GCM_SHA384Z TLS_RSA_WITH_AES_128_GCM_SHA256ZTLS_AES_128_CCM_8_SHA256ZTLS_AES_128_CCM_SHA256Z TLS_RSA_WITH_AES_256_CBC_SHA256Z TLS_RSA_WITH_AES_128_CBC_SHA256Z TLS_RSA_WITH_AES_256_CBC_SHAZ TLS_RSA_WITH_AES_128_CBC_SHArT Z PROTOCOL_TLSr� r� r� r� r� r r� r r r� r r r r r> rC Z SSLReadFuncru Z SSLWriteFuncrv �objectrD r� r r r r r �<module> s� 5 �% � � � � � � 76 <