| Server IP : 127.0.0.1 / Your IP : 216.73.216.109 Web Server : Apache/2.4.54 (Win64) OpenSSL/1.1.1q PHP/8.1.10 System : Windows NT DESKTOP-E5T4RUN 10.0 build 19045 (Windows 10) AMD64 User : SERVERWEB ( 0) PHP Version : 8.1.10 Disable Function : NONE MySQL : OFF | cURL : ON | WGET : OFF | Perl : OFF | Python : OFF | Sudo : OFF | Pkexec : OFF Directory : C:/cygwin64/lib/python3.9/site-packages/sphinx/util/__pycache__/ |
Upload File : |
a
�ab6 � @ s� d dl Z d dlZd dlZd dlmZ d dlmZmZmZm Z m
Z
m Z z d dl Z W n e
yf dZ Y n0 d dlmZ d dlmZ e�e�Ze o�e jdkZG dd� d�ZG d d
� d
�Zde e eee e d �d
d�ZdS )� N)�sqrt)�Any�Callable�Dict�List�Optional�Sequence)�SphinxParallelError)�logging�posixc @ sB e Zd Zd edd�dd�Zd
eeedd�dd�Zdd �d
d �ZdS )� SerialTasks� N��nproc�returnc C s d S �N� ��selfr r r �8/usr/lib/python3.9/site-packages/sphinx/util/parallel.py�__init__# s zSerialTasks.__init__�� task_func�arg� result_funcr c C s( |d ur||�}n|� }|r$||� d S r r )r r r r �resr r r �add_task& s
zSerialTasks.add_task�r c C s d S r r �r r r r �join. s zSerialTasks.join)r
)NN) �__name__�
__module__� __qualname__�intr r r r r r r r r r s r c @ sp e Zd Zedd�dd�Zeeedd�dd�Zdeeedd�d d
�Zdd �d d
�Z dd �dd�Z
e d �dd�Z dS )�
ParallelTasksNr c C s4 || _ i | _i | _i | _i | _i | _d| _d| _d S )Nr )r �
_result_funcs�_args�_procs�_precvs�_precvsWaiting� _pworking�_taskidr r r r r 5 s zParallelTasks.__init__)�pipe�funcr r c
C s� zPt �� }|�� �( |d u r$|� }n||�}W d � n1 s@0 Y d}W nJ ty� } z2d}t�|j|�d �� }|t�� f}W Y d }~n
d }~0 0 t � |j
� |� ||j
|f� d S )NFTr ) r
Z LogCollectorZcollect�
BaseException� traceback�format_exception_only� __class__�strip�
format_excZconvert_serializable�logs�send) r r, r- r Z collector�retZfailed�err�errmsgr r r �_processF s
&" zParallelTasks._processr c C s~ | j }| j d7 _ |p dd� | j|< || j|< t�d�\}}t�d�}|j| j|||fd�}|| j|< || j |< | �
� d S )Nr
c S s d S r r )r �resultr r r �<lambda>Y � z(ParallelTasks.add_task.<locals>.<lambda>F�fork)�target�args) r+ r% r& �multiprocessingZPipeZ get_contextZProcessr9 r' r) � _join_one) r r r r �tidZprecvZpsend�context�procr r r r V s
zParallelTasks.add_taskr c C s@ z | j r | �� st�d� qW n ty: | �� � Y n0 d S )Ng{�G�z�?)r* rA �time�sleep� Exception� terminater r r r r b s zParallelTasks.joinc C sT t | j�D ]D}| j| �� | j�|� | j�|� | j�|� | jd8 _q
d S )Nr
)�listr( r' rH r% �popr* )r rB r r r rH l s zParallelTasks.terminatec
C s� d}| j �� D ]�\}}|�� r|�� \}}}|r8t|� �|D ]}t�|� q<| j�|�| j �|�|� | j
| � � | j �|� | j d8 _ d} q�q| j
r�| j | jk r�| j
�� \}} | | j |< | j
| �� | j d7 _ q�|S )NFr
T)r( �itemsZpollZrecvr �loggerZhandler% rJ r& r' r r* r) r �popitem�start)
r Z
joined_anyrB r, �excr4 r: �logZnewtidZnewprecvr r r rA t s(
zParallelTasks._join_one)NN)
r r! r" r# r r r r9 r r rH �boolrA r r r r r$ 2 s
r$ �
)� argumentsr �maxbatchr c sj t � �}|| ��|kr,tt|| | ����dkr8d�t|��\}}|rR|d7 }� �fdd�t|�D �S )Nr r
c s$ g | ] }� |� |d � � �qS )r
r )�.0�i�rS Z chunksizer r �
<listcomp>� r< z make_chunks.<locals>.<listcomp>)�lenr# r �divmod�range)rS r rT �nargsZnchunks�restr rW r � make_chunks� s r^ )rR ) �osrE r/ Zmathr �typingr r r r r r r@ � ImportErrorZ
sphinx.errorsr Z sphinx.utilr
Z getLoggerr rL �nameZparallel_availabler r$ �strr# r^ r r r r �<module> s
[