| Server IP : 127.0.0.1 / Your IP : 216.73.216.109 Web Server : Apache/2.4.54 (Win64) OpenSSL/1.1.1q PHP/8.1.10 System : Windows NT DESKTOP-E5T4RUN 10.0 build 19045 (Windows 10) AMD64 User : SERVERWEB ( 0) PHP Version : 8.1.10 Disable Function : NONE MySQL : OFF | cURL : ON | WGET : OFF | Perl : OFF | Python : OFF | Sudo : OFF | Pkexec : OFF Directory : C:/cygwin64/lib/python3.9/site-packages/sphinx/util/__pycache__/ |
Upload File : |
a
�ab6 � @ s� d Z ddlZddlZddlZddlmZ ddlmZmZm Z m
Z
m Z m Z z ddl
Z
W n eyj dZ
Y n0 ddlmZ ddlmZ e�e�Ze
o�ejdkZG dd � d �ZG d
d � d �Zde e eee
e d
�dd�Z dS )z�
sphinx.util.parallel
~~~~~~~~~~~~~~~~~~~~
Parallel building utilities.
:copyright: Copyright 2007-2022 by the Sphinx team, see AUTHORS.
:license: BSD, see LICENSE for details.
� N)�sqrt)�Any�Callable�Dict�List�Optional�Sequence)�SphinxParallelError)�logging�posixc @ sF e Zd ZdZd
edd�dd�Zdeeedd�dd �Zdd
�d d �Z dS )� SerialTaskszEHas the same interface as ParallelTasks, but executes tasks directly.� N��nproc�returnc C s d S �N� ��selfr r r �8/usr/lib/python3.9/site-packages/sphinx/util/parallel.py�__init__# s zSerialTasks.__init__�� task_func�arg� result_funcr c C s( |d ur||�}n|� }|r$||� d S r r )r r r r �resr r r �add_task& s
zSerialTasks.add_task�r c C s d S r r �r r r r �join. s zSerialTasks.join)r
)NN)
�__name__�
__module__� __qualname__�__doc__�intr r r r r r r r r r s r c @ st e Zd ZdZedd�dd�Zeeedd�dd�Zdeeedd �d
d �Z dd �d
d�Z
dd �dd�Z e d �dd�Z
dS )�
ParallelTasksz1Executes *nproc* tasks in parallel after forking.Nr c C s4 || _ i | _i | _i | _i | _i | _d| _d| _d S )Nr )r �
_result_funcs�_args�_procs�_precvs�_precvsWaiting� _pworking�_taskidr r r r r 5 s zParallelTasks.__init__)�pipe�funcr r c
C s� zPt �� }|�� �( |d u r$|� }n||�}W d � n1 s@0 Y d}W nJ ty� } z2d}t�|j|�d �� }|t�� f}W Y d }~n
d }~0 0 t � |j
� |� ||j
|f� d S )NFTr ) r
Z LogCollectorZcollect�
BaseException� traceback�format_exception_only� __class__�strip�
format_excZconvert_serializable�logs�send) r r- r. r Z collector�retZfailed�err�errmsgr r r �_processF s
&" zParallelTasks._processr c C s~ | j }| j d7 _ |p dd� | j|< || j|< t�d�\}}t�d�}|j| j|||fd�}|| j|< || j |< | �
� d S )Nr
c S s d S r r )r �resultr r r �<lambda>Y � z(ParallelTasks.add_task.<locals>.<lambda>F�fork)�target�args) r, r& r' �multiprocessingZPipeZ get_contextZProcessr: r( r* � _join_one) r r r r �tidZprecvZpsend�context�procr r r r V s
zParallelTasks.add_taskr c C s@ z | j r | �� st�d� qW n ty: | �� � Y n0 d S )Ng{�G�z�?)r+ rB �time�sleep� Exception� terminater r r r r b s zParallelTasks.joinc C sT t | j�D ]D}| j| �� | j�|� | j�|� | j�|� | jd8 _q
d S )Nr
)�listr) r( rI r& �popr+ )r rC r r r rI l s zParallelTasks.terminatec
C s� d}| j �� D ]�\}}|�� r|�� \}}}|r8t|� �|D ]}t�|� q<| j�|�| j �|�|� | j
| � � | j �|� | j d8 _ d} q�q| j
r�| j | jk r�| j
�� \}} | | j |< | j
| �� | j d7 _ q�|S )NFr
T)r) �itemsZpollZrecvr �loggerZhandler& rK r' r( r r+ r* r �popitem�start)
r Z
joined_anyrC r- �excr5 r; �logZnewtidZnewprecvr r r rB t s(
zParallelTasks._join_one)NN)r r! r" r# r$ r r r r: r r rI �boolrB r r r r r% 2 s
r% �
)� argumentsr �maxbatchr c sj t � �}|| ��|kr,tt|| | ����dkr8d�t|��\}}|rR|d7 }� �fdd�t|�D �S )Nr r
c s$ g | ] }� |� |d � � �qS )r
r )�.0�i�rT Z chunksizer r �
<listcomp>� r= z make_chunks.<locals>.<listcomp>)�lenr$ r �divmod�range)rT r rU �nargsZnchunks�restr rX r � make_chunks� s r_ )rS ) r# �osrF r0 Zmathr �typingr r r r r r rA � ImportErrorZ
sphinx.errorsr Z sphinx.utilr
Z getLoggerr rM �nameZparallel_availabler r% �strr$ r_ r r r r �<module> s
[