Lines Matching refs:multiprocessing
1 :mod:`multiprocessing` --- Process-based parallelism
4 .. module:: multiprocessing
7 **Source code:** :source:`Lib/multiprocessing/`
14 :mod:`multiprocessing` is a package that supports spawning processes using an
15 API similar to the :mod:`threading` module. The :mod:`multiprocessing` package
18 to this, the :mod:`multiprocessing` module allows the programmer to fully
22 The :mod:`multiprocessing` module also introduces APIs which do not have
24 :class:`~multiprocessing.pool.Pool` object which offers a convenient means of
29 of data parallelism using :class:`~multiprocessing.pool.Pool`, ::
31 from multiprocessing import Pool
48 In :mod:`multiprocessing`, processes are spawned by creating a :class:`Process`
53 from multiprocessing import Process
65 from multiprocessing import Process
85 necessary, see :ref:`multiprocessing-programming`.
94 Depending on the platform, :mod:`multiprocessing` supports three ways
146 import multiprocessing as mp
163 object. Context objects have the same API as the multiprocessing
167 import multiprocessing as mp
200 :mod:`multiprocessing` supports two types of communication channel between
208 from multiprocessing import Process, Queue
227 from multiprocessing import Process, Pipe
252 :mod:`multiprocessing` contains equivalents of all the synchronization
256 from multiprocessing import Process, Lock
283 :mod:`multiprocessing` provides a couple of ways of doing so.
290 from multiprocessing import Process, Value, Array
319 :mod:`multiprocessing.sharedctypes` module which supports the creation of
334 from multiprocessing import Process, Manager
368 The :class:`~multiprocessing.pool.Pool` class represents a pool of worker
374 from multiprocessing import Pool, TimeoutError
409 print("We lacked patience and got a multiprocessing.TimeoutError")
422 importable by the children. This is covered in :ref:`multiprocessing-programming`
424 as the :class:`multiprocessing.pool.Pool` examples will not work in the
427 >>> from multiprocessing import Pool
451 The :mod:`multiprocessing` package mostly replicates the API of the
567 When :mod:`multiprocessing` is initialized the main process is assigned a
574 See :ref:`multiprocessing-auth-keys`.
582 once using :func:`multiprocessing.connection.wait`. Otherwise
632 >>> import multiprocessing, time, signal
633 >>> p = multiprocessing.Process(target=time.sleep, args=(1000,))
648 The base class of all :mod:`multiprocessing` exceptions.
689 :ref:`multiprocessing-managers`.
693 :mod:`multiprocessing` uses the usual :exc:`queue.Empty` and
695 the :mod:`multiprocessing` namespace so you need to import them from
705 :ref:`manager <multiprocessing-managers>`.
728 <multiprocessing.Queue.cancel_join_thread>`), then that process will
737 :ref:`multiprocessing-programming`.
740 :ref:`multiprocessing-examples`.
746 :class:`~multiprocessing.connection.Connection` objects representing the
770 multithreading/multiprocessing semantics, this number is not reliable.
778 multithreading/multiprocessing semantics, this is not reliable.
783 multithreading/multiprocessing semantics, this is not reliable.
814 :class:`multiprocessing.Queue` has a few additional methods not found in
936 Add support for when a program which uses :mod:`multiprocessing` has been
943 from multiprocessing import Process, freeze_support
973 :mod:`multiprocessing` module.
1023 :mod:`multiprocessing` contains no analogues of
1032 .. currentmodule:: multiprocessing.connection
1038 :func:`Pipe <multiprocessing.Pipe>` -- see also
1039 :ref:`multiprocessing-listeners-clients`.
1077 using :func:`multiprocessing.connection.wait`.
1134 >>> from multiprocessing import Pipe
1161 :ref:`multiprocessing-auth-keys`.
1173 .. currentmodule:: multiprocessing
1180 object -- see :ref:`multiprocessing-managers`.
1205 object from :mod:`multiprocessing`.
1222 :class:`multiprocessing.Lock` as it applies to either processes or threads,
1226 instance of ``multiprocessing.synchronize.Lock`` initialized with a
1276 instance of ``multiprocessing.synchronize.RLock`` initialized with a
1354 :mod:`multiprocessing.synchronize` module will be disabled, and attempts to
1421 The :mod:`multiprocessing.sharedctypes` module
1424 .. module:: multiprocessing.sharedctypes
1427 The :mod:`multiprocessing.sharedctypes` module provides functions for allocating
1478 :class:`~multiprocessing.Lock` or :class:`~multiprocessing.RLock` object
1493 synchronize access to the value. If *lock* is a :class:`~multiprocessing.Lock` or
1494 :class:`~multiprocessing.RLock` object then that will be used to synchronize access to the
1510 :class:`multiprocessing.RLock` object is created automatically.
1540 from multiprocessing import Process, Lock
1541 from multiprocessing.sharedctypes import Value, Array
1596 .. function:: multiprocessing.Manager()
1598 Returns a started :class:`~multiprocessing.managers.SyncManager` object which
1603 .. module:: multiprocessing.managers
1608 :mod:`multiprocessing.managers` module:
1636 >>> from multiprocessing.managers import BaseManager
1647 >>> from multiprocessing.managers import BaseManager
1715 :func:`multiprocessing.Manager`.
1717 Its methods create and return :ref:`multiprocessing-proxy_objects` for a
1807 >>> manager = multiprocessing.Manager()
1823 from multiprocessing.managers import BaseManager
1852 >>> from multiprocessing.managers import BaseManager
1863 >>> from multiprocessing.managers import BaseManager
1873 >>> from multiprocessing.managers import BaseManager
1885 >>> from multiprocessing import Process, Queue
1886 >>> from multiprocessing.managers import BaseManager
1919 >>> from multiprocessing import Manager
1937 :ref:`multiprocessing-proxy_objects`. This permits nesting of these managed
1938 lists, dicts, and other :ref:`multiprocessing-proxy_objects`:
1984 :ref:`multiprocessing-proxy_objects` for most use cases but also
1989 The proxy types in :mod:`multiprocessing` do nothing to support comparisons
2071 .. module:: multiprocessing.pool
2096 function :func:`multiprocessing.Pool` or the :meth:`Pool` method
2182 ``next(timeout)`` will raise :exc:`multiprocessing.TimeoutError` if the
2240 :exc:`multiprocessing.TimeoutError` is raised. If the remote call raised
2258 from multiprocessing import Pool
2277 print(result.get(timeout=1)) # raises multiprocessing.TimeoutError
2285 .. module:: multiprocessing.connection
2290 :func:`~multiprocessing.Pipe`.
2292 However, the :mod:`multiprocessing.connection` module allows some extra
2306 :exc:`~multiprocessing.AuthenticationError` is raised.
2314 :exc:`~multiprocessing.AuthenticationError` is raised.
2323 *address*. (See :ref:`multiprocessing-address-formats`)
2328 :exc:`~multiprocessing.AuthenticationError` is raised if authentication fails.
2329 See :ref:`multiprocessing-auth-keys`.
2352 :ref:`multiprocessing-address-formats`. Note that if *family* is
2363 :exc:`~multiprocessing.AuthenticationError` is raised if authentication fails.
2364 See :ref:`multiprocessing-auth-keys`.
2371 :exc:`~multiprocessing.AuthenticationError` is raised.
2406 * a readable :class:`~multiprocessing.connection.Connection` object;
2408 * the :attr:`~multiprocessing.Process.sentinel` attribute of a
2409 :class:`~multiprocessing.Process` object.
2436 from multiprocessing.connection import Listener
2454 from multiprocessing.connection import Client
2468 The following code uses :func:`~multiprocessing.connection.wait` to
2472 from multiprocessing import Process, Pipe, current_process
2473 from multiprocessing.connection import wait
2543 :class:`~multiprocessing.Process`). This value will be automatically inherited by
2544 any :class:`~multiprocessing.Process` object that the current process creates.
2559 .. currentmodule:: multiprocessing
2562 Returns the logger used by :mod:`multiprocessing`. If necessary, a new one
2573 .. currentmodule:: multiprocessing
2583 >>> import multiprocessing, logging
2584 >>> logger = multiprocessing.log_to_stderr()
2588 >>> m = multiprocessing.Manager()
2599 The :mod:`multiprocessing.dummy` module
2602 .. module:: multiprocessing.dummy
2605 :mod:`multiprocessing.dummy` replicates the API of :mod:`multiprocessing` but is
2615 :mod:`multiprocessing`.
2647 :func:`~multiprocessing.active_children` is called) all completed processes
2649 process's :meth:`Process.is_alive <multiprocessing.Process.is_alive>` will
2656 from :mod:`multiprocessing` need to be picklable so that child
2665 Using the :meth:`Process.terminate <multiprocessing.Process.terminate>`
2672 :meth:`Process.terminate <multiprocessing.Process.terminate>` on processes
2680 :meth:`Queue.cancel_join_thread <multiprocessing.Queue.cancel_join_thread>`
2691 from multiprocessing import Process, Queue
2722 from multiprocessing import Process, Lock
2734 from multiprocessing import Process, Lock
2746 :mod:`multiprocessing` originally unconditionally called::
2750 in the :meth:`multiprocessing.Process._bootstrap` method --- this resulted
2786 Also, if you subclass :class:`~multiprocessing.Process` then make sure that
2788 <multiprocessing.Process.start>` method is called.
2795 <multiprocessing.Process.start>` was called.
2810 from multiprocessing import Process
2821 from multiprocessing import Process, freeze_support, set_start_method
2853 Using :class:`~multiprocessing.pool.Pool`: