MPIEnvironment

class lightning.pytorch.plugins.environments.MPIEnvironment

기반 클래스: lightning.fabric.plugins.environments.cluster_environment.ClusterEnvironment

An environment for running on clusters with processes created through MPI.

Requires the installation of the mpi4py package. See also: https://github.com/mpi4py/mpi4py

static detect()

Returns True if the mpi4py package is installed and MPI returns a world size greater than 1.

반환 형식

bool

global_rank()

The rank (index) of the currently running process across all nodes and devices.

반환 형식

int

local_rank()

The rank (index) of the currently running process inside of the current node.

반환 형식

int

node_rank()

The rank (index) of the node on which the current process runs.

반환 형식

int

world_size()

The number of processes across all devices and nodes.

반환 형식

int

property creates_processes_externally: bool

Whether the environment creates the subprocesses or not.

반환 형식

bool

property main_address: str

The main address through which all processes connect and communicate.

반환 형식

str

property main_port: int

An open and configured port in the main node through which all processes communicate.

반환 형식

int