Skip to main content

Module allgather

atomr_accel_cuda::kernel::collective

Module allgather 

Source
Expand description

Typed AllGather request — generic over T: NcclReduceSupported.

Structs§

AllGatherRequest
AllGather: each rank contributes send (length N) and writes a concatenated buffer of length N * world_size into recv.