Skip to main content

Module reduce_scatter

atomr_accel_cuda::kernel::collective

Module reduce_scatter 

Source
Expand description

Typed ReduceScatter request — generic over T: NcclReduceSupported.

Structs§

ReduceScatterRequest
ReduceScatter: each rank contributes send (length N * world_size) and receives a reduced shard of length N into recv.