Skip to main content

Module allreduce

Module allreduce 

Source
Expand description

Typed AllReduce request. Generic over T: NcclReduceSupported (any of f32/f64/i8/u8/i32/u32/i64/u64; f16/bf16 with f16).

Structs§

AllReduceRequest
In-place all-reduce on a single tensor on this actor’s device.