Skip to main content

NcclWorldMsg

atomr_accel_cuda::multi_device

Enum NcclWorldMsg

pub enum NcclWorldMsg {
    AllReduceF32 {
        tensors: Vec<GpuRef<f32>>,
        op: ReduceOp,
        reply: Sender<Result<(), GpuError>>,
    },
    ChildReady {
        device_idx: usize,
        device_ref: ActorRef<DeviceMsg>,
    },
    DeviceContextChanged {
        device_idx: usize,
        new_generation: u64,
    },
}

Variants§

AllReduceF32

Fields

§tensors: Vec<GpuRef<f32>>

§op: ReduceOp

§reply: Sender<Result<(), GpuError>>

ChildReady

Internal: child reports it’s ready.

Fields

§device_idx: usize

§device_ref: ActorRef<DeviceMsg>

DeviceContextChanged

Internal: a per-device generation watch fired, meaning a ContextActor rebuilt its CUDA context and the existing NCCL communicators are now invalid. The world tears the collectives down and rebuilds.

Fields

§device_idx: usize

§new_generation: u64

Auto Trait Implementations§

impl Freeze for NcclWorldMsg

impl !RefUnwindSafe for NcclWorldMsg

impl Send for NcclWorldMsg

impl Sync for NcclWorldMsg

impl Unpin for NcclWorldMsg

impl UnsafeUnpin for NcclWorldMsg

impl !UnwindSafe for NcclWorldMsg

Blanket Implementations§

impl<T> Any for T
where T: 'static + ?Sized,

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more

impl<T> Borrow<T> for T
where T: ?Sized,

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more

impl<T> BorrowMut<T> for T
where T: ?Sized,

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more

impl<T> From<T> for T

fn from(t: T) -> T

Returns the argument unchanged.

impl<T> Instrument for T

fn instrument(self, span: Span) -> Instrumented<Self>

Instruments this type with the provided [Span], returning an Instrumented wrapper. Read more

fn in_current_span(self) -> Instrumented<Self>

Instruments this type with the current Span, returning an Instrumented wrapper. Read more

impl<T, U> Into<U> for T
where U: From<T>,

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

impl<T, U> TryFrom<U> for T
where U: Into<T>,

type Error = Infallible

The type returned in the event of a conversion error.

fn try_from(value: U) -> Result<T, <T as TryFrom<U>>::Error>

Performs the conversion.

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.

impl<T> WithSubscriber for T

fn with_subscriber<S>(self, subscriber: S) -> WithDispatch<Self>
where S: Into<Dispatch>,

Attaches the provided Subscriber to this type, returning a [WithDispatch] wrapper. Read more

fn with_current_subscriber(self) -> WithDispatch<Self>

Attaches the current default Subscriber to this type, returning a [WithDispatch] wrapper. Read more

impl<T> Extension for T
where T: Any + Send + Sync,