Expand description
Top-level multi-device actors that span multiple DeviceActors.
F4 ships:
world_actor::NcclWorldActor— supervises NDeviceActors and NCollectiveActors for a single NCCL group.
Top-level multi-device actors that span multiple DeviceActors.
F4 ships:
world_actor::NcclWorldActor — supervises N DeviceActors
and N CollectiveActors for a single NCCL group.