Enum Epilogue 

#[repr(u32)]
pub enum Epilogue {
    None = 0,
    Relu = 1,
    Bias = 2,
    ReluBias = 3,
    ReluAux = 4,
    ReluAuxBias = 5,
    Gelu = 6,
    GeluAux = 7,
    GeluBias = 8,
    GeluAuxBias = 9,
    DRelu = 10,
    DReluBgrad = 11,
    DGelu = 12,
    DGeluBgrad = 13,
    BgradA = 14,
    BgradB = 15,
}

Curated epilogue matrix.

Variants

None = 0

No fused activation, no bias. Identity epilogue.

Relu = 1

Fused ReLU.

Bias = 2

Bias-add only.

ReluBias = 3

Bias-add + ReLU.

ReluAux = 4

ReLU forward storing the masked-input “aux” tensor for the matching backward pass.

ReluAuxBias = 5

ReLU forward + bias + aux storage.

Gelu = 6

Fused GeLU.

GeluAux = 7

GeLU forward storing the unactivated preact for backward.

GeluBias = 8

Bias-add + GeLU.

GeluAuxBias = 9

Bias-add + GeLU forward + aux storage.

DRelu = 10

ReLU backward (drelu) — gradient w.r.t. the preact.

DReluBgrad = 11

ReLU backward + reduce-sum producing bias gradient.

DGelu = 12

GeLU backward (dgelu).

DGeluBgrad = 13

GeLU backward + reduce-sum producing bias gradient.

BgradA = 14

Reduction-only along the A (M) dimension — produces the bias-grad without any activation.

BgradB = 15

Reduction-only along the B (N) dimension.

Implementations

impl Epilogue

pub fn to_cublas(self) -> cublasLtEpilogue_t

Map to the cuBLASLt sys-level enum value.

pub fn uses_bias(self) -> bool

Does this epilogue read or write a bias vector?

pub fn uses_aux(self) -> bool

Does this epilogue store or consume an epilogue_aux tensor (the activation preact / mask used by the matching backward)?

pub fn produces_bias_grad(self) -> bool

Does this epilogue produce a bias gradient as a side output (BGRADA, BGRADB, or D{Relu,Gelu}_BGRAD)?

Trait Implementations

impl Clone for Epilogue

fn clone(&self) -> Epilogue

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for Epilogue

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Hash for Epilogue

fn hash<__H: Hasher>(&self, state: &mut __H)

Feeds this value into the given Hasher.

fn hash_slice<H>(data: &[Self], state: &mut H)

where H: Hasher, Self: Sized,

Feeds a slice of this type into the given Hasher.

impl PartialEq for Epilogue

fn eq(&self, other: &Epilogue) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Copy for Epilogue

impl Eq for Epilogue

impl StructuralPartialEq for Epilogue