Expand description
Activation, dropout, and LRN requests for the cuDNN actor.
Activation set: Relu, Sigmoid, Tanh (existing) plus Gelu,
GeluApprox, Swish, Elu, Softplus, Identity. cuDNN routes
these through pointwise descriptor ops in the v9 frontend graph.
Structs§
- Activation
FwdRequest - Activation forward request. dims are the raw tensor dims.
- Dropout
FwdRequest - Dropout forward request: produces
y = x * mask / (1 - p)and records the mask state for backward. - LrnFwd
Request - LRN forward request.
- LrnParams
- Local-response-normalisation parameters.
- Softmax
FwdRequest - Softmax forward request.
Enums§
- Activation
Kind - Activation function tag.
- Softmax
Mode - Softmax mode (instance vs channel-wise).
Functions§
- build_
activation_ fwd_ graph - Build the spec-side activation-fwd op graph.