Struct HeuristicCacheRef 

pub struct HeuristicCacheRef { /* private fields */ }

Shareable handle to the heuristic cache. Cheap to clone.

Implementations

impl HeuristicCacheRef

pub fn with_capacity(capacity: usize) -> Self

pub fn default_size() -> Self

pub fn top_k(&self) -> usize

Number of algorithms to request from cuBLASLt on cold lookup.

pub fn get(&self, key: &HeuristicKey) -> Option<HeuristicEntry>

Cache hit (refreshes LRU order) or miss.

pub fn insert(&self, key: HeuristicKey, entry: HeuristicEntry)

Insert a (key, entry) pair, possibly evicting the LRU tail.

pub fn len(&self) -> usize

Snapshot of cache occupancy. Diagnostic only.

pub fn is_empty(&self) -> bool

Trait Implementations

impl Clone for HeuristicCacheRef

fn clone(&self) -> HeuristicCacheRef

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.