CUDNN API  8
cudnn_frontend::EngineConfigGenerator Class Reference

#include <cudnn_frontend_EngineConfigGenerator.h>

Collaboration diagram for cudnn_frontend::EngineConfigGenerator:
Collaboration graph

Public Member Functions

 EngineConfigGenerator (int const sourceSize, GeneratorSource const *sources)
 
auto generate_engine_config (cudnn_frontend::OperationGraph &opGraph) -> cudnn_frontend::EngineConfigList
 
auto cudnnGetPlan (cudnnHandle_t handle, cudnn_frontend::OperationGraph &&opGraph, Predicate pred) -> executionPlans_t
 Returns the concatenated plan in the order of heuristic results. More...
 
template<CudnnFindSamplingTechnique samplingTechnique>
auto cudnnFindPlan (cudnnHandle_t handle, cudnn_frontend::OperationGraph &&opGraph, cudnn_frontend::VariantPack &variantPack, Predicate pred) -> executionOptions_t
 

Private Attributes

std::vector< GeneratorSourceengine_config_generators
 

Detailed Description

EngineConfigGenerator class Contains a vector of methods that generate a vector of backend descriptor that can be used to create a plan for the method.

Definition at line 50 of file cudnn_frontend_EngineConfigGenerator.h.

Constructor & Destructor Documentation

◆ EngineConfigGenerator()

cudnn_frontend::EngineConfigGenerator::EngineConfigGenerator ( int const  sourceSize,
GeneratorSource const *  sources 
)
inline

Constructor that takes int a array of function pointers that will be called later. in the generate_engine_config function.

Definition at line 57 of file cudnn_frontend_EngineConfigGenerator.h.

Member Function Documentation

◆ cudnnFindPlan()

template<CudnnFindSamplingTechnique samplingTechnique>
auto cudnn_frontend::EngineConfigGenerator::cudnnFindPlan ( cudnnHandle_t  handle,
cudnn_frontend::OperationGraph &&  opGraph,
cudnn_frontend::VariantPack variantPack,
Predicate  pred 
) -> executionOptions_t

Reruns the concatenated plans and measures the execution time following which a sorted order of executionPlans are return to the user.

Creating a set of execution plans that are supported.

Definition at line 99 of file cudnn_frontend_find_plan.h.

References cudnn_frontend::filter().

◆ cudnnGetPlan()

auto cudnn_frontend::EngineConfigGenerator::cudnnGetPlan ( cudnnHandle_t  handle,
cudnn_frontend::OperationGraph &&  opGraph,
Predicate  pred 
) -> executionPlans_t

Returns the concatenated plan in the order of heuristic results.

Definition at line 30 of file cudnn_frontend_get_plan.h.

References cudnn_frontend::filter().

◆ generate_engine_config()

auto cudnn_frontend::EngineConfigGenerator::generate_engine_config ( cudnn_frontend::OperationGraph opGraph) -> cudnn_frontend::EngineConfigList
inline

Calls the vector of engine_config_generators one by one and concatenates the generated engine together into a single list.

Definition at line 66 of file cudnn_frontend_EngineConfigGenerator.h.

Member Data Documentation

◆ engine_config_generators

std::vector<GeneratorSource> cudnn_frontend::EngineConfigGenerator::engine_config_generators
private

Definition at line 52 of file cudnn_frontend_EngineConfigGenerator.h.


The documentation for this class was generated from the following files: