Package inference

Interface ModelConfigOuterClass.ModelOptimizationPolicy.Cuda.GraphSpec.LowerBoundOrBuilder

All Superinterfaces:
com.google.protobuf.MessageLiteOrBuilder, com.google.protobuf.MessageOrBuilder
All Known Implementing Classes:
ModelConfigOuterClass.ModelOptimizationPolicy.Cuda.GraphSpec.LowerBound, ModelConfigOuterClass.ModelOptimizationPolicy.Cuda.GraphSpec.LowerBound.Builder
Enclosing class:
ModelConfigOuterClass.ModelOptimizationPolicy.Cuda.GraphSpec

public static interface ModelConfigOuterClass.ModelOptimizationPolicy.Cuda.GraphSpec.LowerBoundOrBuilder extends com.google.protobuf.MessageOrBuilder
  • Method Details

    • getBatchSize

      int getBatchSize()
      @@      .. cpp:var:: int32 batch_size
      @@
      @@         The batch size of the CUDA graph. If 'max_batch_size' is 0,
      @@         'batch_size' must be set to 0. Otherwise, 'batch_size' must
      @@         be set to value between 1 and 'max_batch_size'.
      @@
       
      int32 batch_size = 1;
      Returns:
      The batchSize.
    • getInputCount

      int getInputCount()
      @@      .. cpp:var:: map<string, Shape> input
      @@
      @@         The specification of the inputs. 'Shape' is the shape of
      @@         the input without batching dimension.
      @@
       
      map<string, .inference.ModelOptimizationPolicy.Cuda.GraphSpec.Shape> input = 2;
    • containsInput

      boolean containsInput(String key)
      @@      .. cpp:var:: map<string, Shape> input
      @@
      @@         The specification of the inputs. 'Shape' is the shape of
      @@         the input without batching dimension.
      @@
       
      map<string, .inference.ModelOptimizationPolicy.Cuda.GraphSpec.Shape> input = 2;
    • getInput

      Deprecated.
      Use getInputMap() instead.
    • getInputMap

      @@      .. cpp:var:: map<string, Shape> input
      @@
      @@         The specification of the inputs. 'Shape' is the shape of
      @@         the input without batching dimension.
      @@
       
      map<string, .inference.ModelOptimizationPolicy.Cuda.GraphSpec.Shape> input = 2;
    • getInputOrDefault

      @@      .. cpp:var:: map<string, Shape> input
      @@
      @@         The specification of the inputs. 'Shape' is the shape of
      @@         the input without batching dimension.
      @@
       
      map<string, .inference.ModelOptimizationPolicy.Cuda.GraphSpec.Shape> input = 2;
    • getInputOrThrow

      @@      .. cpp:var:: map<string, Shape> input
      @@
      @@         The specification of the inputs. 'Shape' is the shape of
      @@         the input without batching dimension.
      @@
       
      map<string, .inference.ModelOptimizationPolicy.Cuda.GraphSpec.Shape> input = 2;