Package inference

Interface ModelConfigOuterClass.ModelWarmupOrBuilder

All Superinterfaces:
com.google.protobuf.MessageLiteOrBuilder, com.google.protobuf.MessageOrBuilder
All Known Implementing Classes:
ModelConfigOuterClass.ModelWarmup, ModelConfigOuterClass.ModelWarmup.Builder
Enclosing class:
ModelConfigOuterClass
public static interface ModelConfigOuterClass.ModelWarmupOrBuilder extends com.google.protobuf.MessageOrBuilder

  • Method Details

    • getName

      String getName()
      @@  .. cpp:var:: string name
@@
@@     The name of the request sample.
@@
      string name = 1;
      Returns:
      The name.

    • getNameBytes

      com.google.protobuf.ByteString getNameBytes()
      @@  .. cpp:var:: string name
@@
@@     The name of the request sample.
@@
      string name = 1;
      Returns:
      The bytes for name.

    • getBatchSize

      int getBatchSize()
      @@  .. cpp:var:: uint32 batch_size
@@
@@     The batch size of the inference request. This must be >= 1. For
@@     models that don't support batching, batch_size must be 1. If
@@     batch_size > 1, the 'inputs' specified below will be duplicated to
@@     match the batch size requested.
@@
      uint32 batch_size = 2;
      Returns:
      The batchSize.

    • getInputsCount

      int getInputsCount()
      @@  .. cpp:var:: map<string, Input> inputs
@@
@@     The warmup meta data associated with every model input, including
@@     control tensors.
@@
      map<string, .inference.ModelWarmup.Input> inputs = 3;

    • containsInputs

      boolean containsInputs(String key)
      @@  .. cpp:var:: map<string, Input> inputs
@@
@@     The warmup meta data associated with every model input, including
@@     control tensors.
@@
      map<string, .inference.ModelWarmup.Input> inputs = 3;

    • getInputs

      @Deprecated Map<String,ModelConfigOuterClass.ModelWarmup.Input> getInputs()
      Deprecated.
      Use getInputsMap() instead.

    • getInputsMap

      Map<String,ModelConfigOuterClass.ModelWarmup.Input> getInputsMap()
      @@  .. cpp:var:: map<string, Input> inputs
@@
@@     The warmup meta data associated with every model input, including
@@     control tensors.
@@
      map<string, .inference.ModelWarmup.Input> inputs = 3;

    • getInputsOrDefault

      ModelConfigOuterClass.ModelWarmup.Input getInputsOrDefault(String key, ModelConfigOuterClass.ModelWarmup.Input defaultValue)
      @@  .. cpp:var:: map<string, Input> inputs
@@
@@     The warmup meta data associated with every model input, including
@@     control tensors.
@@
      map<string, .inference.ModelWarmup.Input> inputs = 3;

    • getInputsOrThrow

      ModelConfigOuterClass.ModelWarmup.Input getInputsOrThrow(String key)
      @@  .. cpp:var:: map<string, Input> inputs
@@
@@     The warmup meta data associated with every model input, including
@@     control tensors.
@@
      map<string, .inference.ModelWarmup.Input> inputs = 3;

    • getCount

      int getCount()
      @@  .. cpp:var:: uint32 count
@@
@@     The number of iterations that this warmup sample will be executed.
@@     For example, if this field is set to 2, 2 model executions using this
@@     sample will be scheduled for warmup. Default value is 0 which
@@     indicates that this sample will be used only once.
@@     Note that for sequence model, 'count' may not work well
@@     because the model often expect a valid sequence of requests which
@@     should be represented by a series of warmup samples. 'count > 1'
@@     essentially "resends" one of the sample, which may invalidate the
@@     sequence and result in unexpected warmup failure.
@@
      uint32 count = 4;
      Returns:
      The count.