Package inference

Interface GrpcService.ModelInferRequestOrBuilder

All Superinterfaces:
com.google.protobuf.MessageLiteOrBuilder, com.google.protobuf.MessageOrBuilder
All Known Implementing Classes:
GrpcService.ModelInferRequest, GrpcService.ModelInferRequest.Builder
Enclosing class:
GrpcService
public static interface GrpcService.ModelInferRequestOrBuilder extends com.google.protobuf.MessageOrBuilder

  • Method Details

    • getModelName

      String getModelName()
      @@  .. cpp:var:: string model_name
@@
@@     The name of the model to use for inferencing.
@@
      string model_name = 1;
      Returns:
      The modelName.

    • getModelNameBytes

      com.google.protobuf.ByteString getModelNameBytes()
      @@  .. cpp:var:: string model_name
@@
@@     The name of the model to use for inferencing.
@@
      string model_name = 1;
      Returns:
      The bytes for modelName.

    • getModelVersion

      String getModelVersion()
      @@  .. cpp:var:: string model_version
@@
@@     The version of the model to use for inference. If not
@@     given the latest/most-recent version of the model is used.
@@
      string model_version = 2;
      Returns:
      The modelVersion.

    • getModelVersionBytes

      com.google.protobuf.ByteString getModelVersionBytes()
      @@  .. cpp:var:: string model_version
@@
@@     The version of the model to use for inference. If not
@@     given the latest/most-recent version of the model is used.
@@
      string model_version = 2;
      Returns:
      The bytes for modelVersion.

    • getId

      String getId()
      @@  .. cpp:var:: string id
@@
@@     Optional identifier for the request. If specified will be
@@     returned in the response.
@@
      string id = 3;
      Returns:
      The id.

    • getIdBytes

      com.google.protobuf.ByteString getIdBytes()
      @@  .. cpp:var:: string id
@@
@@     Optional identifier for the request. If specified will be
@@     returned in the response.
@@
      string id = 3;
      Returns:
      The bytes for id.

    • getParametersCount

      int getParametersCount()
      @@  .. cpp:var:: map<string,InferParameter> parameters
@@
@@     Optional inference parameters.
@@
      map<string, .inference.InferParameter> parameters = 4;

    • containsParameters

      boolean containsParameters(String key)
      @@  .. cpp:var:: map<string,InferParameter> parameters
@@
@@     Optional inference parameters.
@@
      map<string, .inference.InferParameter> parameters = 4;

    • getParameters

      @Deprecated Map<String,GrpcService.InferParameter> getParameters()
      Deprecated.
      Use getParametersMap() instead.

    • getParametersMap

      Map<String,GrpcService.InferParameter> getParametersMap()
      @@  .. cpp:var:: map<string,InferParameter> parameters
@@
@@     Optional inference parameters.
@@
      map<string, .inference.InferParameter> parameters = 4;

    • getParametersOrDefault

      GrpcService.InferParameter getParametersOrDefault(String key, GrpcService.InferParameter defaultValue)
      @@  .. cpp:var:: map<string,InferParameter> parameters
@@
@@     Optional inference parameters.
@@
      map<string, .inference.InferParameter> parameters = 4;

    • getParametersOrThrow

      GrpcService.InferParameter getParametersOrThrow(String key)
      @@  .. cpp:var:: map<string,InferParameter> parameters
@@
@@     Optional inference parameters.
@@
      map<string, .inference.InferParameter> parameters = 4;

    • getInputsList

      List<GrpcService.ModelInferRequest.InferInputTensor> getInputsList()
      @@
@@  .. cpp:var:: InferInputTensor inputs (repeated)
@@
@@     The input tensors for the inference.
@@
      repeated .inference.ModelInferRequest.InferInputTensor inputs = 5;

    • getInputs

      GrpcService.ModelInferRequest.InferInputTensor getInputs(int index)
      @@
@@  .. cpp:var:: InferInputTensor inputs (repeated)
@@
@@     The input tensors for the inference.
@@
      repeated .inference.ModelInferRequest.InferInputTensor inputs = 5;

    • getInputsCount

      int getInputsCount()
      @@
@@  .. cpp:var:: InferInputTensor inputs (repeated)
@@
@@     The input tensors for the inference.
@@
      repeated .inference.ModelInferRequest.InferInputTensor inputs = 5;

    • getInputsOrBuilderList

      List<? extends GrpcService.ModelInferRequest.InferInputTensorOrBuilder> getInputsOrBuilderList()
      @@
@@  .. cpp:var:: InferInputTensor inputs (repeated)
@@
@@     The input tensors for the inference.
@@
      repeated .inference.ModelInferRequest.InferInputTensor inputs = 5;

    • getInputsOrBuilder

      GrpcService.ModelInferRequest.InferInputTensorOrBuilder getInputsOrBuilder(int index)
      @@
@@  .. cpp:var:: InferInputTensor inputs (repeated)
@@
@@     The input tensors for the inference.
@@
      repeated .inference.ModelInferRequest.InferInputTensor inputs = 5;

    • getOutputsList

      List<GrpcService.ModelInferRequest.InferRequestedOutputTensor> getOutputsList()
      @@
@@  .. cpp:var:: InferRequestedOutputTensor outputs (repeated)
@@
@@     The requested output tensors for the inference. Optional, if not
@@     specified all outputs specified in the model config will be
@@     returned.
@@
      repeated .inference.ModelInferRequest.InferRequestedOutputTensor outputs = 6;

    • getOutputs

      GrpcService.ModelInferRequest.InferRequestedOutputTensor getOutputs(int index)
      @@
@@  .. cpp:var:: InferRequestedOutputTensor outputs (repeated)
@@
@@     The requested output tensors for the inference. Optional, if not
@@     specified all outputs specified in the model config will be
@@     returned.
@@
      repeated .inference.ModelInferRequest.InferRequestedOutputTensor outputs = 6;

    • getOutputsCount

      int getOutputsCount()
      @@
@@  .. cpp:var:: InferRequestedOutputTensor outputs (repeated)
@@
@@     The requested output tensors for the inference. Optional, if not
@@     specified all outputs specified in the model config will be
@@     returned.
@@
      repeated .inference.ModelInferRequest.InferRequestedOutputTensor outputs = 6;

    • getOutputsOrBuilderList

      List<? extends GrpcService.ModelInferRequest.InferRequestedOutputTensorOrBuilder> getOutputsOrBuilderList()
      @@
@@  .. cpp:var:: InferRequestedOutputTensor outputs (repeated)
@@
@@     The requested output tensors for the inference. Optional, if not
@@     specified all outputs specified in the model config will be
@@     returned.
@@
      repeated .inference.ModelInferRequest.InferRequestedOutputTensor outputs = 6;

    • getOutputsOrBuilder

      GrpcService.ModelInferRequest.InferRequestedOutputTensorOrBuilder getOutputsOrBuilder(int index)
      @@
@@  .. cpp:var:: InferRequestedOutputTensor outputs (repeated)
@@
@@     The requested output tensors for the inference. Optional, if not
@@     specified all outputs specified in the model config will be
@@     returned.
@@
      repeated .inference.ModelInferRequest.InferRequestedOutputTensor outputs = 6;

    • getRawInputContentsList

      List<com.google.protobuf.ByteString> getRawInputContentsList()
      @@
@@  .. cpp:var:: bytes raw_input_contents
@@
@@     The data contained in an input tensor can be represented in
@@     "raw" bytes form or in the repeated type that matches the
@@     tensor's data type. Using the "raw" bytes form will
@@     typically allow higher performance due to the way protobuf
@@     allocation and reuse interacts with GRPC. For example, see
@@     https://github.com/grpc/grpc/issues/23231.
@@
@@     To use the raw representation 'raw_input_contents' must be
@@     initialized with data for each tensor in the same order as
@@     'inputs'. For each tensor, the size of this content must
@@     match what is expected by the tensor's shape and data
@@     type. The raw data must be the flattened, one-dimensional,
@@     row-major order of the tensor elements without any stride
@@     or padding between the elements. Note that the FP16 and BF16 data
@@     types must be represented as raw content as there is no
@@     specific data type for a 16-bit float type.
@@
@@     If this field is specified then InferInputTensor::contents
@@     must not be specified for any input tensor.
@@
      repeated bytes raw_input_contents = 7;
      Returns:
      A list containing the rawInputContents.

    • getRawInputContentsCount

      int getRawInputContentsCount()
      @@
@@  .. cpp:var:: bytes raw_input_contents
@@
@@     The data contained in an input tensor can be represented in
@@     "raw" bytes form or in the repeated type that matches the
@@     tensor's data type. Using the "raw" bytes form will
@@     typically allow higher performance due to the way protobuf
@@     allocation and reuse interacts with GRPC. For example, see
@@     https://github.com/grpc/grpc/issues/23231.
@@
@@     To use the raw representation 'raw_input_contents' must be
@@     initialized with data for each tensor in the same order as
@@     'inputs'. For each tensor, the size of this content must
@@     match what is expected by the tensor's shape and data
@@     type. The raw data must be the flattened, one-dimensional,
@@     row-major order of the tensor elements without any stride
@@     or padding between the elements. Note that the FP16 and BF16 data
@@     types must be represented as raw content as there is no
@@     specific data type for a 16-bit float type.
@@
@@     If this field is specified then InferInputTensor::contents
@@     must not be specified for any input tensor.
@@
      repeated bytes raw_input_contents = 7;
      Returns:
      The count of rawInputContents.

    • getRawInputContents

      com.google.protobuf.ByteString getRawInputContents(int index)
      @@
@@  .. cpp:var:: bytes raw_input_contents
@@
@@     The data contained in an input tensor can be represented in
@@     "raw" bytes form or in the repeated type that matches the
@@     tensor's data type. Using the "raw" bytes form will
@@     typically allow higher performance due to the way protobuf
@@     allocation and reuse interacts with GRPC. For example, see
@@     https://github.com/grpc/grpc/issues/23231.
@@
@@     To use the raw representation 'raw_input_contents' must be
@@     initialized with data for each tensor in the same order as
@@     'inputs'. For each tensor, the size of this content must
@@     match what is expected by the tensor's shape and data
@@     type. The raw data must be the flattened, one-dimensional,
@@     row-major order of the tensor elements without any stride
@@     or padding between the elements. Note that the FP16 and BF16 data
@@     types must be represented as raw content as there is no
@@     specific data type for a 16-bit float type.
@@
@@     If this field is specified then InferInputTensor::contents
@@     must not be specified for any input tensor.
@@
      repeated bytes raw_input_contents = 7;
      Parameters:
      index - The index of the element to return.
      Returns:
      The rawInputContents at the given index.