Uses of Class
com.gencior.triton.core.InferInput
Packages that use InferInput
Package
Description
-
Uses of InferInput in com.gencior.triton
Method parameters in com.gencior.triton with type arguments of type InferInputModifier and TypeMethodDescriptionTritonClient.infer(String modelId, String modelVersion, List<InferInput> inputs, InferParameters customParameters) TritonClient.infer(String modelId, String modelVersion, List<InferInput> inputs, List<InferRequestedOutput> outputs, InferParameters customParameters) TritonClient.infer(String modelId, List<InferInput> inputs) TritonClient.inferAsync(String modelId, String modelVersion, List<InferInput> inputs, InferParameters customParameters) TritonClient.inferAsync(String modelId, String modelVersion, List<InferInput> inputs, List<InferRequestedOutput> outputs, InferParameters customParameters) TritonClient.inferAsync(String modelId, List<InferInput> inputs) TritonClient.inferStream(String modelId, String modelVersion, List<InferInput> inputs, InferParameters customParameters, InferStreamListener listener) TritonClient.inferStream(String modelId, String modelVersion, List<InferInput> inputs, List<InferRequestedOutput> outputs, InferParameters customParameters, InferStreamListener listener) TritonClient.inferStream(String modelId, List<InferInput> inputs, InferStreamListener listener) TritonClient.inferStreamPublisher(String modelId, String modelVersion, List<InferInput> inputs, InferParameters customParameters) TritonClient.inferStreamPublisher(String modelId, String modelVersion, List<InferInput> inputs, List<InferRequestedOutput> outputs, InferParameters customParameters) TritonClient.inferStreamPublisher(String modelId, List<InferInput> inputs) -
Uses of InferInput in com.gencior.triton.core
Methods in com.gencior.triton.core that return InferInputModifier and TypeMethodDescriptionInferInput.setData(boolean[] data) Sets the tensor data from a boolean array.InferInput.setData(byte[] data) Sets the tensor data from raw bytes.InferInput.setData(double[] data) Sets the tensor data from a double array (FP64)InferInput.setData(float[] data) Sets the tensor data from a float array.InferInput.setData(int[] data) Sets the tensor data from an int array.InferInput.setData(long[] data) Sets the tensor data from a long array.InferInput.setData(short[] data) Sets the tensor data from a short array.Sets the tensor data from a String array (BYTES datatype).InferInput.setShape(long[] shape) Updates the shape of the input. -
Uses of InferInput in com.gencior.triton.grpc
Method parameters in com.gencior.triton.grpc with type arguments of type InferInputModifier and TypeMethodDescriptionTritonGrpcClient.infer(String modelId, String modelVersion, List<InferInput> inputs, InferParameters customParameters) Performs a synchronous (blocking) inference request with custom parameters.TritonGrpcClient.infer(String modelId, String modelVersion, List<InferInput> inputs, List<InferRequestedOutput> outputs, InferParameters customParameters) TritonGrpcClient.infer(String modelId, List<InferInput> inputs) Performs a synchronous (blocking) inference request.TritonGrpcClient.inferAsync(String modelId, String modelVersion, List<InferInput> inputs, InferParameters customParameters) Performs an asynchronous (non-blocking) inference request with custom parameters.TritonGrpcClient.inferAsync(String modelId, String modelVersion, List<InferInput> inputs, List<InferRequestedOutput> outputs, InferParameters customParameters) TritonGrpcClient.inferAsync(String modelId, List<InferInput> inputs) Performs an asynchronous (non-blocking) inference request.TritonGrpcClient.inferStream(String modelId, String modelVersion, List<InferInput> inputs, InferParameters customParameters, InferStreamListener listener) Performs a streaming inference request with callback-based token delivery.TritonGrpcClient.inferStream(String modelId, String modelVersion, List<InferInput> inputs, List<InferRequestedOutput> outputs, InferParameters customParameters, InferStreamListener listener) TritonGrpcClient.inferStream(String modelId, List<InferInput> inputs, InferStreamListener listener) TritonGrpcClient.inferStreamPublisher(String modelId, String modelVersion, List<InferInput> inputs, InferParameters customParameters) Performs a streaming inference request returning a reactiveFlow.Publisher.TritonGrpcClient.inferStreamPublisher(String modelId, String modelVersion, List<InferInput> inputs, List<InferRequestedOutput> outputs, InferParameters customParameters) TritonGrpcClient.inferStreamPublisher(String modelId, List<InferInput> inputs) -
Uses of InferInput in com.gencior.triton.http
Method parameters in com.gencior.triton.http with type arguments of type InferInputModifier and TypeMethodDescriptionTritonHttpClient.infer(String modelId, String modelVersion, List<InferInput> inputs, InferParameters customParameters) TritonHttpClient.infer(String modelId, String modelVersion, List<InferInput> inputs, List<InferRequestedOutput> outputs, InferParameters customParameters) TritonHttpClient.infer(String modelId, List<InferInput> inputs) TritonHttpClient.inferAsync(String modelId, String modelVersion, List<InferInput> inputs, InferParameters customParameters) TritonHttpClient.inferAsync(String modelId, String modelVersion, List<InferInput> inputs, List<InferRequestedOutput> outputs, InferParameters customParameters) TritonHttpClient.inferAsync(String modelId, List<InferInput> inputs) TritonHttpClient.inferStream(String modelId, String modelVersion, List<InferInput> inputs, InferParameters customParameters, InferStreamListener listener) TritonHttpClient.inferStream(String modelId, String modelVersion, List<InferInput> inputs, List<InferRequestedOutput> outputs, InferParameters customParameters, InferStreamListener listener) TritonHttpClient.inferStream(String modelId, List<InferInput> inputs, InferStreamListener listener) TritonHttpClient.inferStreamPublisher(String modelId, String modelVersion, List<InferInput> inputs, InferParameters customParameters) TritonHttpClient.inferStreamPublisher(String modelId, String modelVersion, List<InferInput> inputs, List<InferRequestedOutput> outputs, InferParameters customParameters) TritonHttpClient.inferStreamPublisher(String modelId, List<InferInput> inputs)