Uses of Class
com.gencior.triton.core.InferParameters
Packages that use InferParameters
Package
Description
-
Uses of InferParameters in com.gencior.triton
Methods in com.gencior.triton with parameters of type InferParametersModifier and TypeMethodDescriptionTritonClient.infer(String modelId, String modelVersion, List<InferInput> inputs, InferParameters customParameters) TritonClient.infer(String modelId, String modelVersion, List<InferInput> inputs, List<InferRequestedOutput> outputs, InferParameters customParameters) TritonClient.inferAsync(String modelId, String modelVersion, List<InferInput> inputs, InferParameters customParameters) TritonClient.inferAsync(String modelId, String modelVersion, List<InferInput> inputs, List<InferRequestedOutput> outputs, InferParameters customParameters) TritonClient.inferStream(String modelId, String modelVersion, List<InferInput> inputs, InferParameters customParameters, InferStreamListener listener) TritonClient.inferStream(String modelId, String modelVersion, List<InferInput> inputs, List<InferRequestedOutput> outputs, InferParameters customParameters, InferStreamListener listener) TritonClient.inferStreamPublisher(String modelId, String modelVersion, List<InferInput> inputs, InferParameters customParameters) TritonClient.inferStreamPublisher(String modelId, String modelVersion, List<InferInput> inputs, List<InferRequestedOutput> outputs, InferParameters customParameters) -
Uses of InferParameters in com.gencior.triton.core
Methods in com.gencior.triton.core that return InferParametersModifier and TypeMethodDescriptionInferParameters.Builder.build()Builds and returns a newInferParametersinstance. -
Uses of InferParameters in com.gencior.triton.grpc
Methods in com.gencior.triton.grpc with parameters of type InferParametersModifier and TypeMethodDescriptionTritonGrpcClient.infer(String modelId, String modelVersion, List<InferInput> inputs, InferParameters customParameters) Performs a synchronous (blocking) inference request with custom parameters.TritonGrpcClient.infer(String modelId, String modelVersion, List<InferInput> inputs, List<InferRequestedOutput> outputs, InferParameters customParameters) TritonGrpcClient.inferAsync(String modelId, String modelVersion, List<InferInput> inputs, InferParameters customParameters) Performs an asynchronous (non-blocking) inference request with custom parameters.TritonGrpcClient.inferAsync(String modelId, String modelVersion, List<InferInput> inputs, List<InferRequestedOutput> outputs, InferParameters customParameters) TritonGrpcClient.inferStream(String modelId, String modelVersion, List<InferInput> inputs, InferParameters customParameters, InferStreamListener listener) Performs a streaming inference request with callback-based token delivery.TritonGrpcClient.inferStream(String modelId, String modelVersion, List<InferInput> inputs, List<InferRequestedOutput> outputs, InferParameters customParameters, InferStreamListener listener) TritonGrpcClient.inferStreamPublisher(String modelId, String modelVersion, List<InferInput> inputs, InferParameters customParameters) Performs a streaming inference request returning a reactiveFlow.Publisher.TritonGrpcClient.inferStreamPublisher(String modelId, String modelVersion, List<InferInput> inputs, List<InferRequestedOutput> outputs, InferParameters customParameters) -
Uses of InferParameters in com.gencior.triton.http
Methods in com.gencior.triton.http with parameters of type InferParametersModifier and TypeMethodDescriptionTritonHttpClient.infer(String modelId, String modelVersion, List<InferInput> inputs, InferParameters customParameters) TritonHttpClient.infer(String modelId, String modelVersion, List<InferInput> inputs, List<InferRequestedOutput> outputs, InferParameters customParameters) TritonHttpClient.inferAsync(String modelId, String modelVersion, List<InferInput> inputs, InferParameters customParameters) TritonHttpClient.inferAsync(String modelId, String modelVersion, List<InferInput> inputs, List<InferRequestedOutput> outputs, InferParameters customParameters) TritonHttpClient.inferStream(String modelId, String modelVersion, List<InferInput> inputs, InferParameters customParameters, InferStreamListener listener) TritonHttpClient.inferStream(String modelId, String modelVersion, List<InferInput> inputs, List<InferRequestedOutput> outputs, InferParameters customParameters, InferStreamListener listener) TritonHttpClient.inferStreamPublisher(String modelId, String modelVersion, List<InferInput> inputs, InferParameters customParameters) TritonHttpClient.inferStreamPublisher(String modelId, String modelVersion, List<InferInput> inputs, List<InferRequestedOutput> outputs, InferParameters customParameters)