Uses of Class
com.gencior.triton.core.InferResult
Packages that use InferResult
Package
Description
-
Uses of InferResult in com.gencior.triton
Methods in com.gencior.triton that return InferResultModifier and TypeMethodDescriptionTritonClient.infer(String modelId, String modelVersion, List<InferInput> inputs, InferParameters customParameters) TritonClient.infer(String modelId, String modelVersion, List<InferInput> inputs, List<InferRequestedOutput> outputs, InferParameters customParameters) TritonClient.infer(String modelId, List<InferInput> inputs) Methods in com.gencior.triton that return types with arguments of type InferResultModifier and TypeMethodDescriptionTritonClient.inferAsync(String modelId, String modelVersion, List<InferInput> inputs, InferParameters customParameters) TritonClient.inferAsync(String modelId, String modelVersion, List<InferInput> inputs, List<InferRequestedOutput> outputs, InferParameters customParameters) TritonClient.inferAsync(String modelId, List<InferInput> inputs) TritonClient.inferStreamPublisher(String modelId, String modelVersion, List<InferInput> inputs, InferParameters customParameters) TritonClient.inferStreamPublisher(String modelId, String modelVersion, List<InferInput> inputs, List<InferRequestedOutput> outputs, InferParameters customParameters) TritonClient.inferStreamPublisher(String modelId, List<InferInput> inputs) -
Uses of InferResult in com.gencior.triton.core
Methods in com.gencior.triton.core with parameters of type InferResultModifier and TypeMethodDescriptionvoidInferStreamListener.onToken(InferResult result) Called for each streamed inference result (token). -
Uses of InferResult in com.gencior.triton.grpc
Methods in com.gencior.triton.grpc that return InferResultModifier and TypeMethodDescriptionTritonGrpcClient.infer(String modelId, String modelVersion, List<InferInput> inputs, InferParameters customParameters) Performs a synchronous (blocking) inference request with custom parameters.TritonGrpcClient.infer(String modelId, String modelVersion, List<InferInput> inputs, List<InferRequestedOutput> outputs, InferParameters customParameters) TritonGrpcClient.infer(String modelId, List<InferInput> inputs) Performs a synchronous (blocking) inference request.Methods in com.gencior.triton.grpc that return types with arguments of type InferResultModifier and TypeMethodDescriptionTritonGrpcClient.inferAsync(String modelId, String modelVersion, List<InferInput> inputs, InferParameters customParameters) Performs an asynchronous (non-blocking) inference request with custom parameters.TritonGrpcClient.inferAsync(String modelId, String modelVersion, List<InferInput> inputs, List<InferRequestedOutput> outputs, InferParameters customParameters) TritonGrpcClient.inferAsync(String modelId, List<InferInput> inputs) Performs an asynchronous (non-blocking) inference request.TritonGrpcClient.inferStreamPublisher(String modelId, String modelVersion, List<InferInput> inputs, InferParameters customParameters) Performs a streaming inference request returning a reactiveFlow.Publisher.TritonGrpcClient.inferStreamPublisher(String modelId, String modelVersion, List<InferInput> inputs, List<InferRequestedOutput> outputs, InferParameters customParameters) TritonGrpcClient.inferStreamPublisher(String modelId, List<InferInput> inputs) -
Uses of InferResult in com.gencior.triton.http
Methods in com.gencior.triton.http that return InferResultModifier and TypeMethodDescriptionTritonHttpClient.infer(String modelId, String modelVersion, List<InferInput> inputs, InferParameters customParameters) TritonHttpClient.infer(String modelId, String modelVersion, List<InferInput> inputs, List<InferRequestedOutput> outputs, InferParameters customParameters) TritonHttpClient.infer(String modelId, List<InferInput> inputs) Methods in com.gencior.triton.http that return types with arguments of type InferResultModifier and TypeMethodDescriptionTritonHttpClient.inferAsync(String modelId, String modelVersion, List<InferInput> inputs, InferParameters customParameters) TritonHttpClient.inferAsync(String modelId, String modelVersion, List<InferInput> inputs, List<InferRequestedOutput> outputs, InferParameters customParameters) TritonHttpClient.inferAsync(String modelId, List<InferInput> inputs) TritonHttpClient.inferStreamPublisher(String modelId, String modelVersion, List<InferInput> inputs, InferParameters customParameters) TritonHttpClient.inferStreamPublisher(String modelId, String modelVersion, List<InferInput> inputs, List<InferRequestedOutput> outputs, InferParameters customParameters) TritonHttpClient.inferStreamPublisher(String modelId, List<InferInput> inputs)