Uses of Class
com.gencior.triton.core.InferStreamHandle
Packages that use InferStreamHandle
-
Uses of InferStreamHandle in com.gencior.triton
Methods in com.gencior.triton that return InferStreamHandleModifier and TypeMethodDescriptionTritonClient.inferStream(String modelId, String modelVersion, List<InferInput> inputs, InferParameters customParameters, InferStreamListener listener) TritonClient.inferStream(String modelId, String modelVersion, List<InferInput> inputs, List<InferRequestedOutput> outputs, InferParameters customParameters, InferStreamListener listener) TritonClient.inferStream(String modelId, List<InferInput> inputs, InferStreamListener listener) -
Uses of InferStreamHandle in com.gencior.triton.grpc
Methods in com.gencior.triton.grpc that return InferStreamHandleModifier and TypeMethodDescriptionTritonGrpcClient.inferStream(String modelId, String modelVersion, List<InferInput> inputs, InferParameters customParameters, InferStreamListener listener) Performs a streaming inference request with callback-based token delivery.TritonGrpcClient.inferStream(String modelId, String modelVersion, List<InferInput> inputs, List<InferRequestedOutput> outputs, InferParameters customParameters, InferStreamListener listener) TritonGrpcClient.inferStream(String modelId, List<InferInput> inputs, InferStreamListener listener) -
Uses of InferStreamHandle in com.gencior.triton.http
Methods in com.gencior.triton.http that return InferStreamHandleModifier and TypeMethodDescriptionTritonHttpClient.inferStream(String modelId, String modelVersion, List<InferInput> inputs, InferParameters customParameters, InferStreamListener listener) TritonHttpClient.inferStream(String modelId, String modelVersion, List<InferInput> inputs, List<InferRequestedOutput> outputs, InferParameters customParameters, InferStreamListener listener) TritonHttpClient.inferStream(String modelId, List<InferInput> inputs, InferStreamListener listener)