Package com.gencior.triton
Interface TritonClient
- All Superinterfaces:
AutoCloseable
- All Known Implementing Classes:
TritonGrpcClient,TritonHttpClient
- Author:
- sachachoumiloff
-
Method Summary
Modifier and TypeMethodDescriptiongetInferenceStatistics(String modelId, String modelVersion) getModelConfig(String modelId) getModelConfig(String modelId, String modelVersion) getModelMetadata(String modelId, String modelVersion) infer(String modelId, String modelVersion, List<InferInput> inputs, Map<String, GrpcService.InferParameter> customParameters) infer(String modelId, List<InferInput> inputs) inferAsync(String modelId, String modelVersion, List<InferInput> inputs, Map<String, GrpcService.InferParameter> customParameters) inferAsync(String modelId, List<InferInput> inputs) booleanisModelReady(String modelId) booleanisModelReady(String modelId, String modelVersion) booleanbooleanvoidvoidunLoadModel(String modelId) Methods inherited from interface java.lang.AutoCloseable
close
-
Method Details
-
isServerLive
boolean isServerLive() -
isServerReady
boolean isServerReady() -
getServerMetadata
TritonServerMetadata getServerMetadata() -
isModelReady
-
isModelReady
-
getModelMetadata
-
getModelConfig
-
getModelConfig
-
getModelRepositoryIndex
TritonRepositoryIndex getModelRepositoryIndex() -
loadModel
-
unLoadModel
-
getInferenceStatistics
-
infer
-
infer
InferResult infer(String modelId, String modelVersion, List<InferInput> inputs, Map<String, GrpcService.InferParameter> customParameters) -
inferAsync
-
inferAsync
CompletableFuture<InferResult> inferAsync(String modelId, String modelVersion, List<InferInput> inputs, Map<String, GrpcService.InferParameter> customParameters)
-