Package com.gencior.triton.http
Class TritonHttpClient
java.lang.Object
com.gencior.triton.http.TritonHttpClient
- All Implemented Interfaces:
TritonClient,AutoCloseable
- Author:
- sachachoumiloff
-
Constructor Summary
Constructors -
Method Summary
Modifier and TypeMethodDescriptionvoidclose()getInferenceStatistics(String modelId, String modelVersion) getModelConfig(String modelId) getModelConfig(String modelId, String modelVersion) getModelMetadata(String modelId, String modelVersion) infer(String modelId, String modelVersion, List<InferInput> inputs, Map<String, GrpcService.InferParameter> customParameters) infer(String modelId, List<InferInput> inputs) inferAsync(String modelId, String modelVersion, List<InferInput> inputs, Map<String, GrpcService.InferParameter> customParameters) inferAsync(String modelId, List<InferInput> inputs) booleanisModelReady(String modelId) booleanisModelReady(String modelId, String modelVersion) booleanbooleanvoidvoidunLoadModel(String modelId)
-
Constructor Details
-
TritonHttpClient
public TritonHttpClient()
-
-
Method Details
-
close
- Specified by:
closein interfaceAutoCloseable- Throws:
Exception
-
isServerLive
public boolean isServerLive()- Specified by:
isServerLivein interfaceTritonClient
-
isServerReady
public boolean isServerReady()- Specified by:
isServerReadyin interfaceTritonClient
-
getServerMetadata
- Specified by:
getServerMetadatain interfaceTritonClient
-
isModelReady
- Specified by:
isModelReadyin interfaceTritonClient
-
isModelReady
- Specified by:
isModelReadyin interfaceTritonClient
-
getModelMetadata
- Specified by:
getModelMetadatain interfaceTritonClient
-
getModelConfig
- Specified by:
getModelConfigin interfaceTritonClient
-
getModelConfig
- Specified by:
getModelConfigin interfaceTritonClient
-
getModelRepositoryIndex
- Specified by:
getModelRepositoryIndexin interfaceTritonClient
-
loadModel
- Specified by:
loadModelin interfaceTritonClient
-
unLoadModel
- Specified by:
unLoadModelin interfaceTritonClient
-
getInferenceStatistics
- Specified by:
getInferenceStatisticsin interfaceTritonClient
-
infer
- Specified by:
inferin interfaceTritonClient
-
infer
public InferResult infer(String modelId, String modelVersion, List<InferInput> inputs, Map<String, GrpcService.InferParameter> customParameters) - Specified by:
inferin interfaceTritonClient
-
inferAsync
- Specified by:
inferAsyncin interfaceTritonClient
-
inferAsync
public CompletableFuture<InferResult> inferAsync(String modelId, String modelVersion, List<InferInput> inputs, Map<String, GrpcService.InferParameter> customParameters) - Specified by:
inferAsyncin interfaceTritonClient
-