Uses of Class
com.gencior.triton.core.pojo.TritonStatisticDuration
Packages that use TritonStatisticDuration
-
Uses of TritonStatisticDuration in com.gencior.triton.core.pojo
Methods in com.gencior.triton.core.pojo that return TritonStatisticDurationModifier and TypeMethodDescriptionstatic TritonStatisticDurationTritonStatisticDuration.fromProto(GrpcService.StatisticDuration proto) TritonInferStatistics.getCacheHit()Returns statistics for inferences that hit the result cache.TritonInferStatistics.getCacheMiss()Returns statistics for inferences that missed the result cache.TritonInferResponseStatistics.getCancel()Returns statistics for cancelled inference requests.TritonInferResponseStatistics.getComputeInfer()Returns statistics for the time spent in model inference computation.TritonInferStatistics.getComputeInfer()Returns statistics for time spent in inference computation.TritonInferStatistics.getComputeInput()Returns statistics for time spent preparing input tensors.TritonInferResponseStatistics.getComputeOutput()Returns statistics for the time spent preparing output tensors.TritonInferStatistics.getComputeOutput()Returns statistics for time spent in model inference computation.TritonInferResponseStatistics.getEmptyResponse()Returns statistics for inference requests with empty responses.TritonInferResponseStatistics.getFail()Returns statistics for inference requests that failed.TritonInferStatistics.getFail()Returns statistics for failed inferences.TritonInferStatistics.getQueue()Returns statistics for time spent in the request queue.TritonInferResponseStatistics.getSuccess()Returns statistics for successfully completed inference requests.TritonInferStatistics.getSuccess()Returns statistics for successfully completed inferences.