Uses of Interface
inference.GrpcService.StatisticDurationOrBuilder
Packages that use GrpcService.StatisticDurationOrBuilder
-
Uses of GrpcService.StatisticDurationOrBuilder in inference
Classes in inference that implement GrpcService.StatisticDurationOrBuilderModifier and TypeClassDescriptionstatic final class@@ @@.. cpp:var:: message StatisticDuration @@ @@ Statistic recording a cumulative duration metric.static final class@@ @@.. cpp:var:: message StatisticDuration @@ @@ Statistic recording a cumulative duration metric.Methods in inference that return GrpcService.StatisticDurationOrBuilderModifier and TypeMethodDescriptionGrpcService.InferStatistics.Builder.getCacheHitOrBuilder()@@ .. cpp:var:: StatisticDuration cache_hit @@ @@ The count of response cache hits and cumulative duration to lookup @@ and extract output tensor data from the Response Cache on a cache @@ hit.GrpcService.InferStatistics.getCacheHitOrBuilder()@@ .. cpp:var:: StatisticDuration cache_hit @@ @@ The count of response cache hits and cumulative duration to lookup @@ and extract output tensor data from the Response Cache on a cache @@ hit.GrpcService.InferStatisticsOrBuilder.getCacheHitOrBuilder()@@ .. cpp:var:: StatisticDuration cache_hit @@ @@ The count of response cache hits and cumulative duration to lookup @@ and extract output tensor data from the Response Cache on a cache @@ hit.GrpcService.InferStatistics.Builder.getCacheMissOrBuilder()@@ .. cpp:var:: StatisticDuration cache_miss @@ @@ The count of response cache misses and cumulative duration to lookup @@ and insert output tensor data from the computed response to the cache.GrpcService.InferStatistics.getCacheMissOrBuilder()@@ .. cpp:var:: StatisticDuration cache_miss @@ @@ The count of response cache misses and cumulative duration to lookup @@ and insert output tensor data from the computed response to the cache.GrpcService.InferStatisticsOrBuilder.getCacheMissOrBuilder()@@ .. cpp:var:: StatisticDuration cache_miss @@ @@ The count of response cache misses and cumulative duration to lookup @@ and insert output tensor data from the computed response to the cache.GrpcService.InferResponseStatistics.Builder.getCancelOrBuilder()@@ .. cpp:var:: StatisticDuration cancel @@ @@ The count and cumulative duration, for cleaning up resources held by @@ a cancelled request, for cancelled responses.GrpcService.InferResponseStatistics.getCancelOrBuilder()@@ .. cpp:var:: StatisticDuration cancel @@ @@ The count and cumulative duration, for cleaning up resources held by @@ a cancelled request, for cancelled responses.GrpcService.InferResponseStatisticsOrBuilder.getCancelOrBuilder()@@ .. cpp:var:: StatisticDuration cancel @@ @@ The count and cumulative duration, for cleaning up resources held by @@ a cancelled request, for cancelled responses.GrpcService.InferBatchStatistics.Builder.getComputeInferOrBuilder()@@ .. cpp:var:: StatisticDuration compute_infer @@ @@ The count and cumulative duration to execute the model with the given @@ batch size.GrpcService.InferBatchStatistics.getComputeInferOrBuilder()@@ .. cpp:var:: StatisticDuration compute_infer @@ @@ The count and cumulative duration to execute the model with the given @@ batch size.GrpcService.InferBatchStatisticsOrBuilder.getComputeInferOrBuilder()@@ .. cpp:var:: StatisticDuration compute_infer @@ @@ The count and cumulative duration to execute the model with the given @@ batch size.GrpcService.InferResponseStatistics.Builder.getComputeInferOrBuilder()@@ .. cpp:var:: StatisticDuration compute_infer @@ @@ The count and cumulative duration to compute a response.GrpcService.InferResponseStatistics.getComputeInferOrBuilder()@@ .. cpp:var:: StatisticDuration compute_infer @@ @@ The count and cumulative duration to compute a response.GrpcService.InferResponseStatisticsOrBuilder.getComputeInferOrBuilder()@@ .. cpp:var:: StatisticDuration compute_infer @@ @@ The count and cumulative duration to compute a response.GrpcService.InferStatistics.Builder.getComputeInferOrBuilder()@@ .. cpp:var:: StatisticDuration compute_infer @@ @@ The count and cumulative duration to execute the model.GrpcService.InferStatistics.getComputeInferOrBuilder()@@ .. cpp:var:: StatisticDuration compute_infer @@ @@ The count and cumulative duration to execute the model.GrpcService.InferStatisticsOrBuilder.getComputeInferOrBuilder()@@ .. cpp:var:: StatisticDuration compute_infer @@ @@ The count and cumulative duration to execute the model.GrpcService.InferBatchStatistics.Builder.getComputeInputOrBuilder()@@ .. cpp:var:: StatisticDuration compute_input @@ @@ The count and cumulative duration to prepare input tensor data as @@ required by the model framework / backend with the given batch size.GrpcService.InferBatchStatistics.getComputeInputOrBuilder()@@ .. cpp:var:: StatisticDuration compute_input @@ @@ The count and cumulative duration to prepare input tensor data as @@ required by the model framework / backend with the given batch size.GrpcService.InferBatchStatisticsOrBuilder.getComputeInputOrBuilder()@@ .. cpp:var:: StatisticDuration compute_input @@ @@ The count and cumulative duration to prepare input tensor data as @@ required by the model framework / backend with the given batch size.GrpcService.InferStatistics.Builder.getComputeInputOrBuilder()@@ .. cpp:var:: StatisticDuration compute_input @@ @@ The count and cumulative duration to prepare input tensor data as @@ required by the model framework / backend.GrpcService.InferStatistics.getComputeInputOrBuilder()@@ .. cpp:var:: StatisticDuration compute_input @@ @@ The count and cumulative duration to prepare input tensor data as @@ required by the model framework / backend.GrpcService.InferStatisticsOrBuilder.getComputeInputOrBuilder()@@ .. cpp:var:: StatisticDuration compute_input @@ @@ The count and cumulative duration to prepare input tensor data as @@ required by the model framework / backend.GrpcService.InferBatchStatistics.Builder.getComputeOutputOrBuilder()@@ .. cpp:var:: StatisticDuration compute_output @@ @@ The count and cumulative duration to extract output tensor data @@ produced by the model framework / backend with the given batch size.GrpcService.InferBatchStatistics.getComputeOutputOrBuilder()@@ .. cpp:var:: StatisticDuration compute_output @@ @@ The count and cumulative duration to extract output tensor data @@ produced by the model framework / backend with the given batch size.GrpcService.InferBatchStatisticsOrBuilder.getComputeOutputOrBuilder()@@ .. cpp:var:: StatisticDuration compute_output @@ @@ The count and cumulative duration to extract output tensor data @@ produced by the model framework / backend with the given batch size.GrpcService.InferResponseStatistics.Builder.getComputeOutputOrBuilder()@@ .. cpp:var:: StatisticDuration compute_output @@ @@ The count and cumulative duration to extract the output tensors of a @@ response.GrpcService.InferResponseStatistics.getComputeOutputOrBuilder()@@ .. cpp:var:: StatisticDuration compute_output @@ @@ The count and cumulative duration to extract the output tensors of a @@ response.GrpcService.InferResponseStatisticsOrBuilder.getComputeOutputOrBuilder()@@ .. cpp:var:: StatisticDuration compute_output @@ @@ The count and cumulative duration to extract the output tensors of a @@ response.GrpcService.InferStatistics.Builder.getComputeOutputOrBuilder()@@ .. cpp:var:: StatisticDuration compute_output @@ @@ The count and cumulative duration to extract output tensor data @@ produced by the model framework / backend.GrpcService.InferStatistics.getComputeOutputOrBuilder()@@ .. cpp:var:: StatisticDuration compute_output @@ @@ The count and cumulative duration to extract output tensor data @@ produced by the model framework / backend.GrpcService.InferStatisticsOrBuilder.getComputeOutputOrBuilder()@@ .. cpp:var:: StatisticDuration compute_output @@ @@ The count and cumulative duration to extract output tensor data @@ produced by the model framework / backend.GrpcService.InferResponseStatistics.Builder.getEmptyResponseOrBuilder()@@ .. cpp:var:: StatisticDuration empty_response @@ @@ The count and cumulative duration for empty responses.GrpcService.InferResponseStatistics.getEmptyResponseOrBuilder()@@ .. cpp:var:: StatisticDuration empty_response @@ @@ The count and cumulative duration for empty responses.GrpcService.InferResponseStatisticsOrBuilder.getEmptyResponseOrBuilder()@@ .. cpp:var:: StatisticDuration empty_response @@ @@ The count and cumulative duration for empty responses.GrpcService.InferResponseStatistics.Builder.getFailOrBuilder()@@ .. cpp:var:: StatisticDuration fail @@ @@ The count and cumulative duration for failed responses.GrpcService.InferResponseStatistics.getFailOrBuilder()@@ .. cpp:var:: StatisticDuration fail @@ @@ The count and cumulative duration for failed responses.GrpcService.InferResponseStatisticsOrBuilder.getFailOrBuilder()@@ .. cpp:var:: StatisticDuration fail @@ @@ The count and cumulative duration for failed responses.GrpcService.InferStatistics.Builder.getFailOrBuilder()@@ .. cpp:var:: StatisticDuration fail @@ @@ Cumulative count and duration for failed inference @@ request.GrpcService.InferStatistics.getFailOrBuilder()@@ .. cpp:var:: StatisticDuration fail @@ @@ Cumulative count and duration for failed inference @@ request.GrpcService.InferStatisticsOrBuilder.getFailOrBuilder()@@ .. cpp:var:: StatisticDuration fail @@ @@ Cumulative count and duration for failed inference @@ request.GrpcService.InferStatistics.Builder.getQueueOrBuilder()@@ .. cpp:var:: StatisticDuration queue @@ @@ The count and cumulative duration that inference requests wait in @@ scheduling or other queues.GrpcService.InferStatistics.getQueueOrBuilder()@@ .. cpp:var:: StatisticDuration queue @@ @@ The count and cumulative duration that inference requests wait in @@ scheduling or other queues.GrpcService.InferStatisticsOrBuilder.getQueueOrBuilder()@@ .. cpp:var:: StatisticDuration queue @@ @@ The count and cumulative duration that inference requests wait in @@ scheduling or other queues.GrpcService.InferResponseStatistics.Builder.getSuccessOrBuilder()@@ .. cpp:var:: StatisticDuration success @@ @@ The count and cumulative duration for successful responses.GrpcService.InferResponseStatistics.getSuccessOrBuilder()@@ .. cpp:var:: StatisticDuration success @@ @@ The count and cumulative duration for successful responses.GrpcService.InferResponseStatisticsOrBuilder.getSuccessOrBuilder()@@ .. cpp:var:: StatisticDuration success @@ @@ The count and cumulative duration for successful responses.GrpcService.InferStatistics.Builder.getSuccessOrBuilder()@@ .. cpp:var:: StatisticDuration success @@ @@ Cumulative count and duration for successful inference @@ request.GrpcService.InferStatistics.getSuccessOrBuilder()@@ .. cpp:var:: StatisticDuration success @@ @@ Cumulative count and duration for successful inference @@ request.GrpcService.InferStatisticsOrBuilder.getSuccessOrBuilder()@@ .. cpp:var:: StatisticDuration success @@ @@ Cumulative count and duration for successful inference @@ request.