Uses of Class
inference.GrpcService.StatisticDuration
Packages that use GrpcService.StatisticDuration
-
Uses of GrpcService.StatisticDuration in com.gencior.triton.core.pojo
Methods in com.gencior.triton.core.pojo with parameters of type GrpcService.StatisticDurationModifier and TypeMethodDescriptionstatic TritonStatisticDurationTritonStatisticDuration.fromProto(GrpcService.StatisticDuration proto) -
Uses of GrpcService.StatisticDuration in inference
Methods in inference that return GrpcService.StatisticDurationModifier and TypeMethodDescriptionGrpcService.StatisticDuration.Builder.build()GrpcService.StatisticDuration.Builder.buildPartial()GrpcService.InferStatistics.Builder.getCacheHit()@@ .. cpp:var:: StatisticDuration cache_hit @@ @@ The count of response cache hits and cumulative duration to lookup @@ and extract output tensor data from the Response Cache on a cache @@ hit.GrpcService.InferStatistics.getCacheHit()@@ .. cpp:var:: StatisticDuration cache_hit @@ @@ The count of response cache hits and cumulative duration to lookup @@ and extract output tensor data from the Response Cache on a cache @@ hit.GrpcService.InferStatisticsOrBuilder.getCacheHit()@@ .. cpp:var:: StatisticDuration cache_hit @@ @@ The count of response cache hits and cumulative duration to lookup @@ and extract output tensor data from the Response Cache on a cache @@ hit.GrpcService.InferStatistics.Builder.getCacheMiss()@@ .. cpp:var:: StatisticDuration cache_miss @@ @@ The count of response cache misses and cumulative duration to lookup @@ and insert output tensor data from the computed response to the cache.GrpcService.InferStatistics.getCacheMiss()@@ .. cpp:var:: StatisticDuration cache_miss @@ @@ The count of response cache misses and cumulative duration to lookup @@ and insert output tensor data from the computed response to the cache.GrpcService.InferStatisticsOrBuilder.getCacheMiss()@@ .. cpp:var:: StatisticDuration cache_miss @@ @@ The count of response cache misses and cumulative duration to lookup @@ and insert output tensor data from the computed response to the cache.GrpcService.InferResponseStatistics.Builder.getCancel()@@ .. cpp:var:: StatisticDuration cancel @@ @@ The count and cumulative duration, for cleaning up resources held by @@ a cancelled request, for cancelled responses.GrpcService.InferResponseStatistics.getCancel()@@ .. cpp:var:: StatisticDuration cancel @@ @@ The count and cumulative duration, for cleaning up resources held by @@ a cancelled request, for cancelled responses.GrpcService.InferResponseStatisticsOrBuilder.getCancel()@@ .. cpp:var:: StatisticDuration cancel @@ @@ The count and cumulative duration, for cleaning up resources held by @@ a cancelled request, for cancelled responses.GrpcService.InferBatchStatistics.Builder.getComputeInfer()@@ .. cpp:var:: StatisticDuration compute_infer @@ @@ The count and cumulative duration to execute the model with the given @@ batch size.GrpcService.InferBatchStatistics.getComputeInfer()@@ .. cpp:var:: StatisticDuration compute_infer @@ @@ The count and cumulative duration to execute the model with the given @@ batch size.GrpcService.InferBatchStatisticsOrBuilder.getComputeInfer()@@ .. cpp:var:: StatisticDuration compute_infer @@ @@ The count and cumulative duration to execute the model with the given @@ batch size.GrpcService.InferResponseStatistics.Builder.getComputeInfer()@@ .. cpp:var:: StatisticDuration compute_infer @@ @@ The count and cumulative duration to compute a response.GrpcService.InferResponseStatistics.getComputeInfer()@@ .. cpp:var:: StatisticDuration compute_infer @@ @@ The count and cumulative duration to compute a response.GrpcService.InferResponseStatisticsOrBuilder.getComputeInfer()@@ .. cpp:var:: StatisticDuration compute_infer @@ @@ The count and cumulative duration to compute a response.GrpcService.InferStatistics.Builder.getComputeInfer()@@ .. cpp:var:: StatisticDuration compute_infer @@ @@ The count and cumulative duration to execute the model.GrpcService.InferStatistics.getComputeInfer()@@ .. cpp:var:: StatisticDuration compute_infer @@ @@ The count and cumulative duration to execute the model.GrpcService.InferStatisticsOrBuilder.getComputeInfer()@@ .. cpp:var:: StatisticDuration compute_infer @@ @@ The count and cumulative duration to execute the model.GrpcService.InferBatchStatistics.Builder.getComputeInput()@@ .. cpp:var:: StatisticDuration compute_input @@ @@ The count and cumulative duration to prepare input tensor data as @@ required by the model framework / backend with the given batch size.GrpcService.InferBatchStatistics.getComputeInput()@@ .. cpp:var:: StatisticDuration compute_input @@ @@ The count and cumulative duration to prepare input tensor data as @@ required by the model framework / backend with the given batch size.GrpcService.InferBatchStatisticsOrBuilder.getComputeInput()@@ .. cpp:var:: StatisticDuration compute_input @@ @@ The count and cumulative duration to prepare input tensor data as @@ required by the model framework / backend with the given batch size.GrpcService.InferStatistics.Builder.getComputeInput()@@ .. cpp:var:: StatisticDuration compute_input @@ @@ The count and cumulative duration to prepare input tensor data as @@ required by the model framework / backend.GrpcService.InferStatistics.getComputeInput()@@ .. cpp:var:: StatisticDuration compute_input @@ @@ The count and cumulative duration to prepare input tensor data as @@ required by the model framework / backend.GrpcService.InferStatisticsOrBuilder.getComputeInput()@@ .. cpp:var:: StatisticDuration compute_input @@ @@ The count and cumulative duration to prepare input tensor data as @@ required by the model framework / backend.GrpcService.InferBatchStatistics.Builder.getComputeOutput()@@ .. cpp:var:: StatisticDuration compute_output @@ @@ The count and cumulative duration to extract output tensor data @@ produced by the model framework / backend with the given batch size.GrpcService.InferBatchStatistics.getComputeOutput()@@ .. cpp:var:: StatisticDuration compute_output @@ @@ The count and cumulative duration to extract output tensor data @@ produced by the model framework / backend with the given batch size.GrpcService.InferBatchStatisticsOrBuilder.getComputeOutput()@@ .. cpp:var:: StatisticDuration compute_output @@ @@ The count and cumulative duration to extract output tensor data @@ produced by the model framework / backend with the given batch size.GrpcService.InferResponseStatistics.Builder.getComputeOutput()@@ .. cpp:var:: StatisticDuration compute_output @@ @@ The count and cumulative duration to extract the output tensors of a @@ response.GrpcService.InferResponseStatistics.getComputeOutput()@@ .. cpp:var:: StatisticDuration compute_output @@ @@ The count and cumulative duration to extract the output tensors of a @@ response.GrpcService.InferResponseStatisticsOrBuilder.getComputeOutput()@@ .. cpp:var:: StatisticDuration compute_output @@ @@ The count and cumulative duration to extract the output tensors of a @@ response.GrpcService.InferStatistics.Builder.getComputeOutput()@@ .. cpp:var:: StatisticDuration compute_output @@ @@ The count and cumulative duration to extract output tensor data @@ produced by the model framework / backend.GrpcService.InferStatistics.getComputeOutput()@@ .. cpp:var:: StatisticDuration compute_output @@ @@ The count and cumulative duration to extract output tensor data @@ produced by the model framework / backend.GrpcService.InferStatisticsOrBuilder.getComputeOutput()@@ .. cpp:var:: StatisticDuration compute_output @@ @@ The count and cumulative duration to extract output tensor data @@ produced by the model framework / backend.GrpcService.StatisticDuration.getDefaultInstance()GrpcService.StatisticDuration.Builder.getDefaultInstanceForType()GrpcService.StatisticDuration.getDefaultInstanceForType()GrpcService.InferResponseStatistics.Builder.getEmptyResponse()@@ .. cpp:var:: StatisticDuration empty_response @@ @@ The count and cumulative duration for empty responses.GrpcService.InferResponseStatistics.getEmptyResponse()@@ .. cpp:var:: StatisticDuration empty_response @@ @@ The count and cumulative duration for empty responses.GrpcService.InferResponseStatisticsOrBuilder.getEmptyResponse()@@ .. cpp:var:: StatisticDuration empty_response @@ @@ The count and cumulative duration for empty responses.GrpcService.InferResponseStatistics.Builder.getFail()@@ .. cpp:var:: StatisticDuration fail @@ @@ The count and cumulative duration for failed responses.GrpcService.InferResponseStatistics.getFail()@@ .. cpp:var:: StatisticDuration fail @@ @@ The count and cumulative duration for failed responses.GrpcService.InferResponseStatisticsOrBuilder.getFail()@@ .. cpp:var:: StatisticDuration fail @@ @@ The count and cumulative duration for failed responses.GrpcService.InferStatistics.Builder.getFail()@@ .. cpp:var:: StatisticDuration fail @@ @@ Cumulative count and duration for failed inference @@ request.GrpcService.InferStatistics.getFail()@@ .. cpp:var:: StatisticDuration fail @@ @@ Cumulative count and duration for failed inference @@ request.GrpcService.InferStatisticsOrBuilder.getFail()@@ .. cpp:var:: StatisticDuration fail @@ @@ Cumulative count and duration for failed inference @@ request.GrpcService.InferStatistics.Builder.getQueue()@@ .. cpp:var:: StatisticDuration queue @@ @@ The count and cumulative duration that inference requests wait in @@ scheduling or other queues.GrpcService.InferStatistics.getQueue()@@ .. cpp:var:: StatisticDuration queue @@ @@ The count and cumulative duration that inference requests wait in @@ scheduling or other queues.GrpcService.InferStatisticsOrBuilder.getQueue()@@ .. cpp:var:: StatisticDuration queue @@ @@ The count and cumulative duration that inference requests wait in @@ scheduling or other queues.GrpcService.InferResponseStatistics.Builder.getSuccess()@@ .. cpp:var:: StatisticDuration success @@ @@ The count and cumulative duration for successful responses.GrpcService.InferResponseStatistics.getSuccess()@@ .. cpp:var:: StatisticDuration success @@ @@ The count and cumulative duration for successful responses.GrpcService.InferResponseStatisticsOrBuilder.getSuccess()@@ .. cpp:var:: StatisticDuration success @@ @@ The count and cumulative duration for successful responses.GrpcService.InferStatistics.Builder.getSuccess()@@ .. cpp:var:: StatisticDuration success @@ @@ Cumulative count and duration for successful inference @@ request.GrpcService.InferStatistics.getSuccess()@@ .. cpp:var:: StatisticDuration success @@ @@ Cumulative count and duration for successful inference @@ request.GrpcService.InferStatisticsOrBuilder.getSuccess()@@ .. cpp:var:: StatisticDuration success @@ @@ Cumulative count and duration for successful inference @@ request.GrpcService.StatisticDuration.parseDelimitedFrom(InputStream input) GrpcService.StatisticDuration.parseDelimitedFrom(InputStream input, com.google.protobuf.ExtensionRegistryLite extensionRegistry) GrpcService.StatisticDuration.parseFrom(byte[] data) GrpcService.StatisticDuration.parseFrom(byte[] data, com.google.protobuf.ExtensionRegistryLite extensionRegistry) GrpcService.StatisticDuration.parseFrom(com.google.protobuf.ByteString data) GrpcService.StatisticDuration.parseFrom(com.google.protobuf.ByteString data, com.google.protobuf.ExtensionRegistryLite extensionRegistry) GrpcService.StatisticDuration.parseFrom(com.google.protobuf.CodedInputStream input) GrpcService.StatisticDuration.parseFrom(com.google.protobuf.CodedInputStream input, com.google.protobuf.ExtensionRegistryLite extensionRegistry) GrpcService.StatisticDuration.parseFrom(InputStream input) GrpcService.StatisticDuration.parseFrom(InputStream input, com.google.protobuf.ExtensionRegistryLite extensionRegistry) GrpcService.StatisticDuration.parseFrom(ByteBuffer data) GrpcService.StatisticDuration.parseFrom(ByteBuffer data, com.google.protobuf.ExtensionRegistryLite extensionRegistry) Methods in inference that return types with arguments of type GrpcService.StatisticDurationModifier and TypeMethodDescriptioncom.google.protobuf.Parser<GrpcService.StatisticDuration> GrpcService.StatisticDuration.getParserForType()static com.google.protobuf.Parser<GrpcService.StatisticDuration> GrpcService.StatisticDuration.parser()Methods in inference with parameters of type GrpcService.StatisticDurationModifier and TypeMethodDescriptionGrpcService.InferStatistics.Builder.mergeCacheHit(GrpcService.StatisticDuration value) @@ .. cpp:var:: StatisticDuration cache_hit @@ @@ The count of response cache hits and cumulative duration to lookup @@ and extract output tensor data from the Response Cache on a cache @@ hit.GrpcService.InferStatistics.Builder.mergeCacheMiss(GrpcService.StatisticDuration value) @@ .. cpp:var:: StatisticDuration cache_miss @@ @@ The count of response cache misses and cumulative duration to lookup @@ and insert output tensor data from the computed response to the cache.GrpcService.InferResponseStatistics.Builder.mergeCancel(GrpcService.StatisticDuration value) @@ .. cpp:var:: StatisticDuration cancel @@ @@ The count and cumulative duration, for cleaning up resources held by @@ a cancelled request, for cancelled responses.GrpcService.InferBatchStatistics.Builder.mergeComputeInfer(GrpcService.StatisticDuration value) @@ .. cpp:var:: StatisticDuration compute_infer @@ @@ The count and cumulative duration to execute the model with the given @@ batch size.GrpcService.InferResponseStatistics.Builder.mergeComputeInfer(GrpcService.StatisticDuration value) @@ .. cpp:var:: StatisticDuration compute_infer @@ @@ The count and cumulative duration to compute a response.GrpcService.InferStatistics.Builder.mergeComputeInfer(GrpcService.StatisticDuration value) @@ .. cpp:var:: StatisticDuration compute_infer @@ @@ The count and cumulative duration to execute the model.GrpcService.InferBatchStatistics.Builder.mergeComputeInput(GrpcService.StatisticDuration value) @@ .. cpp:var:: StatisticDuration compute_input @@ @@ The count and cumulative duration to prepare input tensor data as @@ required by the model framework / backend with the given batch size.GrpcService.InferStatistics.Builder.mergeComputeInput(GrpcService.StatisticDuration value) @@ .. cpp:var:: StatisticDuration compute_input @@ @@ The count and cumulative duration to prepare input tensor data as @@ required by the model framework / backend.GrpcService.InferBatchStatistics.Builder.mergeComputeOutput(GrpcService.StatisticDuration value) @@ .. cpp:var:: StatisticDuration compute_output @@ @@ The count and cumulative duration to extract output tensor data @@ produced by the model framework / backend with the given batch size.GrpcService.InferResponseStatistics.Builder.mergeComputeOutput(GrpcService.StatisticDuration value) @@ .. cpp:var:: StatisticDuration compute_output @@ @@ The count and cumulative duration to extract the output tensors of a @@ response.GrpcService.InferStatistics.Builder.mergeComputeOutput(GrpcService.StatisticDuration value) @@ .. cpp:var:: StatisticDuration compute_output @@ @@ The count and cumulative duration to extract output tensor data @@ produced by the model framework / backend.GrpcService.InferResponseStatistics.Builder.mergeEmptyResponse(GrpcService.StatisticDuration value) @@ .. cpp:var:: StatisticDuration empty_response @@ @@ The count and cumulative duration for empty responses.GrpcService.InferResponseStatistics.Builder.mergeFail(GrpcService.StatisticDuration value) @@ .. cpp:var:: StatisticDuration fail @@ @@ The count and cumulative duration for failed responses.GrpcService.InferStatistics.Builder.mergeFail(GrpcService.StatisticDuration value) @@ .. cpp:var:: StatisticDuration fail @@ @@ Cumulative count and duration for failed inference @@ request.GrpcService.StatisticDuration.Builder.mergeFrom(GrpcService.StatisticDuration other) GrpcService.InferStatistics.Builder.mergeQueue(GrpcService.StatisticDuration value) @@ .. cpp:var:: StatisticDuration queue @@ @@ The count and cumulative duration that inference requests wait in @@ scheduling or other queues.GrpcService.InferResponseStatistics.Builder.mergeSuccess(GrpcService.StatisticDuration value) @@ .. cpp:var:: StatisticDuration success @@ @@ The count and cumulative duration for successful responses.GrpcService.InferStatistics.Builder.mergeSuccess(GrpcService.StatisticDuration value) @@ .. cpp:var:: StatisticDuration success @@ @@ Cumulative count and duration for successful inference @@ request.GrpcService.StatisticDuration.newBuilder(GrpcService.StatisticDuration prototype) GrpcService.InferStatistics.Builder.setCacheHit(GrpcService.StatisticDuration value) @@ .. cpp:var:: StatisticDuration cache_hit @@ @@ The count of response cache hits and cumulative duration to lookup @@ and extract output tensor data from the Response Cache on a cache @@ hit.GrpcService.InferStatistics.Builder.setCacheMiss(GrpcService.StatisticDuration value) @@ .. cpp:var:: StatisticDuration cache_miss @@ @@ The count of response cache misses and cumulative duration to lookup @@ and insert output tensor data from the computed response to the cache.GrpcService.InferResponseStatistics.Builder.setCancel(GrpcService.StatisticDuration value) @@ .. cpp:var:: StatisticDuration cancel @@ @@ The count and cumulative duration, for cleaning up resources held by @@ a cancelled request, for cancelled responses.GrpcService.InferBatchStatistics.Builder.setComputeInfer(GrpcService.StatisticDuration value) @@ .. cpp:var:: StatisticDuration compute_infer @@ @@ The count and cumulative duration to execute the model with the given @@ batch size.GrpcService.InferResponseStatistics.Builder.setComputeInfer(GrpcService.StatisticDuration value) @@ .. cpp:var:: StatisticDuration compute_infer @@ @@ The count and cumulative duration to compute a response.GrpcService.InferStatistics.Builder.setComputeInfer(GrpcService.StatisticDuration value) @@ .. cpp:var:: StatisticDuration compute_infer @@ @@ The count and cumulative duration to execute the model.GrpcService.InferBatchStatistics.Builder.setComputeInput(GrpcService.StatisticDuration value) @@ .. cpp:var:: StatisticDuration compute_input @@ @@ The count and cumulative duration to prepare input tensor data as @@ required by the model framework / backend with the given batch size.GrpcService.InferStatistics.Builder.setComputeInput(GrpcService.StatisticDuration value) @@ .. cpp:var:: StatisticDuration compute_input @@ @@ The count and cumulative duration to prepare input tensor data as @@ required by the model framework / backend.GrpcService.InferBatchStatistics.Builder.setComputeOutput(GrpcService.StatisticDuration value) @@ .. cpp:var:: StatisticDuration compute_output @@ @@ The count and cumulative duration to extract output tensor data @@ produced by the model framework / backend with the given batch size.GrpcService.InferResponseStatistics.Builder.setComputeOutput(GrpcService.StatisticDuration value) @@ .. cpp:var:: StatisticDuration compute_output @@ @@ The count and cumulative duration to extract the output tensors of a @@ response.GrpcService.InferStatistics.Builder.setComputeOutput(GrpcService.StatisticDuration value) @@ .. cpp:var:: StatisticDuration compute_output @@ @@ The count and cumulative duration to extract output tensor data @@ produced by the model framework / backend.GrpcService.InferResponseStatistics.Builder.setEmptyResponse(GrpcService.StatisticDuration value) @@ .. cpp:var:: StatisticDuration empty_response @@ @@ The count and cumulative duration for empty responses.GrpcService.InferResponseStatistics.Builder.setFail(GrpcService.StatisticDuration value) @@ .. cpp:var:: StatisticDuration fail @@ @@ The count and cumulative duration for failed responses.GrpcService.InferStatistics.Builder.setFail(GrpcService.StatisticDuration value) @@ .. cpp:var:: StatisticDuration fail @@ @@ Cumulative count and duration for failed inference @@ request.GrpcService.InferStatistics.Builder.setQueue(GrpcService.StatisticDuration value) @@ .. cpp:var:: StatisticDuration queue @@ @@ The count and cumulative duration that inference requests wait in @@ scheduling or other queues.GrpcService.InferResponseStatistics.Builder.setSuccess(GrpcService.StatisticDuration value) @@ .. cpp:var:: StatisticDuration success @@ @@ The count and cumulative duration for successful responses.GrpcService.InferStatistics.Builder.setSuccess(GrpcService.StatisticDuration value) @@ .. cpp:var:: StatisticDuration success @@ @@ Cumulative count and duration for successful inference @@ request.