Uses of Class
inference.GrpcService.InferStatistics.Builder
Packages that use GrpcService.InferStatistics.Builder
-
Uses of GrpcService.InferStatistics.Builder in inference
Methods in inference that return GrpcService.InferStatistics.BuilderModifier and TypeMethodDescriptionGrpcService.InferStatistics.Builder.addRepeatedField(com.google.protobuf.Descriptors.FieldDescriptor field, Object value) GrpcService.InferStatistics.Builder.clear()GrpcService.InferStatistics.Builder.clearCacheHit()@@ .. cpp:var:: StatisticDuration cache_hit @@ @@ The count of response cache hits and cumulative duration to lookup @@ and extract output tensor data from the Response Cache on a cache @@ hit.GrpcService.InferStatistics.Builder.clearCacheMiss()@@ .. cpp:var:: StatisticDuration cache_miss @@ @@ The count of response cache misses and cumulative duration to lookup @@ and insert output tensor data from the computed response to the cache.GrpcService.InferStatistics.Builder.clearComputeInfer()@@ .. cpp:var:: StatisticDuration compute_infer @@ @@ The count and cumulative duration to execute the model.GrpcService.InferStatistics.Builder.clearComputeInput()@@ .. cpp:var:: StatisticDuration compute_input @@ @@ The count and cumulative duration to prepare input tensor data as @@ required by the model framework / backend.GrpcService.InferStatistics.Builder.clearComputeOutput()@@ .. cpp:var:: StatisticDuration compute_output @@ @@ The count and cumulative duration to extract output tensor data @@ produced by the model framework / backend.GrpcService.InferStatistics.Builder.clearFail()@@ .. cpp:var:: StatisticDuration fail @@ @@ Cumulative count and duration for failed inference @@ request.GrpcService.InferStatistics.Builder.clearField(com.google.protobuf.Descriptors.FieldDescriptor field) GrpcService.InferStatistics.Builder.clearOneof(com.google.protobuf.Descriptors.OneofDescriptor oneof) GrpcService.InferStatistics.Builder.clearQueue()@@ .. cpp:var:: StatisticDuration queue @@ @@ The count and cumulative duration that inference requests wait in @@ scheduling or other queues.GrpcService.InferStatistics.Builder.clearSuccess()@@ .. cpp:var:: StatisticDuration success @@ @@ Cumulative count and duration for successful inference @@ request.GrpcService.InferStatistics.Builder.clone()GrpcService.ModelStatistics.Builder.getInferenceStatsBuilder()@@ .. cpp:var:: InferStatistics inference_stats @@ @@ The aggregate statistics for the model/version.GrpcService.InferStatistics.Builder.mergeCacheHit(GrpcService.StatisticDuration value) @@ .. cpp:var:: StatisticDuration cache_hit @@ @@ The count of response cache hits and cumulative duration to lookup @@ and extract output tensor data from the Response Cache on a cache @@ hit.GrpcService.InferStatistics.Builder.mergeCacheMiss(GrpcService.StatisticDuration value) @@ .. cpp:var:: StatisticDuration cache_miss @@ @@ The count of response cache misses and cumulative duration to lookup @@ and insert output tensor data from the computed response to the cache.GrpcService.InferStatistics.Builder.mergeComputeInfer(GrpcService.StatisticDuration value) @@ .. cpp:var:: StatisticDuration compute_infer @@ @@ The count and cumulative duration to execute the model.GrpcService.InferStatistics.Builder.mergeComputeInput(GrpcService.StatisticDuration value) @@ .. cpp:var:: StatisticDuration compute_input @@ @@ The count and cumulative duration to prepare input tensor data as @@ required by the model framework / backend.GrpcService.InferStatistics.Builder.mergeComputeOutput(GrpcService.StatisticDuration value) @@ .. cpp:var:: StatisticDuration compute_output @@ @@ The count and cumulative duration to extract output tensor data @@ produced by the model framework / backend.GrpcService.InferStatistics.Builder.mergeFail(GrpcService.StatisticDuration value) @@ .. cpp:var:: StatisticDuration fail @@ @@ Cumulative count and duration for failed inference @@ request.GrpcService.InferStatistics.Builder.mergeFrom(com.google.protobuf.CodedInputStream input, com.google.protobuf.ExtensionRegistryLite extensionRegistry) GrpcService.InferStatistics.Builder.mergeFrom(com.google.protobuf.Message other) GrpcService.InferStatistics.Builder.mergeFrom(GrpcService.InferStatistics other) GrpcService.InferStatistics.Builder.mergeQueue(GrpcService.StatisticDuration value) @@ .. cpp:var:: StatisticDuration queue @@ @@ The count and cumulative duration that inference requests wait in @@ scheduling or other queues.GrpcService.InferStatistics.Builder.mergeSuccess(GrpcService.StatisticDuration value) @@ .. cpp:var:: StatisticDuration success @@ @@ Cumulative count and duration for successful inference @@ request.GrpcService.InferStatistics.Builder.mergeUnknownFields(com.google.protobuf.UnknownFieldSet unknownFields) GrpcService.InferStatistics.newBuilder()GrpcService.InferStatistics.newBuilder(GrpcService.InferStatistics prototype) GrpcService.InferStatistics.newBuilderForType()protected GrpcService.InferStatistics.BuilderGrpcService.InferStatistics.newBuilderForType(com.google.protobuf.GeneratedMessageV3.BuilderParent parent) GrpcService.InferStatistics.Builder.setCacheHit(GrpcService.StatisticDuration value) @@ .. cpp:var:: StatisticDuration cache_hit @@ @@ The count of response cache hits and cumulative duration to lookup @@ and extract output tensor data from the Response Cache on a cache @@ hit.GrpcService.InferStatistics.Builder.setCacheHit(GrpcService.StatisticDuration.Builder builderForValue) @@ .. cpp:var:: StatisticDuration cache_hit @@ @@ The count of response cache hits and cumulative duration to lookup @@ and extract output tensor data from the Response Cache on a cache @@ hit.GrpcService.InferStatistics.Builder.setCacheMiss(GrpcService.StatisticDuration value) @@ .. cpp:var:: StatisticDuration cache_miss @@ @@ The count of response cache misses and cumulative duration to lookup @@ and insert output tensor data from the computed response to the cache.GrpcService.InferStatistics.Builder.setCacheMiss(GrpcService.StatisticDuration.Builder builderForValue) @@ .. cpp:var:: StatisticDuration cache_miss @@ @@ The count of response cache misses and cumulative duration to lookup @@ and insert output tensor data from the computed response to the cache.GrpcService.InferStatistics.Builder.setComputeInfer(GrpcService.StatisticDuration value) @@ .. cpp:var:: StatisticDuration compute_infer @@ @@ The count and cumulative duration to execute the model.GrpcService.InferStatistics.Builder.setComputeInfer(GrpcService.StatisticDuration.Builder builderForValue) @@ .. cpp:var:: StatisticDuration compute_infer @@ @@ The count and cumulative duration to execute the model.GrpcService.InferStatistics.Builder.setComputeInput(GrpcService.StatisticDuration value) @@ .. cpp:var:: StatisticDuration compute_input @@ @@ The count and cumulative duration to prepare input tensor data as @@ required by the model framework / backend.GrpcService.InferStatistics.Builder.setComputeInput(GrpcService.StatisticDuration.Builder builderForValue) @@ .. cpp:var:: StatisticDuration compute_input @@ @@ The count and cumulative duration to prepare input tensor data as @@ required by the model framework / backend.GrpcService.InferStatistics.Builder.setComputeOutput(GrpcService.StatisticDuration value) @@ .. cpp:var:: StatisticDuration compute_output @@ @@ The count and cumulative duration to extract output tensor data @@ produced by the model framework / backend.GrpcService.InferStatistics.Builder.setComputeOutput(GrpcService.StatisticDuration.Builder builderForValue) @@ .. cpp:var:: StatisticDuration compute_output @@ @@ The count and cumulative duration to extract output tensor data @@ produced by the model framework / backend.GrpcService.InferStatistics.Builder.setFail(GrpcService.StatisticDuration value) @@ .. cpp:var:: StatisticDuration fail @@ @@ Cumulative count and duration for failed inference @@ request.GrpcService.InferStatistics.Builder.setFail(GrpcService.StatisticDuration.Builder builderForValue) @@ .. cpp:var:: StatisticDuration fail @@ @@ Cumulative count and duration for failed inference @@ request.GrpcService.InferStatistics.Builder.setField(com.google.protobuf.Descriptors.FieldDescriptor field, Object value) GrpcService.InferStatistics.Builder.setQueue(GrpcService.StatisticDuration value) @@ .. cpp:var:: StatisticDuration queue @@ @@ The count and cumulative duration that inference requests wait in @@ scheduling or other queues.GrpcService.InferStatistics.Builder.setQueue(GrpcService.StatisticDuration.Builder builderForValue) @@ .. cpp:var:: StatisticDuration queue @@ @@ The count and cumulative duration that inference requests wait in @@ scheduling or other queues.GrpcService.InferStatistics.Builder.setRepeatedField(com.google.protobuf.Descriptors.FieldDescriptor field, int index, Object value) GrpcService.InferStatistics.Builder.setSuccess(GrpcService.StatisticDuration value) @@ .. cpp:var:: StatisticDuration success @@ @@ Cumulative count and duration for successful inference @@ request.GrpcService.InferStatistics.Builder.setSuccess(GrpcService.StatisticDuration.Builder builderForValue) @@ .. cpp:var:: StatisticDuration success @@ @@ Cumulative count and duration for successful inference @@ request.GrpcService.InferStatistics.Builder.setUnknownFields(com.google.protobuf.UnknownFieldSet unknownFields) GrpcService.InferStatistics.toBuilder()Methods in inference with parameters of type GrpcService.InferStatistics.BuilderModifier and TypeMethodDescriptionGrpcService.ModelStatistics.Builder.setInferenceStats(GrpcService.InferStatistics.Builder builderForValue) @@ .. cpp:var:: InferStatistics inference_stats @@ @@ The aggregate statistics for the model/version.