Uses of Interface
inference.ModelConfigOuterClass.ModelQueuePolicyOrBuilder
Packages that use ModelConfigOuterClass.ModelQueuePolicyOrBuilder
-
Uses of ModelConfigOuterClass.ModelQueuePolicyOrBuilder in inference
Classes in inference that implement ModelConfigOuterClass.ModelQueuePolicyOrBuilderModifier and TypeClassDescriptionstatic final class@@ @@.. cpp:var:: message ModelQueuePolicy @@ @@ Queue policy for inference requests.static final class@@ @@.. cpp:var:: message ModelQueuePolicy @@ @@ Queue policy for inference requests.Methods in inference that return ModelConfigOuterClass.ModelQueuePolicyOrBuilderModifier and TypeMethodDescriptionModelConfigOuterClass.ModelDynamicBatching.Builder.getDefaultQueuePolicyOrBuilder()@@ .. cpp:var:: ModelQueuePolicy default_queue_policy @@ @@ The default queue policy used for requests that don't require @@ priority handling and requests that specify priority levels where @@ there is no specific policy given.ModelConfigOuterClass.ModelDynamicBatching.getDefaultQueuePolicyOrBuilder()@@ .. cpp:var:: ModelQueuePolicy default_queue_policy @@ @@ The default queue policy used for requests that don't require @@ priority handling and requests that specify priority levels where @@ there is no specific policy given.ModelConfigOuterClass.ModelDynamicBatchingOrBuilder.getDefaultQueuePolicyOrBuilder()@@ .. cpp:var:: ModelQueuePolicy default_queue_policy @@ @@ The default queue policy used for requests that don't require @@ priority handling and requests that specify priority levels where @@ there is no specific policy given.