Uses of Interface
inference.ModelConfigOuterClass.ModelRateLimiterOrBuilder
Packages that use ModelConfigOuterClass.ModelRateLimiterOrBuilder
-
Uses of ModelConfigOuterClass.ModelRateLimiterOrBuilder in inference
Classes in inference that implement ModelConfigOuterClass.ModelRateLimiterOrBuilderModifier and TypeClassDescriptionstatic final class@@ @@ .. cpp:var:: message ModelRateLimiter @@ @@ The specifications required by the rate limiter to properly @@ schedule the inference requests across the different models @@ and their instances.static final class@@ @@ .. cpp:var:: message ModelRateLimiter @@ @@ The specifications required by the rate limiter to properly @@ schedule the inference requests across the different models @@ and their instances.Methods in inference that return ModelConfigOuterClass.ModelRateLimiterOrBuilderModifier and TypeMethodDescriptionModelConfigOuterClass.ModelInstanceGroup.Builder.getRateLimiterOrBuilder()@@ .. cpp:var:: ModelRateLimiter rate_limiter @@ @@ The rate limiter specific settings to be associated with this @@ instance group.ModelConfigOuterClass.ModelInstanceGroup.getRateLimiterOrBuilder()@@ .. cpp:var:: ModelRateLimiter rate_limiter @@ @@ The rate limiter specific settings to be associated with this @@ instance group.ModelConfigOuterClass.ModelInstanceGroupOrBuilder.getRateLimiterOrBuilder()@@ .. cpp:var:: ModelRateLimiter rate_limiter @@ @@ The rate limiter specific settings to be associated with this @@ instance group.