Uses of Interface
inference.ModelConfigOuterClass.ModelRateLimiterOrBuilder

Packages that use ModelConfigOuterClass.ModelRateLimiterOrBuilder

Package	Description
inference

Uses of ModelConfigOuterClass.ModelRateLimiterOrBuilder in inference

Classes in inference that implement ModelConfigOuterClass.ModelRateLimiterOrBuilder

Modifier and Type	Class	Description
static final class	ModelConfigOuterClass.ModelRateLimiter	@@ @@ .. cpp:var:: message ModelRateLimiter @@ @@ The specifications required by the rate limiter to properly @@ schedule the inference requests across the different models @@ and their instances.
static final class	ModelConfigOuterClass.ModelRateLimiter.Builder	@@ @@ .. cpp:var:: message ModelRateLimiter @@ @@ The specifications required by the rate limiter to properly @@ schedule the inference requests across the different models @@ and their instances.

Methods in inference that return ModelConfigOuterClass.ModelRateLimiterOrBuilder

Modifier and Type	Method	Description
ModelConfigOuterClass.ModelRateLimiterOrBuilder	ModelConfigOuterClass.ModelInstanceGroup.Builder.getRateLimiterOrBuilder()	@@ .. cpp:var:: ModelRateLimiter rate_limiter @@ @@ The rate limiter specific settings to be associated with this @@ instance group.
ModelConfigOuterClass.ModelRateLimiterOrBuilder	ModelConfigOuterClass.ModelInstanceGroup.getRateLimiterOrBuilder()	@@ .. cpp:var:: ModelRateLimiter rate_limiter @@ @@ The rate limiter specific settings to be associated with this @@ instance group.
ModelConfigOuterClass.ModelRateLimiterOrBuilder	ModelConfigOuterClass.ModelInstanceGroupOrBuilder.getRateLimiterOrBuilder()	@@ .. cpp:var:: ModelRateLimiter rate_limiter @@ @@ The rate limiter specific settings to be associated with this @@ instance group.