Uses of Class
inference.ModelConfigOuterClass.ModelSequenceBatching.StrategyOldest.Builder

Packages that use ModelConfigOuterClass.ModelSequenceBatching.StrategyOldest.Builder

Package	Description
inference

Uses of ModelConfigOuterClass.ModelSequenceBatching.StrategyOldest.Builder in inference

Methods in inference that return ModelConfigOuterClass.ModelSequenceBatching.StrategyOldest.Builder

Modifier and Type	Method	Description
ModelConfigOuterClass.ModelSequenceBatching.StrategyOldest.Builder	ModelConfigOuterClass.ModelSequenceBatching.StrategyOldest.Builder.addAllPreferredBatchSize(Iterable<? extends Integer> values)	@@ .. cpp:var:: int32 preferred_batch_size (repeated) @@ @@ Preferred batch sizes for dynamic batching of candidate @@ sequences.
ModelConfigOuterClass.ModelSequenceBatching.StrategyOldest.Builder	ModelConfigOuterClass.ModelSequenceBatching.StrategyOldest.Builder.addPreferredBatchSize(int value)	@@ .. cpp:var:: int32 preferred_batch_size (repeated) @@ @@ Preferred batch sizes for dynamic batching of candidate @@ sequences.
ModelConfigOuterClass.ModelSequenceBatching.StrategyOldest.Builder	ModelConfigOuterClass.ModelSequenceBatching.StrategyOldest.Builder.addRepeatedField(com.google.protobuf.Descriptors.FieldDescriptor field, Object value)
ModelConfigOuterClass.ModelSequenceBatching.StrategyOldest.Builder	ModelConfigOuterClass.ModelSequenceBatching.StrategyOldest.Builder.clear()
ModelConfigOuterClass.ModelSequenceBatching.StrategyOldest.Builder	ModelConfigOuterClass.ModelSequenceBatching.StrategyOldest.Builder.clearField(com.google.protobuf.Descriptors.FieldDescriptor field)
ModelConfigOuterClass.ModelSequenceBatching.StrategyOldest.Builder	ModelConfigOuterClass.ModelSequenceBatching.StrategyOldest.Builder.clearMaxCandidateSequences()	@@ .. cpp:var:: int32 max_candidate_sequences @@ @@ Maximum number of candidate sequences that the batcher @@ maintains.
ModelConfigOuterClass.ModelSequenceBatching.StrategyOldest.Builder	ModelConfigOuterClass.ModelSequenceBatching.StrategyOldest.Builder.clearMaxQueueDelayMicroseconds()	@@ .. cpp:var:: uint64 max_queue_delay_microseconds @@ @@ The maximum time, in microseconds, a candidate request @@ will be delayed in the dynamic batch scheduling queue to @@ wait for additional requests for batching.
ModelConfigOuterClass.ModelSequenceBatching.StrategyOldest.Builder	ModelConfigOuterClass.ModelSequenceBatching.StrategyOldest.Builder.clearOneof(com.google.protobuf.Descriptors.OneofDescriptor oneof)
ModelConfigOuterClass.ModelSequenceBatching.StrategyOldest.Builder	ModelConfigOuterClass.ModelSequenceBatching.StrategyOldest.Builder.clearPreferredBatchSize()	@@ .. cpp:var:: int32 preferred_batch_size (repeated) @@ @@ Preferred batch sizes for dynamic batching of candidate @@ sequences.
ModelConfigOuterClass.ModelSequenceBatching.StrategyOldest.Builder	ModelConfigOuterClass.ModelSequenceBatching.StrategyOldest.Builder.clearPreserveOrdering()	@@ .. cpp:var:: bool preserve_ordering @@ @@ Should the dynamic batcher preserve the ordering of responses to @@ match the order of requests received by the scheduler.
ModelConfigOuterClass.ModelSequenceBatching.StrategyOldest.Builder	ModelConfigOuterClass.ModelSequenceBatching.StrategyOldest.Builder.clone()
ModelConfigOuterClass.ModelSequenceBatching.StrategyOldest.Builder	ModelConfigOuterClass.ModelSequenceBatching.Builder.getOldestBuilder()	@@ .. cpp:var:: StrategyOldest oldest @@ @@ StrategyOldest scheduling strategy.
ModelConfigOuterClass.ModelSequenceBatching.StrategyOldest.Builder	ModelConfigOuterClass.ModelSequenceBatching.StrategyOldest.Builder.mergeFrom(com.google.protobuf.CodedInputStream input, com.google.protobuf.ExtensionRegistryLite extensionRegistry)
ModelConfigOuterClass.ModelSequenceBatching.StrategyOldest.Builder	ModelConfigOuterClass.ModelSequenceBatching.StrategyOldest.Builder.mergeFrom(com.google.protobuf.Message other)
ModelConfigOuterClass.ModelSequenceBatching.StrategyOldest.Builder	ModelConfigOuterClass.ModelSequenceBatching.StrategyOldest.Builder.mergeFrom(ModelConfigOuterClass.ModelSequenceBatching.StrategyOldest other)
final ModelConfigOuterClass.ModelSequenceBatching.StrategyOldest.Builder	ModelConfigOuterClass.ModelSequenceBatching.StrategyOldest.Builder.mergeUnknownFields(com.google.protobuf.UnknownFieldSet unknownFields)
static ModelConfigOuterClass.ModelSequenceBatching.StrategyOldest.Builder	ModelConfigOuterClass.ModelSequenceBatching.StrategyOldest.newBuilder()
static ModelConfigOuterClass.ModelSequenceBatching.StrategyOldest.Builder	ModelConfigOuterClass.ModelSequenceBatching.StrategyOldest.newBuilder(ModelConfigOuterClass.ModelSequenceBatching.StrategyOldest prototype)
ModelConfigOuterClass.ModelSequenceBatching.StrategyOldest.Builder	ModelConfigOuterClass.ModelSequenceBatching.StrategyOldest.newBuilderForType()
protected ModelConfigOuterClass.ModelSequenceBatching.StrategyOldest.Builder	ModelConfigOuterClass.ModelSequenceBatching.StrategyOldest.newBuilderForType(com.google.protobuf.GeneratedMessageV3.BuilderParent parent)
ModelConfigOuterClass.ModelSequenceBatching.StrategyOldest.Builder	ModelConfigOuterClass.ModelSequenceBatching.StrategyOldest.Builder.setField(com.google.protobuf.Descriptors.FieldDescriptor field, Object value)
ModelConfigOuterClass.ModelSequenceBatching.StrategyOldest.Builder	ModelConfigOuterClass.ModelSequenceBatching.StrategyOldest.Builder.setMaxCandidateSequences(int value)	@@ .. cpp:var:: int32 max_candidate_sequences @@ @@ Maximum number of candidate sequences that the batcher @@ maintains.
ModelConfigOuterClass.ModelSequenceBatching.StrategyOldest.Builder	ModelConfigOuterClass.ModelSequenceBatching.StrategyOldest.Builder.setMaxQueueDelayMicroseconds(long value)	@@ .. cpp:var:: uint64 max_queue_delay_microseconds @@ @@ The maximum time, in microseconds, a candidate request @@ will be delayed in the dynamic batch scheduling queue to @@ wait for additional requests for batching.
ModelConfigOuterClass.ModelSequenceBatching.StrategyOldest.Builder	ModelConfigOuterClass.ModelSequenceBatching.StrategyOldest.Builder.setPreferredBatchSize(int index, int value)	@@ .. cpp:var:: int32 preferred_batch_size (repeated) @@ @@ Preferred batch sizes for dynamic batching of candidate @@ sequences.
ModelConfigOuterClass.ModelSequenceBatching.StrategyOldest.Builder	ModelConfigOuterClass.ModelSequenceBatching.StrategyOldest.Builder.setPreserveOrdering(boolean value)	@@ .. cpp:var:: bool preserve_ordering @@ @@ Should the dynamic batcher preserve the ordering of responses to @@ match the order of requests received by the scheduler.
ModelConfigOuterClass.ModelSequenceBatching.StrategyOldest.Builder	ModelConfigOuterClass.ModelSequenceBatching.StrategyOldest.Builder.setRepeatedField(com.google.protobuf.Descriptors.FieldDescriptor field, int index, Object value)
final ModelConfigOuterClass.ModelSequenceBatching.StrategyOldest.Builder	ModelConfigOuterClass.ModelSequenceBatching.StrategyOldest.Builder.setUnknownFields(com.google.protobuf.UnknownFieldSet unknownFields)
ModelConfigOuterClass.ModelSequenceBatching.StrategyOldest.Builder	ModelConfigOuterClass.ModelSequenceBatching.StrategyOldest.toBuilder()

Methods in inference with parameters of type ModelConfigOuterClass.ModelSequenceBatching.StrategyOldest.Builder

Modifier and Type	Method	Description
ModelConfigOuterClass.ModelSequenceBatching.Builder	ModelConfigOuterClass.ModelSequenceBatching.Builder.setOldest(ModelConfigOuterClass.ModelSequenceBatching.StrategyOldest.Builder builderForValue)	@@ .. cpp:var:: StrategyOldest oldest @@ @@ StrategyOldest scheduling strategy.