Uses of Class
inference.ModelConfigOuterClass.ModelSequenceBatching.StrategyDirect.Builder

Packages that use ModelConfigOuterClass.ModelSequenceBatching.StrategyDirect.Builder

Package	Description
inference

Uses of ModelConfigOuterClass.ModelSequenceBatching.StrategyDirect.Builder in inference

Methods in inference that return ModelConfigOuterClass.ModelSequenceBatching.StrategyDirect.Builder

Modifier and Type	Method	Description
ModelConfigOuterClass.ModelSequenceBatching.StrategyDirect.Builder	ModelConfigOuterClass.ModelSequenceBatching.StrategyDirect.Builder.addRepeatedField(com.google.protobuf.Descriptors.FieldDescriptor field, Object value)
ModelConfigOuterClass.ModelSequenceBatching.StrategyDirect.Builder	ModelConfigOuterClass.ModelSequenceBatching.StrategyDirect.Builder.clear()
ModelConfigOuterClass.ModelSequenceBatching.StrategyDirect.Builder	ModelConfigOuterClass.ModelSequenceBatching.StrategyDirect.Builder.clearField(com.google.protobuf.Descriptors.FieldDescriptor field)
ModelConfigOuterClass.ModelSequenceBatching.StrategyDirect.Builder	ModelConfigOuterClass.ModelSequenceBatching.StrategyDirect.Builder.clearMaxQueueDelayMicroseconds()	@@ .. cpp:var:: uint64 max_queue_delay_microseconds @@ @@ The maximum time, in microseconds, a candidate request @@ will be delayed in the sequence batch scheduling queue to @@ wait for additional requests for batching.
ModelConfigOuterClass.ModelSequenceBatching.StrategyDirect.Builder	ModelConfigOuterClass.ModelSequenceBatching.StrategyDirect.Builder.clearMinimumSlotUtilization()	@@ .. cpp:var:: float minimum_slot_utilization @@ @@ The minimum slot utilization that must be satisfied to @@ execute the batch before 'max_queue_delay_microseconds' expires.
ModelConfigOuterClass.ModelSequenceBatching.StrategyDirect.Builder	ModelConfigOuterClass.ModelSequenceBatching.StrategyDirect.Builder.clearOneof(com.google.protobuf.Descriptors.OneofDescriptor oneof)
ModelConfigOuterClass.ModelSequenceBatching.StrategyDirect.Builder	ModelConfigOuterClass.ModelSequenceBatching.StrategyDirect.Builder.clone()
ModelConfigOuterClass.ModelSequenceBatching.StrategyDirect.Builder	ModelConfigOuterClass.ModelSequenceBatching.Builder.getDirectBuilder()	@@ .. cpp:var:: StrategyDirect direct @@ @@ StrategyDirect scheduling strategy.
ModelConfigOuterClass.ModelSequenceBatching.StrategyDirect.Builder	ModelConfigOuterClass.ModelSequenceBatching.StrategyDirect.Builder.mergeFrom(com.google.protobuf.CodedInputStream input, com.google.protobuf.ExtensionRegistryLite extensionRegistry)
ModelConfigOuterClass.ModelSequenceBatching.StrategyDirect.Builder	ModelConfigOuterClass.ModelSequenceBatching.StrategyDirect.Builder.mergeFrom(com.google.protobuf.Message other)
ModelConfigOuterClass.ModelSequenceBatching.StrategyDirect.Builder	ModelConfigOuterClass.ModelSequenceBatching.StrategyDirect.Builder.mergeFrom(ModelConfigOuterClass.ModelSequenceBatching.StrategyDirect other)
final ModelConfigOuterClass.ModelSequenceBatching.StrategyDirect.Builder	ModelConfigOuterClass.ModelSequenceBatching.StrategyDirect.Builder.mergeUnknownFields(com.google.protobuf.UnknownFieldSet unknownFields)
static ModelConfigOuterClass.ModelSequenceBatching.StrategyDirect.Builder	ModelConfigOuterClass.ModelSequenceBatching.StrategyDirect.newBuilder()
static ModelConfigOuterClass.ModelSequenceBatching.StrategyDirect.Builder	ModelConfigOuterClass.ModelSequenceBatching.StrategyDirect.newBuilder(ModelConfigOuterClass.ModelSequenceBatching.StrategyDirect prototype)
ModelConfigOuterClass.ModelSequenceBatching.StrategyDirect.Builder	ModelConfigOuterClass.ModelSequenceBatching.StrategyDirect.newBuilderForType()
protected ModelConfigOuterClass.ModelSequenceBatching.StrategyDirect.Builder	ModelConfigOuterClass.ModelSequenceBatching.StrategyDirect.newBuilderForType(com.google.protobuf.GeneratedMessageV3.BuilderParent parent)
ModelConfigOuterClass.ModelSequenceBatching.StrategyDirect.Builder	ModelConfigOuterClass.ModelSequenceBatching.StrategyDirect.Builder.setField(com.google.protobuf.Descriptors.FieldDescriptor field, Object value)
ModelConfigOuterClass.ModelSequenceBatching.StrategyDirect.Builder	ModelConfigOuterClass.ModelSequenceBatching.StrategyDirect.Builder.setMaxQueueDelayMicroseconds(long value)	@@ .. cpp:var:: uint64 max_queue_delay_microseconds @@ @@ The maximum time, in microseconds, a candidate request @@ will be delayed in the sequence batch scheduling queue to @@ wait for additional requests for batching.
ModelConfigOuterClass.ModelSequenceBatching.StrategyDirect.Builder	ModelConfigOuterClass.ModelSequenceBatching.StrategyDirect.Builder.setMinimumSlotUtilization(float value)	@@ .. cpp:var:: float minimum_slot_utilization @@ @@ The minimum slot utilization that must be satisfied to @@ execute the batch before 'max_queue_delay_microseconds' expires.
ModelConfigOuterClass.ModelSequenceBatching.StrategyDirect.Builder	ModelConfigOuterClass.ModelSequenceBatching.StrategyDirect.Builder.setRepeatedField(com.google.protobuf.Descriptors.FieldDescriptor field, int index, Object value)
final ModelConfigOuterClass.ModelSequenceBatching.StrategyDirect.Builder	ModelConfigOuterClass.ModelSequenceBatching.StrategyDirect.Builder.setUnknownFields(com.google.protobuf.UnknownFieldSet unknownFields)
ModelConfigOuterClass.ModelSequenceBatching.StrategyDirect.Builder	ModelConfigOuterClass.ModelSequenceBatching.StrategyDirect.toBuilder()

Methods in inference with parameters of type ModelConfigOuterClass.ModelSequenceBatching.StrategyDirect.Builder

Modifier and Type	Method	Description
ModelConfigOuterClass.ModelSequenceBatching.Builder	ModelConfigOuterClass.ModelSequenceBatching.Builder.setDirect(ModelConfigOuterClass.ModelSequenceBatching.StrategyDirect.Builder builderForValue)	@@ .. cpp:var:: StrategyDirect direct @@ @@ StrategyDirect scheduling strategy.