Uses of Class
inference.ModelConfigOuterClass.ModelSequenceBatching.StrategyDirect.Builder
Packages that use ModelConfigOuterClass.ModelSequenceBatching.StrategyDirect.Builder
-
Uses of ModelConfigOuterClass.ModelSequenceBatching.StrategyDirect.Builder in inference
Methods in inference that return ModelConfigOuterClass.ModelSequenceBatching.StrategyDirect.BuilderModifier and TypeMethodDescriptionModelConfigOuterClass.ModelSequenceBatching.StrategyDirect.Builder.addRepeatedField(com.google.protobuf.Descriptors.FieldDescriptor field, Object value) ModelConfigOuterClass.ModelSequenceBatching.StrategyDirect.Builder.clear()ModelConfigOuterClass.ModelSequenceBatching.StrategyDirect.Builder.clearField(com.google.protobuf.Descriptors.FieldDescriptor field) ModelConfigOuterClass.ModelSequenceBatching.StrategyDirect.Builder.clearMaxQueueDelayMicroseconds()@@ .. cpp:var:: uint64 max_queue_delay_microseconds @@ @@ The maximum time, in microseconds, a candidate request @@ will be delayed in the sequence batch scheduling queue to @@ wait for additional requests for batching.ModelConfigOuterClass.ModelSequenceBatching.StrategyDirect.Builder.clearMinimumSlotUtilization()@@ .. cpp:var:: float minimum_slot_utilization @@ @@ The minimum slot utilization that must be satisfied to @@ execute the batch before 'max_queue_delay_microseconds' expires.ModelConfigOuterClass.ModelSequenceBatching.StrategyDirect.Builder.clearOneof(com.google.protobuf.Descriptors.OneofDescriptor oneof) ModelConfigOuterClass.ModelSequenceBatching.StrategyDirect.Builder.clone()ModelConfigOuterClass.ModelSequenceBatching.Builder.getDirectBuilder()@@ .. cpp:var:: StrategyDirect direct @@ @@ StrategyDirect scheduling strategy.ModelConfigOuterClass.ModelSequenceBatching.StrategyDirect.Builder.mergeFrom(com.google.protobuf.CodedInputStream input, com.google.protobuf.ExtensionRegistryLite extensionRegistry) ModelConfigOuterClass.ModelSequenceBatching.StrategyDirect.Builder.mergeFrom(com.google.protobuf.Message other) ModelConfigOuterClass.ModelSequenceBatching.StrategyDirect.Builder.mergeFrom(ModelConfigOuterClass.ModelSequenceBatching.StrategyDirect other) ModelConfigOuterClass.ModelSequenceBatching.StrategyDirect.Builder.mergeUnknownFields(com.google.protobuf.UnknownFieldSet unknownFields) ModelConfigOuterClass.ModelSequenceBatching.StrategyDirect.newBuilder()ModelConfigOuterClass.ModelSequenceBatching.StrategyDirect.newBuilder(ModelConfigOuterClass.ModelSequenceBatching.StrategyDirect prototype) ModelConfigOuterClass.ModelSequenceBatching.StrategyDirect.newBuilderForType()ModelConfigOuterClass.ModelSequenceBatching.StrategyDirect.newBuilderForType(com.google.protobuf.GeneratedMessageV3.BuilderParent parent) ModelConfigOuterClass.ModelSequenceBatching.StrategyDirect.Builder.setField(com.google.protobuf.Descriptors.FieldDescriptor field, Object value) ModelConfigOuterClass.ModelSequenceBatching.StrategyDirect.Builder.setMaxQueueDelayMicroseconds(long value) @@ .. cpp:var:: uint64 max_queue_delay_microseconds @@ @@ The maximum time, in microseconds, a candidate request @@ will be delayed in the sequence batch scheduling queue to @@ wait for additional requests for batching.ModelConfigOuterClass.ModelSequenceBatching.StrategyDirect.Builder.setMinimumSlotUtilization(float value) @@ .. cpp:var:: float minimum_slot_utilization @@ @@ The minimum slot utilization that must be satisfied to @@ execute the batch before 'max_queue_delay_microseconds' expires.ModelConfigOuterClass.ModelSequenceBatching.StrategyDirect.Builder.setRepeatedField(com.google.protobuf.Descriptors.FieldDescriptor field, int index, Object value) ModelConfigOuterClass.ModelSequenceBatching.StrategyDirect.Builder.setUnknownFields(com.google.protobuf.UnknownFieldSet unknownFields) ModelConfigOuterClass.ModelSequenceBatching.StrategyDirect.toBuilder()Methods in inference with parameters of type ModelConfigOuterClass.ModelSequenceBatching.StrategyDirect.BuilderModifier and TypeMethodDescriptionModelConfigOuterClass.ModelSequenceBatching.Builder.setDirect(ModelConfigOuterClass.ModelSequenceBatching.StrategyDirect.Builder builderForValue) @@ .. cpp:var:: StrategyDirect direct @@ @@ StrategyDirect scheduling strategy.