Uses of Class
inference.ModelConfigOuterClass.ModelSequenceBatching.Builder
Packages that use ModelConfigOuterClass.ModelSequenceBatching.Builder
-
Uses of ModelConfigOuterClass.ModelSequenceBatching.Builder in inference
Methods in inference that return ModelConfigOuterClass.ModelSequenceBatching.BuilderModifier and TypeMethodDescriptionModelConfigOuterClass.ModelSequenceBatching.Builder.addAllControlInput(Iterable<? extends ModelConfigOuterClass.ModelSequenceBatching.ControlInput> values) @@ .. cpp:var:: ControlInput control_input (repeated) @@ @@ The model input(s) that the server should use to communicate @@ sequence start, stop, ready and similar control values to the @@ model.ModelConfigOuterClass.ModelSequenceBatching.Builder.addAllState(Iterable<? extends ModelConfigOuterClass.ModelSequenceBatching.State> values) @@ .. cpp:var:: State state (repeated) @@ @@ The optional state that can be stored in Triton for performing @@ inference requests on a sequence.ModelConfigOuterClass.ModelSequenceBatching.Builder.addControlInput(int index, ModelConfigOuterClass.ModelSequenceBatching.ControlInput value) @@ .. cpp:var:: ControlInput control_input (repeated) @@ @@ The model input(s) that the server should use to communicate @@ sequence start, stop, ready and similar control values to the @@ model.ModelConfigOuterClass.ModelSequenceBatching.Builder.addControlInput(int index, ModelConfigOuterClass.ModelSequenceBatching.ControlInput.Builder builderForValue) @@ .. cpp:var:: ControlInput control_input (repeated) @@ @@ The model input(s) that the server should use to communicate @@ sequence start, stop, ready and similar control values to the @@ model.ModelConfigOuterClass.ModelSequenceBatching.Builder.addControlInput(ModelConfigOuterClass.ModelSequenceBatching.ControlInput value) @@ .. cpp:var:: ControlInput control_input (repeated) @@ @@ The model input(s) that the server should use to communicate @@ sequence start, stop, ready and similar control values to the @@ model.ModelConfigOuterClass.ModelSequenceBatching.Builder.addControlInput(ModelConfigOuterClass.ModelSequenceBatching.ControlInput.Builder builderForValue) @@ .. cpp:var:: ControlInput control_input (repeated) @@ @@ The model input(s) that the server should use to communicate @@ sequence start, stop, ready and similar control values to the @@ model.ModelConfigOuterClass.ModelSequenceBatching.Builder.addRepeatedField(com.google.protobuf.Descriptors.FieldDescriptor field, Object value) ModelConfigOuterClass.ModelSequenceBatching.Builder.addState(int index, ModelConfigOuterClass.ModelSequenceBatching.State value) @@ .. cpp:var:: State state (repeated) @@ @@ The optional state that can be stored in Triton for performing @@ inference requests on a sequence.ModelConfigOuterClass.ModelSequenceBatching.Builder.addState(int index, ModelConfigOuterClass.ModelSequenceBatching.State.Builder builderForValue) @@ .. cpp:var:: State state (repeated) @@ @@ The optional state that can be stored in Triton for performing @@ inference requests on a sequence.ModelConfigOuterClass.ModelSequenceBatching.Builder.addState(ModelConfigOuterClass.ModelSequenceBatching.State value) @@ .. cpp:var:: State state (repeated) @@ @@ The optional state that can be stored in Triton for performing @@ inference requests on a sequence.ModelConfigOuterClass.ModelSequenceBatching.Builder.addState(ModelConfigOuterClass.ModelSequenceBatching.State.Builder builderForValue) @@ .. cpp:var:: State state (repeated) @@ @@ The optional state that can be stored in Triton for performing @@ inference requests on a sequence.ModelConfigOuterClass.ModelSequenceBatching.Builder.clear()ModelConfigOuterClass.ModelSequenceBatching.Builder.clearControlInput()@@ .. cpp:var:: ControlInput control_input (repeated) @@ @@ The model input(s) that the server should use to communicate @@ sequence start, stop, ready and similar control values to the @@ model.ModelConfigOuterClass.ModelSequenceBatching.Builder.clearDirect()@@ .. cpp:var:: StrategyDirect direct @@ @@ StrategyDirect scheduling strategy.ModelConfigOuterClass.ModelSequenceBatching.Builder.clearField(com.google.protobuf.Descriptors.FieldDescriptor field) ModelConfigOuterClass.ModelSequenceBatching.Builder.clearIterativeSequence()@@ .. cpp:var:: bool iterative_sequence @@ @@ Requests for iterative sequences are processed over a number @@ of iterations.ModelConfigOuterClass.ModelSequenceBatching.Builder.clearMaxSequenceIdleMicroseconds()@@ .. cpp:var:: uint64 max_sequence_idle_microseconds @@ @@ The maximum time, in microseconds, that a sequence is allowed to @@ be idle before it is aborted.ModelConfigOuterClass.ModelSequenceBatching.Builder.clearOldest()@@ .. cpp:var:: StrategyOldest oldest @@ @@ StrategyOldest scheduling strategy.ModelConfigOuterClass.ModelSequenceBatching.Builder.clearOneof(com.google.protobuf.Descriptors.OneofDescriptor oneof) ModelConfigOuterClass.ModelSequenceBatching.Builder.clearState()@@ .. cpp:var:: State state (repeated) @@ @@ The optional state that can be stored in Triton for performing @@ inference requests on a sequence.ModelConfigOuterClass.ModelSequenceBatching.Builder.clearStrategyChoice()ModelConfigOuterClass.ModelSequenceBatching.Builder.clone()ModelConfigOuterClass.ModelConfig.Builder.getSequenceBatchingBuilder()@@ .. cpp:var:: ModelSequenceBatching sequence_batching @@ @@ If specified, enables the sequence-batching scheduling @@ policy.ModelConfigOuterClass.ModelSequenceBatching.Builder.mergeDirect(ModelConfigOuterClass.ModelSequenceBatching.StrategyDirect value) @@ .. cpp:var:: StrategyDirect direct @@ @@ StrategyDirect scheduling strategy.ModelConfigOuterClass.ModelSequenceBatching.Builder.mergeFrom(com.google.protobuf.CodedInputStream input, com.google.protobuf.ExtensionRegistryLite extensionRegistry) ModelConfigOuterClass.ModelSequenceBatching.Builder.mergeFrom(com.google.protobuf.Message other) ModelConfigOuterClass.ModelSequenceBatching.Builder.mergeFrom(ModelConfigOuterClass.ModelSequenceBatching other) ModelConfigOuterClass.ModelSequenceBatching.Builder.mergeOldest(ModelConfigOuterClass.ModelSequenceBatching.StrategyOldest value) @@ .. cpp:var:: StrategyOldest oldest @@ @@ StrategyOldest scheduling strategy.ModelConfigOuterClass.ModelSequenceBatching.Builder.mergeUnknownFields(com.google.protobuf.UnknownFieldSet unknownFields) ModelConfigOuterClass.ModelSequenceBatching.newBuilder()ModelConfigOuterClass.ModelSequenceBatching.newBuilder(ModelConfigOuterClass.ModelSequenceBatching prototype) ModelConfigOuterClass.ModelSequenceBatching.newBuilderForType()ModelConfigOuterClass.ModelSequenceBatching.newBuilderForType(com.google.protobuf.GeneratedMessageV3.BuilderParent parent) ModelConfigOuterClass.ModelSequenceBatching.Builder.removeControlInput(int index) @@ .. cpp:var:: ControlInput control_input (repeated) @@ @@ The model input(s) that the server should use to communicate @@ sequence start, stop, ready and similar control values to the @@ model.ModelConfigOuterClass.ModelSequenceBatching.Builder.removeState(int index) @@ .. cpp:var:: State state (repeated) @@ @@ The optional state that can be stored in Triton for performing @@ inference requests on a sequence.ModelConfigOuterClass.ModelSequenceBatching.Builder.setControlInput(int index, ModelConfigOuterClass.ModelSequenceBatching.ControlInput value) @@ .. cpp:var:: ControlInput control_input (repeated) @@ @@ The model input(s) that the server should use to communicate @@ sequence start, stop, ready and similar control values to the @@ model.ModelConfigOuterClass.ModelSequenceBatching.Builder.setControlInput(int index, ModelConfigOuterClass.ModelSequenceBatching.ControlInput.Builder builderForValue) @@ .. cpp:var:: ControlInput control_input (repeated) @@ @@ The model input(s) that the server should use to communicate @@ sequence start, stop, ready and similar control values to the @@ model.ModelConfigOuterClass.ModelSequenceBatching.Builder.setDirect(ModelConfigOuterClass.ModelSequenceBatching.StrategyDirect value) @@ .. cpp:var:: StrategyDirect direct @@ @@ StrategyDirect scheduling strategy.ModelConfigOuterClass.ModelSequenceBatching.Builder.setDirect(ModelConfigOuterClass.ModelSequenceBatching.StrategyDirect.Builder builderForValue) @@ .. cpp:var:: StrategyDirect direct @@ @@ StrategyDirect scheduling strategy.ModelConfigOuterClass.ModelSequenceBatching.Builder.setField(com.google.protobuf.Descriptors.FieldDescriptor field, Object value) ModelConfigOuterClass.ModelSequenceBatching.Builder.setIterativeSequence(boolean value) @@ .. cpp:var:: bool iterative_sequence @@ @@ Requests for iterative sequences are processed over a number @@ of iterations.ModelConfigOuterClass.ModelSequenceBatching.Builder.setMaxSequenceIdleMicroseconds(long value) @@ .. cpp:var:: uint64 max_sequence_idle_microseconds @@ @@ The maximum time, in microseconds, that a sequence is allowed to @@ be idle before it is aborted.ModelConfigOuterClass.ModelSequenceBatching.Builder.setOldest(ModelConfigOuterClass.ModelSequenceBatching.StrategyOldest value) @@ .. cpp:var:: StrategyOldest oldest @@ @@ StrategyOldest scheduling strategy.ModelConfigOuterClass.ModelSequenceBatching.Builder.setOldest(ModelConfigOuterClass.ModelSequenceBatching.StrategyOldest.Builder builderForValue) @@ .. cpp:var:: StrategyOldest oldest @@ @@ StrategyOldest scheduling strategy.ModelConfigOuterClass.ModelSequenceBatching.Builder.setRepeatedField(com.google.protobuf.Descriptors.FieldDescriptor field, int index, Object value) ModelConfigOuterClass.ModelSequenceBatching.Builder.setState(int index, ModelConfigOuterClass.ModelSequenceBatching.State value) @@ .. cpp:var:: State state (repeated) @@ @@ The optional state that can be stored in Triton for performing @@ inference requests on a sequence.ModelConfigOuterClass.ModelSequenceBatching.Builder.setState(int index, ModelConfigOuterClass.ModelSequenceBatching.State.Builder builderForValue) @@ .. cpp:var:: State state (repeated) @@ @@ The optional state that can be stored in Triton for performing @@ inference requests on a sequence.ModelConfigOuterClass.ModelSequenceBatching.Builder.setUnknownFields(com.google.protobuf.UnknownFieldSet unknownFields) ModelConfigOuterClass.ModelSequenceBatching.toBuilder()Methods in inference with parameters of type ModelConfigOuterClass.ModelSequenceBatching.BuilderModifier and TypeMethodDescriptionModelConfigOuterClass.ModelConfig.Builder.setSequenceBatching(ModelConfigOuterClass.ModelSequenceBatching.Builder builderForValue) @@ .. cpp:var:: ModelSequenceBatching sequence_batching @@ @@ If specified, enables the sequence-batching scheduling @@ policy.