Uses of Class
inference.ModelConfigOuterClass.ModelOptimizationPolicy.Builder
Packages that use ModelConfigOuterClass.ModelOptimizationPolicy.Builder
-
Uses of ModelConfigOuterClass.ModelOptimizationPolicy.Builder in inference
Methods in inference that return ModelConfigOuterClass.ModelOptimizationPolicy.BuilderModifier and TypeMethodDescriptionModelConfigOuterClass.ModelOptimizationPolicy.Builder.addRepeatedField(com.google.protobuf.Descriptors.FieldDescriptor field, Object value) ModelConfigOuterClass.ModelOptimizationPolicy.Builder.clear()ModelConfigOuterClass.ModelOptimizationPolicy.Builder.clearCuda()@@ .. cpp:var:: Cuda cuda @@ @@ CUDA-specific optimization settings.ModelConfigOuterClass.ModelOptimizationPolicy.Builder.clearEagerBatching()@@ .. cpp:var:: bool eager_batching @@ @@ Start preparing the next batch before the model instance is ready @@ for the next inference.ModelConfigOuterClass.ModelOptimizationPolicy.Builder.clearExecutionAccelerators()@@ .. cpp:var:: ExecutionAccelerators execution_accelerators @@ @@ The accelerators used for the model.ModelConfigOuterClass.ModelOptimizationPolicy.Builder.clearField(com.google.protobuf.Descriptors.FieldDescriptor field) ModelConfigOuterClass.ModelOptimizationPolicy.Builder.clearGatherKernelBufferThreshold()@@ .. cpp:var:: uint32 gather_kernel_buffer_threshold @@ @@ The backend may use a gather kernel to gather input data if the @@ device has direct access to the source buffer and the destination @@ buffer.ModelConfigOuterClass.ModelOptimizationPolicy.Builder.clearGraph()@@ .. cpp:var:: Graph graph @@ @@ The graph optimization setting for the model.ModelConfigOuterClass.ModelOptimizationPolicy.Builder.clearInputPinnedMemory()@@ .. cpp:var:: PinnedMemoryBuffer input_pinned_memory @@ @@ Use pinned memory buffer when the data transfer for inputs @@ is between GPU memory and non-pinned system memory.ModelConfigOuterClass.ModelOptimizationPolicy.Builder.clearOneof(com.google.protobuf.Descriptors.OneofDescriptor oneof) ModelConfigOuterClass.ModelOptimizationPolicy.Builder.clearOutputPinnedMemory()@@ .. cpp:var:: PinnedMemoryBuffer output_pinned_memory @@ @@ Use pinned memory buffer when the data transfer for outputs @@ is between GPU memory and non-pinned system memory.ModelConfigOuterClass.ModelOptimizationPolicy.Builder.clearPriority()@@ .. cpp:var:: ModelPriority priority @@ @@ The priority setting for the model.ModelConfigOuterClass.ModelOptimizationPolicy.Builder.clone()ModelConfigOuterClass.ModelConfig.Builder.getOptimizationBuilder()@@ .. cpp:var:: ModelOptimizationPolicy optimization @@ @@ Optimization configuration for the model.ModelConfigOuterClass.ModelOptimizationPolicy.Builder.mergeCuda(ModelConfigOuterClass.ModelOptimizationPolicy.Cuda value) @@ .. cpp:var:: Cuda cuda @@ @@ CUDA-specific optimization settings.ModelConfigOuterClass.ModelOptimizationPolicy.Builder.mergeExecutionAccelerators(ModelConfigOuterClass.ModelOptimizationPolicy.ExecutionAccelerators value) @@ .. cpp:var:: ExecutionAccelerators execution_accelerators @@ @@ The accelerators used for the model.ModelConfigOuterClass.ModelOptimizationPolicy.Builder.mergeFrom(com.google.protobuf.CodedInputStream input, com.google.protobuf.ExtensionRegistryLite extensionRegistry) ModelConfigOuterClass.ModelOptimizationPolicy.Builder.mergeFrom(com.google.protobuf.Message other) ModelConfigOuterClass.ModelOptimizationPolicy.Builder.mergeFrom(ModelConfigOuterClass.ModelOptimizationPolicy other) ModelConfigOuterClass.ModelOptimizationPolicy.Builder.mergeGraph(ModelConfigOuterClass.ModelOptimizationPolicy.Graph value) @@ .. cpp:var:: Graph graph @@ @@ The graph optimization setting for the model.ModelConfigOuterClass.ModelOptimizationPolicy.Builder.mergeInputPinnedMemory(ModelConfigOuterClass.ModelOptimizationPolicy.PinnedMemoryBuffer value) @@ .. cpp:var:: PinnedMemoryBuffer input_pinned_memory @@ @@ Use pinned memory buffer when the data transfer for inputs @@ is between GPU memory and non-pinned system memory.ModelConfigOuterClass.ModelOptimizationPolicy.Builder.mergeOutputPinnedMemory(ModelConfigOuterClass.ModelOptimizationPolicy.PinnedMemoryBuffer value) @@ .. cpp:var:: PinnedMemoryBuffer output_pinned_memory @@ @@ Use pinned memory buffer when the data transfer for outputs @@ is between GPU memory and non-pinned system memory.ModelConfigOuterClass.ModelOptimizationPolicy.Builder.mergeUnknownFields(com.google.protobuf.UnknownFieldSet unknownFields) ModelConfigOuterClass.ModelOptimizationPolicy.newBuilder()ModelConfigOuterClass.ModelOptimizationPolicy.newBuilder(ModelConfigOuterClass.ModelOptimizationPolicy prototype) ModelConfigOuterClass.ModelOptimizationPolicy.newBuilderForType()ModelConfigOuterClass.ModelOptimizationPolicy.newBuilderForType(com.google.protobuf.GeneratedMessageV3.BuilderParent parent) ModelConfigOuterClass.ModelOptimizationPolicy.Builder.setCuda(ModelConfigOuterClass.ModelOptimizationPolicy.Cuda value) @@ .. cpp:var:: Cuda cuda @@ @@ CUDA-specific optimization settings.ModelConfigOuterClass.ModelOptimizationPolicy.Builder.setCuda(ModelConfigOuterClass.ModelOptimizationPolicy.Cuda.Builder builderForValue) @@ .. cpp:var:: Cuda cuda @@ @@ CUDA-specific optimization settings.ModelConfigOuterClass.ModelOptimizationPolicy.Builder.setEagerBatching(boolean value) @@ .. cpp:var:: bool eager_batching @@ @@ Start preparing the next batch before the model instance is ready @@ for the next inference.ModelConfigOuterClass.ModelOptimizationPolicy.Builder.setExecutionAccelerators(ModelConfigOuterClass.ModelOptimizationPolicy.ExecutionAccelerators value) @@ .. cpp:var:: ExecutionAccelerators execution_accelerators @@ @@ The accelerators used for the model.ModelConfigOuterClass.ModelOptimizationPolicy.Builder.setExecutionAccelerators(ModelConfigOuterClass.ModelOptimizationPolicy.ExecutionAccelerators.Builder builderForValue) @@ .. cpp:var:: ExecutionAccelerators execution_accelerators @@ @@ The accelerators used for the model.ModelConfigOuterClass.ModelOptimizationPolicy.Builder.setField(com.google.protobuf.Descriptors.FieldDescriptor field, Object value) ModelConfigOuterClass.ModelOptimizationPolicy.Builder.setGatherKernelBufferThreshold(int value) @@ .. cpp:var:: uint32 gather_kernel_buffer_threshold @@ @@ The backend may use a gather kernel to gather input data if the @@ device has direct access to the source buffer and the destination @@ buffer.ModelConfigOuterClass.ModelOptimizationPolicy.Builder.setGraph(ModelConfigOuterClass.ModelOptimizationPolicy.Graph value) @@ .. cpp:var:: Graph graph @@ @@ The graph optimization setting for the model.ModelConfigOuterClass.ModelOptimizationPolicy.Builder.setGraph(ModelConfigOuterClass.ModelOptimizationPolicy.Graph.Builder builderForValue) @@ .. cpp:var:: Graph graph @@ @@ The graph optimization setting for the model.ModelConfigOuterClass.ModelOptimizationPolicy.Builder.setInputPinnedMemory(ModelConfigOuterClass.ModelOptimizationPolicy.PinnedMemoryBuffer value) @@ .. cpp:var:: PinnedMemoryBuffer input_pinned_memory @@ @@ Use pinned memory buffer when the data transfer for inputs @@ is between GPU memory and non-pinned system memory.ModelConfigOuterClass.ModelOptimizationPolicy.Builder.setInputPinnedMemory(ModelConfigOuterClass.ModelOptimizationPolicy.PinnedMemoryBuffer.Builder builderForValue) @@ .. cpp:var:: PinnedMemoryBuffer input_pinned_memory @@ @@ Use pinned memory buffer when the data transfer for inputs @@ is between GPU memory and non-pinned system memory.ModelConfigOuterClass.ModelOptimizationPolicy.Builder.setOutputPinnedMemory(ModelConfigOuterClass.ModelOptimizationPolicy.PinnedMemoryBuffer value) @@ .. cpp:var:: PinnedMemoryBuffer output_pinned_memory @@ @@ Use pinned memory buffer when the data transfer for outputs @@ is between GPU memory and non-pinned system memory.ModelConfigOuterClass.ModelOptimizationPolicy.Builder.setOutputPinnedMemory(ModelConfigOuterClass.ModelOptimizationPolicy.PinnedMemoryBuffer.Builder builderForValue) @@ .. cpp:var:: PinnedMemoryBuffer output_pinned_memory @@ @@ Use pinned memory buffer when the data transfer for outputs @@ is between GPU memory and non-pinned system memory.ModelConfigOuterClass.ModelOptimizationPolicy.Builder.setPriority(ModelConfigOuterClass.ModelOptimizationPolicy.ModelPriority value) @@ .. cpp:var:: ModelPriority priority @@ @@ The priority setting for the model.ModelConfigOuterClass.ModelOptimizationPolicy.Builder.setPriorityValue(int value) @@ .. cpp:var:: ModelPriority priority @@ @@ The priority setting for the model.ModelConfigOuterClass.ModelOptimizationPolicy.Builder.setRepeatedField(com.google.protobuf.Descriptors.FieldDescriptor field, int index, Object value) ModelConfigOuterClass.ModelOptimizationPolicy.Builder.setUnknownFields(com.google.protobuf.UnknownFieldSet unknownFields) ModelConfigOuterClass.ModelOptimizationPolicy.toBuilder()Methods in inference with parameters of type ModelConfigOuterClass.ModelOptimizationPolicy.BuilderModifier and TypeMethodDescriptionModelConfigOuterClass.ModelConfig.Builder.setOptimization(ModelConfigOuterClass.ModelOptimizationPolicy.Builder builderForValue) @@ .. cpp:var:: ModelOptimizationPolicy optimization @@ @@ Optimization configuration for the model.