Uses of Class
inference.ModelConfigOuterClass.ModelConfig.Builder
Packages that use ModelConfigOuterClass.ModelConfig.Builder
-
Uses of ModelConfigOuterClass.ModelConfig.Builder in inference
Methods in inference that return ModelConfigOuterClass.ModelConfig.BuilderModifier and TypeMethodDescriptionModelConfigOuterClass.ModelConfig.Builder.addAllBatchInput(Iterable<? extends ModelConfigOuterClass.BatchInput> values) @@ .. cpp:var:: BatchInput batch_input (repeated) @@ @@ The model input(s) that the server should use to communicate @@ batch related values to the model.ModelConfigOuterClass.ModelConfig.Builder.addAllBatchOutput(Iterable<? extends ModelConfigOuterClass.BatchOutput> values) @@ .. cpp:var:: BatchOutput batch_output (repeated) @@ @@ The outputs produced by the model that requires special handling @@ by the model backend.ModelConfigOuterClass.ModelConfig.Builder.addAllInput(Iterable<? extends ModelConfigOuterClass.ModelInput> values) @@ .. cpp:var:: ModelInput input (repeated) @@ @@ The inputs request by the model.ModelConfigOuterClass.ModelConfig.Builder.addAllInstanceGroup(Iterable<? extends ModelConfigOuterClass.ModelInstanceGroup> values) @@ .. cpp:var:: ModelInstanceGroup instance_group (repeated) @@ @@ Instances of this model.ModelConfigOuterClass.ModelConfig.Builder.addAllModelWarmup(Iterable<? extends ModelConfigOuterClass.ModelWarmup> values) @@ .. cpp:var:: ModelWarmup model_warmup (repeated) @@ @@ Warmup setting of this model.ModelConfigOuterClass.ModelConfig.Builder.addAllOutput(Iterable<? extends ModelConfigOuterClass.ModelOutput> values) @@ .. cpp:var:: ModelOutput output (repeated) @@ @@ The outputs produced by the model.ModelConfigOuterClass.ModelConfig.Builder.addBatchInput(int index, ModelConfigOuterClass.BatchInput value) @@ .. cpp:var:: BatchInput batch_input (repeated) @@ @@ The model input(s) that the server should use to communicate @@ batch related values to the model.ModelConfigOuterClass.ModelConfig.Builder.addBatchInput(int index, ModelConfigOuterClass.BatchInput.Builder builderForValue) @@ .. cpp:var:: BatchInput batch_input (repeated) @@ @@ The model input(s) that the server should use to communicate @@ batch related values to the model.ModelConfigOuterClass.ModelConfig.Builder.addBatchInput(ModelConfigOuterClass.BatchInput value) @@ .. cpp:var:: BatchInput batch_input (repeated) @@ @@ The model input(s) that the server should use to communicate @@ batch related values to the model.ModelConfigOuterClass.ModelConfig.Builder.addBatchInput(ModelConfigOuterClass.BatchInput.Builder builderForValue) @@ .. cpp:var:: BatchInput batch_input (repeated) @@ @@ The model input(s) that the server should use to communicate @@ batch related values to the model.ModelConfigOuterClass.ModelConfig.Builder.addBatchOutput(int index, ModelConfigOuterClass.BatchOutput value) @@ .. cpp:var:: BatchOutput batch_output (repeated) @@ @@ The outputs produced by the model that requires special handling @@ by the model backend.ModelConfigOuterClass.ModelConfig.Builder.addBatchOutput(int index, ModelConfigOuterClass.BatchOutput.Builder builderForValue) @@ .. cpp:var:: BatchOutput batch_output (repeated) @@ @@ The outputs produced by the model that requires special handling @@ by the model backend.ModelConfigOuterClass.ModelConfig.Builder.addBatchOutput(ModelConfigOuterClass.BatchOutput value) @@ .. cpp:var:: BatchOutput batch_output (repeated) @@ @@ The outputs produced by the model that requires special handling @@ by the model backend.ModelConfigOuterClass.ModelConfig.Builder.addBatchOutput(ModelConfigOuterClass.BatchOutput.Builder builderForValue) @@ .. cpp:var:: BatchOutput batch_output (repeated) @@ @@ The outputs produced by the model that requires special handling @@ by the model backend.ModelConfigOuterClass.ModelConfig.Builder.addInput(int index, ModelConfigOuterClass.ModelInput value) @@ .. cpp:var:: ModelInput input (repeated) @@ @@ The inputs request by the model.ModelConfigOuterClass.ModelConfig.Builder.addInput(int index, ModelConfigOuterClass.ModelInput.Builder builderForValue) @@ .. cpp:var:: ModelInput input (repeated) @@ @@ The inputs request by the model.ModelConfigOuterClass.ModelConfig.Builder.addInput(ModelConfigOuterClass.ModelInput value) @@ .. cpp:var:: ModelInput input (repeated) @@ @@ The inputs request by the model.ModelConfigOuterClass.ModelConfig.Builder.addInput(ModelConfigOuterClass.ModelInput.Builder builderForValue) @@ .. cpp:var:: ModelInput input (repeated) @@ @@ The inputs request by the model.ModelConfigOuterClass.ModelConfig.Builder.addInstanceGroup(int index, ModelConfigOuterClass.ModelInstanceGroup value) @@ .. cpp:var:: ModelInstanceGroup instance_group (repeated) @@ @@ Instances of this model.ModelConfigOuterClass.ModelConfig.Builder.addInstanceGroup(int index, ModelConfigOuterClass.ModelInstanceGroup.Builder builderForValue) @@ .. cpp:var:: ModelInstanceGroup instance_group (repeated) @@ @@ Instances of this model.ModelConfigOuterClass.ModelConfig.Builder.addInstanceGroup(ModelConfigOuterClass.ModelInstanceGroup value) @@ .. cpp:var:: ModelInstanceGroup instance_group (repeated) @@ @@ Instances of this model.ModelConfigOuterClass.ModelConfig.Builder.addInstanceGroup(ModelConfigOuterClass.ModelInstanceGroup.Builder builderForValue) @@ .. cpp:var:: ModelInstanceGroup instance_group (repeated) @@ @@ Instances of this model.ModelConfigOuterClass.ModelConfig.Builder.addModelWarmup(int index, ModelConfigOuterClass.ModelWarmup value) @@ .. cpp:var:: ModelWarmup model_warmup (repeated) @@ @@ Warmup setting of this model.ModelConfigOuterClass.ModelConfig.Builder.addModelWarmup(int index, ModelConfigOuterClass.ModelWarmup.Builder builderForValue) @@ .. cpp:var:: ModelWarmup model_warmup (repeated) @@ @@ Warmup setting of this model.ModelConfigOuterClass.ModelConfig.Builder.addModelWarmup(ModelConfigOuterClass.ModelWarmup value) @@ .. cpp:var:: ModelWarmup model_warmup (repeated) @@ @@ Warmup setting of this model.ModelConfigOuterClass.ModelConfig.Builder.addModelWarmup(ModelConfigOuterClass.ModelWarmup.Builder builderForValue) @@ .. cpp:var:: ModelWarmup model_warmup (repeated) @@ @@ Warmup setting of this model.ModelConfigOuterClass.ModelConfig.Builder.addOutput(int index, ModelConfigOuterClass.ModelOutput value) @@ .. cpp:var:: ModelOutput output (repeated) @@ @@ The outputs produced by the model.ModelConfigOuterClass.ModelConfig.Builder.addOutput(int index, ModelConfigOuterClass.ModelOutput.Builder builderForValue) @@ .. cpp:var:: ModelOutput output (repeated) @@ @@ The outputs produced by the model.ModelConfigOuterClass.ModelConfig.Builder.addOutput(ModelConfigOuterClass.ModelOutput value) @@ .. cpp:var:: ModelOutput output (repeated) @@ @@ The outputs produced by the model.ModelConfigOuterClass.ModelConfig.Builder.addOutput(ModelConfigOuterClass.ModelOutput.Builder builderForValue) @@ .. cpp:var:: ModelOutput output (repeated) @@ @@ The outputs produced by the model.ModelConfigOuterClass.ModelConfig.Builder.addRepeatedField(com.google.protobuf.Descriptors.FieldDescriptor field, Object value) ModelConfigOuterClass.ModelConfig.Builder.clear()ModelConfigOuterClass.ModelConfig.Builder.clearBackend()@@ .. cpp:var:: string backend @@ @@ The backend used by the model.ModelConfigOuterClass.ModelConfig.Builder.clearBatchInput()@@ .. cpp:var:: BatchInput batch_input (repeated) @@ @@ The model input(s) that the server should use to communicate @@ batch related values to the model.ModelConfigOuterClass.ModelConfig.Builder.clearBatchOutput()@@ .. cpp:var:: BatchOutput batch_output (repeated) @@ @@ The outputs produced by the model that requires special handling @@ by the model backend.ModelConfigOuterClass.ModelConfig.Builder.clearCcModelFilenames()ModelConfigOuterClass.ModelConfig.Builder.clearDefaultModelFilename()@@ .. cpp:var:: string default_model_filename @@ @@ Optional filename of the model file to use if a @@ compute-capability specific model is not specified in @@ :cpp:var:`cc_model_filenames`.ModelConfigOuterClass.ModelConfig.Builder.clearDynamicBatching()@@ .. cpp:var:: ModelDynamicBatching dynamic_batching @@ @@ If specified, enables the dynamic-batching scheduling @@ policy.ModelConfigOuterClass.ModelConfig.Builder.clearEnsembleScheduling()@@ .. cpp:var:: ModelEnsembling ensemble_scheduling @@ @@ If specified, enables the model-ensembling scheduling @@ policy.ModelConfigOuterClass.ModelConfig.Builder.clearField(com.google.protobuf.Descriptors.FieldDescriptor field) ModelConfigOuterClass.ModelConfig.Builder.clearInput()@@ .. cpp:var:: ModelInput input (repeated) @@ @@ The inputs request by the model.ModelConfigOuterClass.ModelConfig.Builder.clearInstanceGroup()@@ .. cpp:var:: ModelInstanceGroup instance_group (repeated) @@ @@ Instances of this model.ModelConfigOuterClass.ModelConfig.Builder.clearMaxBatchSize()@@ .. cpp:var:: int32 max_batch_size @@ @@ Maximum batch size allowed for inference.ModelConfigOuterClass.ModelConfig.Builder.clearMetricTags()ModelConfigOuterClass.ModelConfig.Builder.clearModelMetrics()@@ .. cpp:var:: ModelMetrics model_metrics @@ @@ Optional setting for custom metrics configuration for this model.ModelConfigOuterClass.ModelConfig.Builder.clearModelOperations()@@ .. cpp:var:: ModelOperations model_operations @@ @@ Optional metadata of the libraries providing custom operations for @@ this model.ModelConfigOuterClass.ModelConfig.Builder.clearModelRepositoryAgents()@@ .. cpp:var:: ModelRepositoryAgents model_repository_agents @@ @@ Optional specification of the agent(s) that should be invoked @@ with repository actions are performed for this model.ModelConfigOuterClass.ModelConfig.Builder.clearModelTransactionPolicy()@@ .. cpp:var:: ModelTransactionPolicy model_transaction_policy @@ @@ Optional specification that describes the nature of transactions @@ to be expected from the model.ModelConfigOuterClass.ModelConfig.Builder.clearModelWarmup()@@ .. cpp:var:: ModelWarmup model_warmup (repeated) @@ @@ Warmup setting of this model.ModelConfigOuterClass.ModelConfig.Builder.clearName()@@ .. cpp:var:: string name @@ @@ The name of the model.ModelConfigOuterClass.ModelConfig.Builder.clearOneof(com.google.protobuf.Descriptors.OneofDescriptor oneof) ModelConfigOuterClass.ModelConfig.Builder.clearOptimization()@@ .. cpp:var:: ModelOptimizationPolicy optimization @@ @@ Optimization configuration for the model.ModelConfigOuterClass.ModelConfig.Builder.clearOutput()@@ .. cpp:var:: ModelOutput output (repeated) @@ @@ The outputs produced by the model.ModelConfigOuterClass.ModelConfig.Builder.clearParameters()ModelConfigOuterClass.ModelConfig.Builder.clearPlatform()@@ .. cpp:var:: string platform @@ @@ Additional backend-specific configuration for the model.ModelConfigOuterClass.ModelConfig.Builder.clearResponseCache()@@ .. cpp:var:: ModelResponseCache response_cache @@ @@ Optional setting for utilizing the response cache for this @@ model.ModelConfigOuterClass.ModelConfig.Builder.clearRuntime()@@ .. cpp:var:: string runtime @@ @@ The name of the backend library file used by the model.ModelConfigOuterClass.ModelConfig.Builder.clearSchedulingChoice()ModelConfigOuterClass.ModelConfig.Builder.clearSequenceBatching()@@ .. cpp:var:: ModelSequenceBatching sequence_batching @@ @@ If specified, enables the sequence-batching scheduling @@ policy.ModelConfigOuterClass.ModelConfig.Builder.clearVersionPolicy()@@ .. cpp:var:: ModelVersionPolicy version_policy @@ @@ Policy indicating which version(s) of the model will be served.ModelConfigOuterClass.ModelConfig.Builder.clone()GrpcService.ModelConfigResponse.Builder.getConfigBuilder()@@ @@ .. cpp:var:: ModelConfig config @@ @@ The model configuration.ModelConfigOuterClass.ModelConfig.Builder.mergeDynamicBatching(ModelConfigOuterClass.ModelDynamicBatching value) @@ .. cpp:var:: ModelDynamicBatching dynamic_batching @@ @@ If specified, enables the dynamic-batching scheduling @@ policy.ModelConfigOuterClass.ModelConfig.Builder.mergeEnsembleScheduling(ModelConfigOuterClass.ModelEnsembling value) @@ .. cpp:var:: ModelEnsembling ensemble_scheduling @@ @@ If specified, enables the model-ensembling scheduling @@ policy.ModelConfigOuterClass.ModelConfig.Builder.mergeFrom(com.google.protobuf.CodedInputStream input, com.google.protobuf.ExtensionRegistryLite extensionRegistry) ModelConfigOuterClass.ModelConfig.Builder.mergeFrom(com.google.protobuf.Message other) ModelConfigOuterClass.ModelConfig.Builder.mergeFrom(ModelConfigOuterClass.ModelConfig other) ModelConfigOuterClass.ModelConfig.Builder.mergeModelMetrics(ModelConfigOuterClass.ModelMetrics value) @@ .. cpp:var:: ModelMetrics model_metrics @@ @@ Optional setting for custom metrics configuration for this model.ModelConfigOuterClass.ModelConfig.Builder.mergeModelOperations(ModelConfigOuterClass.ModelOperations value) @@ .. cpp:var:: ModelOperations model_operations @@ @@ Optional metadata of the libraries providing custom operations for @@ this model.ModelConfigOuterClass.ModelConfig.Builder.mergeModelRepositoryAgents(ModelConfigOuterClass.ModelRepositoryAgents value) @@ .. cpp:var:: ModelRepositoryAgents model_repository_agents @@ @@ Optional specification of the agent(s) that should be invoked @@ with repository actions are performed for this model.ModelConfigOuterClass.ModelConfig.Builder.mergeModelTransactionPolicy(ModelConfigOuterClass.ModelTransactionPolicy value) @@ .. cpp:var:: ModelTransactionPolicy model_transaction_policy @@ @@ Optional specification that describes the nature of transactions @@ to be expected from the model.ModelConfigOuterClass.ModelConfig.Builder.mergeOptimization(ModelConfigOuterClass.ModelOptimizationPolicy value) @@ .. cpp:var:: ModelOptimizationPolicy optimization @@ @@ Optimization configuration for the model.ModelConfigOuterClass.ModelConfig.Builder.mergeResponseCache(ModelConfigOuterClass.ModelResponseCache value) @@ .. cpp:var:: ModelResponseCache response_cache @@ @@ Optional setting for utilizing the response cache for this @@ model.ModelConfigOuterClass.ModelConfig.Builder.mergeSequenceBatching(ModelConfigOuterClass.ModelSequenceBatching value) @@ .. cpp:var:: ModelSequenceBatching sequence_batching @@ @@ If specified, enables the sequence-batching scheduling @@ policy.ModelConfigOuterClass.ModelConfig.Builder.mergeUnknownFields(com.google.protobuf.UnknownFieldSet unknownFields) ModelConfigOuterClass.ModelConfig.Builder.mergeVersionPolicy(ModelConfigOuterClass.ModelVersionPolicy value) @@ .. cpp:var:: ModelVersionPolicy version_policy @@ @@ Policy indicating which version(s) of the model will be served.ModelConfigOuterClass.ModelConfig.newBuilder()ModelConfigOuterClass.ModelConfig.newBuilder(ModelConfigOuterClass.ModelConfig prototype) ModelConfigOuterClass.ModelConfig.newBuilderForType()ModelConfigOuterClass.ModelConfig.newBuilderForType(com.google.protobuf.GeneratedMessageV3.BuilderParent parent) ModelConfigOuterClass.ModelConfig.Builder.putAllCcModelFilenames(Map<String, String> values) @@ .. cpp:var:: map<string,string> cc_model_filenames @@ @@ Optional map from CUDA compute capability to the filename of @@ the model that supports that compute capability.ModelConfigOuterClass.ModelConfig.Builder.putAllMetricTags(Map<String, String> values) @@ .. cpp:var:: map<string,string> metric_tags @@ @@ Optional metric tags.ModelConfigOuterClass.ModelConfig.Builder.putAllParameters(Map<String, ModelConfigOuterClass.ModelParameter> values) @@ .. cpp:var:: map<string,ModelParameter> parameters @@ @@ Optional model parameters.ModelConfigOuterClass.ModelConfig.Builder.putCcModelFilenames(String key, String value) @@ .. cpp:var:: map<string,string> cc_model_filenames @@ @@ Optional map from CUDA compute capability to the filename of @@ the model that supports that compute capability.ModelConfigOuterClass.ModelConfig.Builder.putMetricTags(String key, String value) @@ .. cpp:var:: map<string,string> metric_tags @@ @@ Optional metric tags.ModelConfigOuterClass.ModelConfig.Builder.putParameters(String key, ModelConfigOuterClass.ModelParameter value) @@ .. cpp:var:: map<string,ModelParameter> parameters @@ @@ Optional model parameters.ModelConfigOuterClass.ModelConfig.Builder.removeBatchInput(int index) @@ .. cpp:var:: BatchInput batch_input (repeated) @@ @@ The model input(s) that the server should use to communicate @@ batch related values to the model.ModelConfigOuterClass.ModelConfig.Builder.removeBatchOutput(int index) @@ .. cpp:var:: BatchOutput batch_output (repeated) @@ @@ The outputs produced by the model that requires special handling @@ by the model backend.ModelConfigOuterClass.ModelConfig.Builder.removeCcModelFilenames(String key) @@ .. cpp:var:: map<string,string> cc_model_filenames @@ @@ Optional map from CUDA compute capability to the filename of @@ the model that supports that compute capability.ModelConfigOuterClass.ModelConfig.Builder.removeInput(int index) @@ .. cpp:var:: ModelInput input (repeated) @@ @@ The inputs request by the model.ModelConfigOuterClass.ModelConfig.Builder.removeInstanceGroup(int index) @@ .. cpp:var:: ModelInstanceGroup instance_group (repeated) @@ @@ Instances of this model.ModelConfigOuterClass.ModelConfig.Builder.removeMetricTags(String key) @@ .. cpp:var:: map<string,string> metric_tags @@ @@ Optional metric tags.ModelConfigOuterClass.ModelConfig.Builder.removeModelWarmup(int index) @@ .. cpp:var:: ModelWarmup model_warmup (repeated) @@ @@ Warmup setting of this model.ModelConfigOuterClass.ModelConfig.Builder.removeOutput(int index) @@ .. cpp:var:: ModelOutput output (repeated) @@ @@ The outputs produced by the model.ModelConfigOuterClass.ModelConfig.Builder.removeParameters(String key) @@ .. cpp:var:: map<string,ModelParameter> parameters @@ @@ Optional model parameters.ModelConfigOuterClass.ModelConfig.Builder.setBackend(String value) @@ .. cpp:var:: string backend @@ @@ The backend used by the model.ModelConfigOuterClass.ModelConfig.Builder.setBackendBytes(com.google.protobuf.ByteString value) @@ .. cpp:var:: string backend @@ @@ The backend used by the model.ModelConfigOuterClass.ModelConfig.Builder.setBatchInput(int index, ModelConfigOuterClass.BatchInput value) @@ .. cpp:var:: BatchInput batch_input (repeated) @@ @@ The model input(s) that the server should use to communicate @@ batch related values to the model.ModelConfigOuterClass.ModelConfig.Builder.setBatchInput(int index, ModelConfigOuterClass.BatchInput.Builder builderForValue) @@ .. cpp:var:: BatchInput batch_input (repeated) @@ @@ The model input(s) that the server should use to communicate @@ batch related values to the model.ModelConfigOuterClass.ModelConfig.Builder.setBatchOutput(int index, ModelConfigOuterClass.BatchOutput value) @@ .. cpp:var:: BatchOutput batch_output (repeated) @@ @@ The outputs produced by the model that requires special handling @@ by the model backend.ModelConfigOuterClass.ModelConfig.Builder.setBatchOutput(int index, ModelConfigOuterClass.BatchOutput.Builder builderForValue) @@ .. cpp:var:: BatchOutput batch_output (repeated) @@ @@ The outputs produced by the model that requires special handling @@ by the model backend.ModelConfigOuterClass.ModelConfig.Builder.setDefaultModelFilename(String value) @@ .. cpp:var:: string default_model_filename @@ @@ Optional filename of the model file to use if a @@ compute-capability specific model is not specified in @@ :cpp:var:`cc_model_filenames`.ModelConfigOuterClass.ModelConfig.Builder.setDefaultModelFilenameBytes(com.google.protobuf.ByteString value) @@ .. cpp:var:: string default_model_filename @@ @@ Optional filename of the model file to use if a @@ compute-capability specific model is not specified in @@ :cpp:var:`cc_model_filenames`.ModelConfigOuterClass.ModelConfig.Builder.setDynamicBatching(ModelConfigOuterClass.ModelDynamicBatching value) @@ .. cpp:var:: ModelDynamicBatching dynamic_batching @@ @@ If specified, enables the dynamic-batching scheduling @@ policy.ModelConfigOuterClass.ModelConfig.Builder.setDynamicBatching(ModelConfigOuterClass.ModelDynamicBatching.Builder builderForValue) @@ .. cpp:var:: ModelDynamicBatching dynamic_batching @@ @@ If specified, enables the dynamic-batching scheduling @@ policy.ModelConfigOuterClass.ModelConfig.Builder.setEnsembleScheduling(ModelConfigOuterClass.ModelEnsembling value) @@ .. cpp:var:: ModelEnsembling ensemble_scheduling @@ @@ If specified, enables the model-ensembling scheduling @@ policy.ModelConfigOuterClass.ModelConfig.Builder.setEnsembleScheduling(ModelConfigOuterClass.ModelEnsembling.Builder builderForValue) @@ .. cpp:var:: ModelEnsembling ensemble_scheduling @@ @@ If specified, enables the model-ensembling scheduling @@ policy.ModelConfigOuterClass.ModelConfig.Builder.setField(com.google.protobuf.Descriptors.FieldDescriptor field, Object value) ModelConfigOuterClass.ModelConfig.Builder.setInput(int index, ModelConfigOuterClass.ModelInput value) @@ .. cpp:var:: ModelInput input (repeated) @@ @@ The inputs request by the model.ModelConfigOuterClass.ModelConfig.Builder.setInput(int index, ModelConfigOuterClass.ModelInput.Builder builderForValue) @@ .. cpp:var:: ModelInput input (repeated) @@ @@ The inputs request by the model.ModelConfigOuterClass.ModelConfig.Builder.setInstanceGroup(int index, ModelConfigOuterClass.ModelInstanceGroup value) @@ .. cpp:var:: ModelInstanceGroup instance_group (repeated) @@ @@ Instances of this model.ModelConfigOuterClass.ModelConfig.Builder.setInstanceGroup(int index, ModelConfigOuterClass.ModelInstanceGroup.Builder builderForValue) @@ .. cpp:var:: ModelInstanceGroup instance_group (repeated) @@ @@ Instances of this model.ModelConfigOuterClass.ModelConfig.Builder.setMaxBatchSize(int value) @@ .. cpp:var:: int32 max_batch_size @@ @@ Maximum batch size allowed for inference.ModelConfigOuterClass.ModelConfig.Builder.setModelMetrics(ModelConfigOuterClass.ModelMetrics value) @@ .. cpp:var:: ModelMetrics model_metrics @@ @@ Optional setting for custom metrics configuration for this model.ModelConfigOuterClass.ModelConfig.Builder.setModelMetrics(ModelConfigOuterClass.ModelMetrics.Builder builderForValue) @@ .. cpp:var:: ModelMetrics model_metrics @@ @@ Optional setting for custom metrics configuration for this model.ModelConfigOuterClass.ModelConfig.Builder.setModelOperations(ModelConfigOuterClass.ModelOperations value) @@ .. cpp:var:: ModelOperations model_operations @@ @@ Optional metadata of the libraries providing custom operations for @@ this model.ModelConfigOuterClass.ModelConfig.Builder.setModelOperations(ModelConfigOuterClass.ModelOperations.Builder builderForValue) @@ .. cpp:var:: ModelOperations model_operations @@ @@ Optional metadata of the libraries providing custom operations for @@ this model.ModelConfigOuterClass.ModelConfig.Builder.setModelRepositoryAgents(ModelConfigOuterClass.ModelRepositoryAgents value) @@ .. cpp:var:: ModelRepositoryAgents model_repository_agents @@ @@ Optional specification of the agent(s) that should be invoked @@ with repository actions are performed for this model.ModelConfigOuterClass.ModelConfig.Builder.setModelRepositoryAgents(ModelConfigOuterClass.ModelRepositoryAgents.Builder builderForValue) @@ .. cpp:var:: ModelRepositoryAgents model_repository_agents @@ @@ Optional specification of the agent(s) that should be invoked @@ with repository actions are performed for this model.ModelConfigOuterClass.ModelConfig.Builder.setModelTransactionPolicy(ModelConfigOuterClass.ModelTransactionPolicy value) @@ .. cpp:var:: ModelTransactionPolicy model_transaction_policy @@ @@ Optional specification that describes the nature of transactions @@ to be expected from the model.ModelConfigOuterClass.ModelConfig.Builder.setModelTransactionPolicy(ModelConfigOuterClass.ModelTransactionPolicy.Builder builderForValue) @@ .. cpp:var:: ModelTransactionPolicy model_transaction_policy @@ @@ Optional specification that describes the nature of transactions @@ to be expected from the model.ModelConfigOuterClass.ModelConfig.Builder.setModelWarmup(int index, ModelConfigOuterClass.ModelWarmup value) @@ .. cpp:var:: ModelWarmup model_warmup (repeated) @@ @@ Warmup setting of this model.ModelConfigOuterClass.ModelConfig.Builder.setModelWarmup(int index, ModelConfigOuterClass.ModelWarmup.Builder builderForValue) @@ .. cpp:var:: ModelWarmup model_warmup (repeated) @@ @@ Warmup setting of this model.@@ .. cpp:var:: string name @@ @@ The name of the model.ModelConfigOuterClass.ModelConfig.Builder.setNameBytes(com.google.protobuf.ByteString value) @@ .. cpp:var:: string name @@ @@ The name of the model.ModelConfigOuterClass.ModelConfig.Builder.setOptimization(ModelConfigOuterClass.ModelOptimizationPolicy value) @@ .. cpp:var:: ModelOptimizationPolicy optimization @@ @@ Optimization configuration for the model.ModelConfigOuterClass.ModelConfig.Builder.setOptimization(ModelConfigOuterClass.ModelOptimizationPolicy.Builder builderForValue) @@ .. cpp:var:: ModelOptimizationPolicy optimization @@ @@ Optimization configuration for the model.ModelConfigOuterClass.ModelConfig.Builder.setOutput(int index, ModelConfigOuterClass.ModelOutput value) @@ .. cpp:var:: ModelOutput output (repeated) @@ @@ The outputs produced by the model.ModelConfigOuterClass.ModelConfig.Builder.setOutput(int index, ModelConfigOuterClass.ModelOutput.Builder builderForValue) @@ .. cpp:var:: ModelOutput output (repeated) @@ @@ The outputs produced by the model.ModelConfigOuterClass.ModelConfig.Builder.setPlatform(String value) @@ .. cpp:var:: string platform @@ @@ Additional backend-specific configuration for the model.ModelConfigOuterClass.ModelConfig.Builder.setPlatformBytes(com.google.protobuf.ByteString value) @@ .. cpp:var:: string platform @@ @@ Additional backend-specific configuration for the model.ModelConfigOuterClass.ModelConfig.Builder.setRepeatedField(com.google.protobuf.Descriptors.FieldDescriptor field, int index, Object value) ModelConfigOuterClass.ModelConfig.Builder.setResponseCache(ModelConfigOuterClass.ModelResponseCache value) @@ .. cpp:var:: ModelResponseCache response_cache @@ @@ Optional setting for utilizing the response cache for this @@ model.ModelConfigOuterClass.ModelConfig.Builder.setResponseCache(ModelConfigOuterClass.ModelResponseCache.Builder builderForValue) @@ .. cpp:var:: ModelResponseCache response_cache @@ @@ Optional setting for utilizing the response cache for this @@ model.ModelConfigOuterClass.ModelConfig.Builder.setRuntime(String value) @@ .. cpp:var:: string runtime @@ @@ The name of the backend library file used by the model.ModelConfigOuterClass.ModelConfig.Builder.setRuntimeBytes(com.google.protobuf.ByteString value) @@ .. cpp:var:: string runtime @@ @@ The name of the backend library file used by the model.ModelConfigOuterClass.ModelConfig.Builder.setSequenceBatching(ModelConfigOuterClass.ModelSequenceBatching value) @@ .. cpp:var:: ModelSequenceBatching sequence_batching @@ @@ If specified, enables the sequence-batching scheduling @@ policy.ModelConfigOuterClass.ModelConfig.Builder.setSequenceBatching(ModelConfigOuterClass.ModelSequenceBatching.Builder builderForValue) @@ .. cpp:var:: ModelSequenceBatching sequence_batching @@ @@ If specified, enables the sequence-batching scheduling @@ policy.ModelConfigOuterClass.ModelConfig.Builder.setUnknownFields(com.google.protobuf.UnknownFieldSet unknownFields) ModelConfigOuterClass.ModelConfig.Builder.setVersionPolicy(ModelConfigOuterClass.ModelVersionPolicy value) @@ .. cpp:var:: ModelVersionPolicy version_policy @@ @@ Policy indicating which version(s) of the model will be served.ModelConfigOuterClass.ModelConfig.Builder.setVersionPolicy(ModelConfigOuterClass.ModelVersionPolicy.Builder builderForValue) @@ .. cpp:var:: ModelVersionPolicy version_policy @@ @@ Policy indicating which version(s) of the model will be served.ModelConfigOuterClass.ModelConfig.toBuilder()Methods in inference with parameters of type ModelConfigOuterClass.ModelConfig.BuilderModifier and TypeMethodDescriptionGrpcService.ModelConfigResponse.Builder.setConfig(ModelConfigOuterClass.ModelConfig.Builder builderForValue) @@ @@ .. cpp:var:: ModelConfig config @@ @@ The model configuration.