Package com.gencior.triton.core

Class InferParameters

java.lang.Object

com.gencior.triton.core.InferParameters

public final class InferParameters
extends Object

Represents a set of custom parameters for an inference request.

This class provides a protocol-agnostic abstraction over inference parameters, decoupling the public API from the underlying transport (gRPC, HTTP). Values can be of type String, Long, Boolean, or Double.

Use the InferParameters.Builder to construct instances:

 InferParameters params = new InferParameters.Builder()
     .add("temperature", 0.7)
     .add("max_tokens", 100L)
     .add("use_cache", true)
     .build();

 InferResult result = client.infer(modelId, inputs, params);
 

Since:

1.0.0

Author:

sachachoumiloff

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static class	InferParameters.Builder	Builder for constructing InferParameters instances.

Method Summary

Modifier and Type	Method	Description
Map<String,Object>	asMap()	Returns the parameters as an unmodifiable map.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Details

asMap

public Map<String,Object> asMap()

Returns the parameters as an unmodifiable map.

Returns:

the parameters map