CreateDynamoDeploymentRequest.md

CreateDynamoDeploymentRequest

Create a Dynamo deployment. Aggregated mode requires hardware_instance_id; disaggregated mode requires fixed-size worker_pools.

Properties

Name	Type	Description	Notes
max_surge	int		[optional]
max_unavailable	int		[optional]
name	str
cluster_id	int
hardware_instance_id	int		[optional]
user_annotations	Dict[str, str]		[optional]
chart_revision	str		[optional]
serving_mode	DynamoServingMode		[optional]
worker_pools	DynamoWorkerPools		[optional]
model	str
served_model_name	str		[optional]
min_replicas	int		[optional] [default to 1]
max_replicas	int		[optional] [default to 1]
concurrency	int		[optional]
cooldown_period	int		[optional]
extra_args	str		[optional]
hf_token	str		[optional]
env_vars	Dict[str, str]		[optional]
endpoint_bearer_token	str		[optional]
endpoint_certificate_authority	str		[optional]
enable_logging	bool		[optional] [default to True]
enable_node_model_cache	bool		[optional] [default to False]
backend_protocol	BackendProtocol		[optional]

Example

from platform_api_python_client.models.create_dynamo_deployment_request import CreateDynamoDeploymentRequest

# TODO update the JSON string below
json = "{}"
# create an instance of CreateDynamoDeploymentRequest from a JSON string
create_dynamo_deployment_request_instance = CreateDynamoDeploymentRequest.from_json(json)
# print the JSON string representation of the object
print(CreateDynamoDeploymentRequest.to_json())

# convert the object into a dict
create_dynamo_deployment_request_dict = create_dynamo_deployment_request_instance.to_dict()
# create an instance of CreateDynamoDeploymentRequest from a dict
create_dynamo_deployment_request_from_dict = CreateDynamoDeploymentRequest.from_dict(create_dynamo_deployment_request_dict)

[Back to Model list] [Back to API list] [Back to README]