CPU 1x Intel Sapphire Rapids tei $0.033 / hr CUSTOM Define your own configuration. Custom

Amazon Web Services

Microsoft Azure

Google Cloud Platform

Intel Sapphire Rapids

1x vCPU · 2 GB

$0.033 / h

Catalog Recipe Pre-selected hardware for the current recipe.

Private Public Authenticated

Only you can access your endpoint, using a Hugging Face Token generated from your personal account.

Automatic Scale-to-Zero

Endpoints scaled to 0 replicas are not billed. They may take some time to scale back up once they start receiving requests again.

Number of replicas

Automatically scale the number of replicas within Min and Max based on compute usage. Min is always 0 if Scale-To-Zero is active.

Min Max

More options

Daily Autoscaling Schedule

Overrides the Endpoint's Min, Max and Scale-to-Zero settings. Each entry applies from its start time until the start time of the next one, every day. An entry with Min above 0 wakes a scaled-to-zero endpoint.

Autoscaling Strategy

Control what type of trigger will cause your Endpoint to scale up.

Hardware Usage Pending Requests

Hardware Utilization Threshold (%)

A scale up event will be triggered if the average hardware utilisation (%) exceeds this threshold for more than 20 seconds.

This Catalog Recipe comes with a pre-configured Text Embeddings Inference engine.

Engine Container URL optional

Server Arguments

Arguments passed to the engine server entrypoint.

optional

Server Command

Command executed as engine server entrypoint.

optional

Default Env values come from the Catalog Recipe and can't be edited during Endpoint creation.

Default Env

Environment variables that will be provided to your container during deployment.

Secret Env

Same as Default, but people with access to this endpoint will not be able to read these values after creation.

VPC Config

Check to activate and configure AWS PrivateLink

Use AWS PrivateLink

all-MiniLM-L6-v2