# Custom Attributes for Asynchronous Endpoint Sagemaker

**URL:** <https://discuss.huggingface.co/t/custom-attributes-for-asynchronous-endpoint-sagemaker/138638>\
**Category:** Amazon SageMaker\
**Created:** [February 3, 2025, 1:33am UTC](https://discuss.huggingface.co/t/custom-attributes-for-asynchronous-endpoint-sagemaker/138638 "2025-02-03T01:33:54Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![quanamifiable2023](https://avatars.discourse-cdn.com/v4/letter/q/7ea924/32.png) [@quanamifiable2023](https://discuss.huggingface.co/u/quanamifiable2023)\
**Post date:** [February 3, 2025, 1:33am UTC](https://discuss.huggingface.co/t/custom-attributes-for-asynchronous-endpoint-sagemaker/138638/1 "2025-02-03T01:33:54Z")

</div>

I am using AWS Sagemaker to host an asynchronous endpoint.  
I have a custom inference.py code for this task.  
This is how i invoke the endpoint using boto3:

```auto
response = client.invoke_endpoint_async(
    EndpointName='string',
    ContentType='string',
    Accept='string',
    CustomAttributes='string',
    InferenceId='string',
    InputLocation='string',
    RequestTTLSeconds=123,
    InvocationTimeoutSeconds=123
)

```

I use [https://github.com/aws/sagemaker-huggingface-inference-toolkit](https://github.com/aws/sagemaker-huggingface-inference-toolkit) to custom the endpoint.  
However, I have a question that: where can I access the CustomAttributes. in sagemaker-huggingface-inference-toolkit?

Any help is appreciated. Thanks

---

<div class="post-metadata">

**Author:** ![pagezyhf](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/pagezyhf/32/29572_2.png) [@pagezyhf](https://discuss.huggingface.co/u/pagezyhf)\
**Post date:** [February 20, 2025, 11:07am UTC](https://discuss.huggingface.co/t/custom-attributes-for-asynchronous-endpoint-sagemaker/138638/2 "2025-02-20T11:07:50Z")

</div>

Hello, I assume you refer to these environment variables? [GitHub - aws/sagemaker-huggingface-inference-toolkit](https://github.com/aws/sagemaker-huggingface-inference-toolkit?tab=readme-ov-file#%EF%B8%8F-environment-variables)

It should be added in the “hub” dictionnary you pass to your Model object used to create the endpoint.