# Sagemaker Serverless Inference

**URL:** <https://discuss.huggingface.co/t/sagemaker-serverless-inference/13246>\
**Category:** Amazon SageMaker\
**Created:** [December 30, 2021, 1:44pm UTC](https://discuss.huggingface.co/t/sagemaker-serverless-inference/13246 "2021-12-30T13:44:18Z")\
**Posts on this page:** 1\
**Showing post:** 7

<div class="post-metadata">

**Author:** ![philschmid](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/philschmid/32/38022_2.png) [@philschmid](https://discuss.huggingface.co/u/philschmid)\
**Post date:** [January 25, 2022, 12:49pm UTC](https://discuss.huggingface.co/t/sagemaker-serverless-inference/13246/7 "2022-01-25T12:49:20Z")

</div>

Hello,

1. There is no fix yet for it but there is a workaround. You can set an environment variable `MMS_DEFAULT_WORKERS_PER_MODEL=1` when creating the endpoint.
2. Since Serverless Inference is powered by AWS Lambda and AWS Lambda doesn’t have GPU support yet Serverless Inference won’t have it as well. And i assume it will get GPU support when AWS Lambda has GPU support.

---

_[View the full topic](https://discuss.huggingface.co/t/sagemaker-serverless-inference/13246)._