# How to use Inference API (serverless) in my model page?

**URL:** <https://discuss.huggingface.co/t/how-to-use-inference-api-serverless-in-my-model-page/90084>\
**Category:** Beginners\
**Created:** [June 3, 2024, 1:46pm UTC](https://discuss.huggingface.co/t/how-to-use-inference-api-serverless-in-my-model-page/90084 "2024-06-03T13:46:02Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![LimYeri](https://avatars.discourse-cdn.com/v4/letter/l/e56c9b/32.png) [@LimYeri](https://discuss.huggingface.co/u/LimYeri)\
**Post date:** [June 3, 2024, 1:46pm UTC](https://discuss.huggingface.co/t/how-to-use-inference-api-serverless-in-my-model-page/90084/1 "2024-06-03T13:46:02Z")

</div>

Hi All.  
I have uploaded my fine-tuned model to Hugging Face. I want to create an inference API (serverless) on the model page, but a timeout occurs. What should I do?

Here is how I wrote the README:  
pipeline\_tag: text-generation  
inference:  
parameters:  
max\_new\_tokens: 300  
stop:  
- \<|end\_of\_text|\>  
- \<|eot\_id|\>

 ![image](https://us1.discourse-cdn.com/hellohellohello/original/3X/2/9/29fbbc0f264e0d4de700ec1c61e5c29b1dfbbbc1.png)

---

<div class="post-metadata">

**Author:** ![kayrab](https://avatars.discourse-cdn.com/v4/letter/k/9fc29f/32.png) [@kayrab](https://discuss.huggingface.co/u/kayrab)\
**Post date:** [June 28, 2024, 5:53am UTC](https://discuss.huggingface.co/t/how-to-use-inference-api-serverless-in-my-model-page/90084/2 "2024-06-28T05:53:29Z")

</div>

![Screenshot from 2024-06-28 08-52-33](https://us1.discourse-cdn.com/hellohellohello/original/3X/5/8/58b4eaed3518cdf19102336070a17045f00d5148.png)  
I am having a similar problem