# Hugging Face API timeouts on all models!

**URL:** <https://discuss.huggingface.co/t/hugging-face-api-timeouts-on-all-models/168509>\
**Category:** Inference Endpoints on the Hub\
**Created:** [September 17, 2025, 11:37am UTC](https://discuss.huggingface.co/t/hugging-face-api-timeouts-on-all-models/168509 "2025-09-17T11:37:16Z")\
**Posts on this page:** 6\
**Page:** 1

<div class="post-metadata">

**Author:** ![GeorginaSteele](https://avatars.discourse-cdn.com/v4/letter/g/439d5e/32.png) [@GeorginaSteele](https://discuss.huggingface.co/u/GeorginaSteele)\
**Post date:** [September 17, 2025, 11:37am UTC](https://discuss.huggingface.co/t/hugging-face-api-timeouts-on-all-models/168509/1 "2025-09-17T11:37:16Z")

</div>

‼ I’m experiencing multiple timeouts on all models on the API. I’m currently using the free tier. Is anyone else experiencing this issue? is using the free tier part of the issue?

```auto
status: 504,
statusText: ‘Gateway Time-out’,

```

---

<div class="post-metadata">

**Author:** ![John6666](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/john6666/32/27664_2.png) [@John6666](https://discuss.huggingface.co/u/John6666)\
**Post date:** [September 17, 2025, 12:17pm UTC](https://discuss.huggingface.co/t/hugging-face-api-timeouts-on-all-models/168509/2 "2025-09-17T12:17:34Z")

</div>

Hmm…? It works for me.

```py
import os
from huggingface_hub import InferenceClient

HF_TOKEN = "hf_ ***my_read_token***"

client = InferenceClient(
    provider="hf-inference",
    api_key=HF_TOKEN,
)

completion = client.chat.completions.create(
    model="HuggingFaceTB/SmolLM3-3B",
    messages=[
        {
            "role": "user",
            "content": "What is the capital of France?"
        }
    ],
)

print(completion.choices[0].message)
"""
ChatCompletionOutputMessage(role='assistant', content="<think>\nOkay, the user is asking for the capital of France. Let me make sure I remember correctly. I think it's Paris. Wait, is there any chance they might be confused with another city? Maybe someone might think it's Lyon or Marseille? No, those are major cities but not the capital. The capital of France is definitely Paris. I 
should confirm that. Let me think if there's any historical context that could change this. No, Paris has been the capital since the 10th century. There's also the Eiffel Tower and the Louvre, 
which are famous landmarks there. Yeah, I'm pretty confident it's Paris. I should just state that clearly and maybe add a bit about it being the largest city in France to give more context.\n</think>\n\nThe capital of France is **Paris**. It is not only the largest city in the country but also a major global cultural, economic, and political hub. Paris is renowned for landmarks like 
the Eiffel Tower, the Louvre Museum, and the Seine River, and has been the heart of French history and politics for centuries.", tool_call_id=None, tool_calls=[], refusal=None, annotations=None, audio=None, function_call=None, reasoning_content=None)
"""

```

[No major server issues have been detected](https://status.huggingface.co/) so far.

---

<div class="post-metadata">

**Author:** ![meganariley](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/meganariley/32/56966_2.png) [@meganariley](https://discuss.huggingface.co/u/meganariley)\
**Post date:** [September 17, 2025, 3:11pm UTC](https://discuss.huggingface.co/t/hugging-face-api-timeouts-on-all-models/168509/3 "2025-09-17T15:11:56Z")

</div>

Hi @GeorginaSteele Are you still experiencing this issue? Can you please share the model you’re using?

---

<div class="post-metadata">

**Author:** ![joshmaiven](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/joshmaiven/32/54009_2.png) [@joshmaiven](https://discuss.huggingface.co/u/joshmaiven)\
**Post date:** [September 18, 2025, 9:31am UTC](https://discuss.huggingface.co/t/hugging-face-api-timeouts-on-all-models/168509/4 "2025-09-18T09:31:34Z")

</div>

Same issue for me @meganariley,  
the core one i’m trying to use here is BAAI/bge-large-en-v1.5, keeps timing out

I switched to try a Deepseek one also timed out. It’s not all models as BAAI/bge-small-en-v1.5 was working.

not sure what the issue is as it hasn’t been working for around a day now

---

<div class="post-metadata">

**Author:** ![joshmaiven](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/joshmaiven/32/54009_2.png) [@joshmaiven](https://discuss.huggingface.co/u/joshmaiven)\
**Post date:** [September 18, 2025, 9:42am UTC](https://discuss.huggingface.co/t/hugging-face-api-timeouts-on-all-models/168509/5 "2025-09-18T09:42:37Z")

</div>

Never mind, looks like it has started working again

It was out for ~4-5 hours yesterday though while I was testing then

---

<div class="post-metadata">

**Author:** ![GeorginaSteele](https://avatars.discourse-cdn.com/v4/letter/g/439d5e/32.png) [@GeorginaSteele](https://discuss.huggingface.co/u/GeorginaSteele)\
**Post date:** [September 18, 2025, 10:37am UTC](https://discuss.huggingface.co/t/hugging-face-api-timeouts-on-all-models/168509/6 "2025-09-18T10:37:08Z")

</div>

I was using BAAI/bge-large-en-v1.5 primarily and then switched to a few others. It’s now working again as @joshmaiven pointed out