# Persistent 404 Not Found Errors with Public Inference API

**URL:** <https://discuss.huggingface.co/t/persistent-404-not-found-errors-with-public-inference-api/154119>\
**Category:** Inference Endpoints on the Hub\
**Created:** [May 8, 2025, 12:02pm UTC](https://discuss.huggingface.co/t/persistent-404-not-found-errors-with-public-inference-api/154119 "2025-05-08T12:02:44Z")\
**Posts on this page:** 13\
**Page:** 1

<div class="post-metadata">

**Author:** ![Mehdimemar](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/mehdimemar/32/47137_2.png) [@Mehdimemar](https://discuss.huggingface.co/u/Mehdimemar)\
**Post date:** [May 8, 2025, 12:02pm UTC](https://discuss.huggingface.co/t/persistent-404-not-found-errors-with-public-inference-api/154119/1 "2025-05-08T12:02:44Z")

</div>

**Problem:**  
For the past day or so, **all** My attempts to make POST requests to the public Inference API endpoint result in a 404 Not Found error. This happens regardless of the model I try to query, including standard, known-available models like gpt2. The response body simply contains “Not Found"“

**My Hugging Face Username:** Mehdimemar

**Troubleshooting Steps Taken:**

1. **Model Validity Confirmed:** I’ve tested numerous valid model IDs (like gpt2, distilbert-base-uncased-fine tuned-sst-2-english, various Segmentation models). The 404 error occurs consistently.

2. **Access Token Verified:** I have generated multiple **new** User Access Tokens from my account settings with the read role. I’ve carefully copied them and ensured they are correctly formatted in the Authorization: Bearer YOUR\_HF\_TOKEN header. Tried to write tokens as well, same result.

3. **Network Connectivity Verified:** nslookup, ping, and tracert to [api-inference.huggingface.co](http://api-inference.huggingface.co) are all successful from my testing environment. General internet connectivity is working fine (tested against [httpbin.org](http://httpbin.org)).

4. **Direct curl Test (Outside other platforms):** To isolate the issue, I performed direct tests using curl from my local machine. These tests also result in the same 404 Not Found error. Example command available upon request.

5. **Checked Hugging Face Status Page:** The status page **[1: status]** indicates services are operational, though HF Inference shows some past instability. The persistent 404 error doesn’t seem like a temporary service unavailability (usually 503).

6. **Checked Account Settings:** I’ve reviewed my account settings (Tokens, Billing [though not required for public API], etc.) via **[2: settings/tokens]** and haven’t found any obvious issues, restrictions, or required actions. My email is verified

---

<div class="post-metadata">

**Author:** ![Mehdimemar](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/mehdimemar/32/47137_2.png) [@Mehdimemar](https://discuss.huggingface.co/u/Mehdimemar)\
**Post date:** [May 8, 2025, 12:04pm UTC](https://discuss.huggingface.co/t/persistent-404-not-found-errors-with-public-inference-api/154119/3 "2025-05-08T12:04:41Z")

</div>

**Conclusion / Question:**

Given that network connectivity is fine, valid models are being used, valid tokens (with correct permissions) seem to be sent correctly (verified by curl -v), the issue strongly suggests a problem with token validation specific to my account (Mehdimemar) or an unknown restriction/status issue with my account preventing Inference API access.

Has anyone else experienced similar persistent 404 errors recently? Is there anything specific I should double-check, or could this require investigation by the Hugging Face team?

---

<div class="post-metadata">

**Author:** ![John6666](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/john6666/32/27664_2.png) [@John6666](https://discuss.huggingface.co/u/John6666)\
**Post date:** [May 9, 2025, 12:04am UTC](https://discuss.huggingface.co/t/persistent-404-not-found-errors-with-public-inference-api/154119/4 "2025-05-09T00:04:27Z")

</div>

I think pretty much all users are in that state…

> [@Persistent DNS Resolution Errors](https://discuss.huggingface.co/t/persistent-dns-resolution-errors/153827):
>
> Hello, I’m experiencing persistent DNS resolution errors when trying to access https://api-inference.huggingface.co from within my Space. My space is running on Nvidia 1xL4 hardware and I am receiving this error no matter which text-generation model I use: requests.exceptions.ConnectionError: HTTPSConnectionPool(host=‘[api-inference.huggingface.co](http://api-inference.huggingface.co)’, port=443): Max retries exceeded with url: … (Caused by NameResolutionError: Failed to resolve ‘[api-inference.huggingface.co](http://api-inference.huggingface.co)’ ([Errno -2] Name or se…

---

<div class="post-metadata">

**Author:** ![syuys](https://avatars.discourse-cdn.com/v4/letter/s/f475e1/32.png) [@syuys](https://discuss.huggingface.co/u/syuys)\
**Post date:** [May 13, 2025, 8:00am UTC](https://discuss.huggingface.co/t/persistent-404-not-found-errors-with-public-inference-api/154119/5 "2025-05-13T08:00:42Z")

</div>

New to the huggingface, and exprienced this issue too…

---

<div class="post-metadata">

**Author:** ![MrAR](https://avatars.discourse-cdn.com/v4/letter/m/a587f6/32.png) [@MrAR](https://discuss.huggingface.co/u/MrAR)\
**Post date:** [May 13, 2025, 1:37pm UTC](https://discuss.huggingface.co/t/persistent-404-not-found-errors-with-public-inference-api/154119/6 "2025-05-13T13:37:01Z")

</div>

I am also experiencing the same issue and I checked with many others too. This issue is been coming for few days. I think its some bug in their system and some its because they are shifting to other inference providers

---

<div class="post-metadata">

**Author:** ![lladawn](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/lladawn/32/47464_2.png) [@lladawn](https://discuss.huggingface.co/u/lladawn)\
**Post date:** [May 14, 2025, 2:53am UTC](https://discuss.huggingface.co/t/persistent-404-not-found-errors-with-public-inference-api/154119/7 "2025-05-14T02:53:50Z")

</div>

I am also facing this same issue.

---

<div class="post-metadata">

**Author:** ![vonba](https://avatars.discourse-cdn.com/v4/letter/v/a88e4f/32.png) [@vonba](https://discuss.huggingface.co/u/vonba)\
**Post date:** [May 15, 2025, 1:13am UTC](https://discuss.huggingface.co/t/persistent-404-not-found-errors-with-public-inference-api/154119/8 "2025-05-15T01:13:02Z")

</div>

Me too. I need to do a huge training task for an application, and I paid for the pro tier, plus already paid a good chunk extra for the first part of the training task. Really frustrating that I now am stuck without being able to complete the task even though I forked out a bunch. Is there no way to get an official reply? I haven’t seen any way of contacting support, if it exists. The official status page says all systems go.

---

<div class="post-metadata">

**Author:** ![John6666](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/john6666/32/27664_2.png) [@John6666](https://discuss.huggingface.co/u/John6666)\
**Post date:** [May 15, 2025, 2:09am UTC](https://discuss.huggingface.co/t/persistent-404-not-found-errors-with-public-inference-api/154119/9 "2025-05-15T02:09:36Z")

</div>

For libraries, it is best to contact the developer via GitHub.

There are several ways to contact support for general issues with Hub.

> **[Issues · huggingface/hub-docs](https://github.com/huggingface/hub-docs/issues)**
>
> Docs of the Hugging Face Hub. Contribute to huggingface/hub-docs development by creating an account on GitHub.

[website@huggingface.co](mailto:website@huggingface.co)

---

<div class="post-metadata">

**Author:** ![meganariley](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/meganariley/32/56966_2.png) [@meganariley](https://discuss.huggingface.co/u/meganariley)\
**Post date:** [May 15, 2025, 3:12pm UTC](https://discuss.huggingface.co/t/persistent-404-not-found-errors-with-public-inference-api/154119/10 "2025-05-15T15:12:47Z")

</div>

Hi all, thanks for reporting! You can check to see if your model is available to use with the HF Inference API (or any Inference Provider) here: [Models - Hugging Face](https://huggingface.co/models?inference_provider=hf-inference&sort=trending). If it’s not deployed by any Inference Provider, you can request provider support on the model page.

Please note Inference Endpoints is available to use - more info here: [Inference Endpoints](https://huggingface.co/docs/inference-endpoints/index).

Thanks!

---

<div class="post-metadata">

**Author:** ![sabimhamed](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/sabimhamed/32/49788_2.png) [@sabimhamed](https://discuss.huggingface.co/u/sabimhamed)\
**Post date:** [June 20, 2025, 9:44am UTC](https://discuss.huggingface.co/t/persistent-404-not-found-errors-with-public-inference-api/154119/11 "2025-06-20T09:44:21Z")

</div>

Yes me too i faced the issue with some models but for the following two models it works fine:

- model: “mistralai/Mixtral-8x7B-Instruct-v0.1”,
- model: ‘meta-llama/Llama-3.3-70B-Instruct’,

Note that i have checked few only.

---

<div class="post-metadata">

**Author:** ![scienzasolutions](https://avatars.discourse-cdn.com/v4/letter/s/d6d6ee/32.png) [@scienzasolutions](https://discuss.huggingface.co/u/scienzasolutions)\
**Post date:** [July 29, 2025, 4:00pm UTC](https://discuss.huggingface.co/t/persistent-404-not-found-errors-with-public-inference-api/154119/12 "2025-07-29T16:00:25Z")

</div>

Hi there! has this been resolved?

---

<div class="post-metadata">

**Author:** ![John6666](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/john6666/32/27664_2.png) [@John6666](https://discuss.huggingface.co/u/John6666)\
**Post date:** [July 29, 2025, 10:19pm UTC](https://discuss.huggingface.co/t/persistent-404-not-found-errors-with-public-inference-api/154119/13 "2025-07-29T22:19:05Z")

</div>

As mentioned above, if [the model is currently deployed](https://huggingface.co/models?inference_provider=all&sort=trending), it should [be available via the Inference Provider](https://huggingface.co/docs/inference-providers/index).

Please note that the program, or rather the Endpoint URL, has changed slightly.

---

<div class="post-metadata">

**Author:** ![asherzad](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/asherzad/32/52792_2.png) [@asherzad](https://discuss.huggingface.co/u/asherzad)\
**Post date:** [August 20, 2025, 4:17am UTC](https://discuss.huggingface.co/t/persistent-404-not-found-errors-with-public-inference-api/154119/14 "2025-08-20T04:17:05Z")

</div>

I’m using “Qwen/Qwen2.5-Coder-32B-Instruct” model and was getting the same/similar error. I modified the initialization a little bit, adding max\_token, provider and etc. and it worked for me. Here’s how I initialize it:

```auto
llm = HuggingFaceInferenceAPI(
    model_name="Qwen/Qwen2.5-Coder-32B-Instruct",
    temperature=0.7,
    max_tokens=100,
    provider="auto"
)

```

In my case, I think the issue was with max\_token, because I was almost running out of free tokens, so that could be a confusing issue really, and the error doesn’t say it’s payment issue unless you’ve completely used your free tokens.

Sometimes it could be because of running out of free tokens too, so take a close look at the error message.

Try assigning a lower max\_token and see how it’ll work.
