# 404 Errors When Using Inference API with Public Models

**URL:** <https://discuss.huggingface.co/t/404-errors-when-using-inference-api-with-public-models/162263>\
**Category:** Models\
**Created:** [July 8, 2025, 8:08pm UTC](https://discuss.huggingface.co/t/404-errors-when-using-inference-api-with-public-models/162263 "2025-07-08T20:08:21Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![graceMkal](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/gracemkal/32/50805_2.png) [@graceMkal](https://discuss.huggingface.co/u/graceMkal)\
**Post date:** [July 8, 2025, 8:08pm UTC](https://discuss.huggingface.co/t/404-errors-when-using-inference-api-with-public-models/162263/1 "2025-07-08T20:08:21Z")

</div>

I’m trying to use the Inference API for the model [`meta-llama/Meta-Llama-3-70B-Instruct`](https://huggingface.co/meta-llama/Meta-Llama-3-70B-Instruct), and to test my setup, I’ve been making requests to public models like `gpt2`, `bert-base-uncased`, and `facebook/bart-large-mnli`. However, I consistently receive 404 errors.

Here’s what I’ve already tried:

- Generated new API tokens
- Switched networks and tested via mobile hotspot
- Used both `curl` and Python’s `requests` library
- Tried with multiple well-known public models

I desperately need help. I don’t understand why this is happening. My accounts are not flagged does anyone know if there’s a configuration issue preventing me from using the Inference API?

---

<div class="post-metadata">

**Author:** ![meganariley](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/meganariley/32/56966_2.png) [@meganariley](https://discuss.huggingface.co/u/meganariley)\
**Post date:** [July 8, 2025, 9:32pm UTC](https://discuss.huggingface.co/t/404-errors-when-using-inference-api-with-public-models/162263/2 "2025-07-08T21:32:02Z")

</div>

Hi @graceMkal This issue sounds similar: [404 to any API i tried - #6 by meganariley](https://discuss.huggingface.co/t/404-to-any-api-i-tried/161937/6).

[meta-llama/Meta-Llama-3-70B-Instruct · Hugging Face](https://huggingface.co/meta-llama/Meta-Llama-3-70B-Instruct) is available to use with many great inference providers like Together AI, Featherless AI, Hyperbolic, and Novita. Check out our documentation on Inference Providers for more info: [Inference Providers](https://huggingface.co/docs/inference-providers/en/index).

Another option is using this model with [Inference Endpoints](https://huggingface.co/docs/inference-endpoints/index) instead.

To see which models are available to use with HF Inference, check out our filtered search [here](https://huggingface.co/models?inference_provider=hf-inference&sort=trending).

You can also [subscribe to PRO](https://huggingface.co/subscribe/pro)! Perks include: 20x more inference usage, 8x ZeroGPU quota, 10x private storage capacity 🚀 Check out [PRO Account - Hugging Face](https://huggingface.co/pro) for details.

---

<div class="post-metadata">

**Author:** ![Amber14L](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/amber14l/32/50832_2.png) [@Amber14L](https://discuss.huggingface.co/u/Amber14L)\
**Post date:** [July 9, 2025, 10:01am UTC](https://discuss.huggingface.co/t/404-errors-when-using-inference-api-with-public-models/162263/3 "2025-07-09T10:01:21Z")

</div>

> [@graceMkal](#):
>
> I’m trying to use the Inference API for the model [`meta-llama/Meta-Llama-3-70B-Instruct`](https://huggingface.co/meta-llama/Meta-Llama-3-70B-Instruct), and to test my setup, I’ve been making requests to public models like `gpt2`, `bert-base-uncased`, and `facebook/bart-large-mnli`. However, I consistently receive 404 errors.
> 
> Here’s what I’ve already tried:
> 
> - Generated new API tokens
> - Switched networks and tested via mobile hotspot
> - Used both `curl` and Python’s `requests` library
> - Tried with multiple well-known public models
> 
> I desperately need help. I don’t understand why this is happening. My accounts are not flagged does anyone know if there’s a configuration issue preventing me from using the Inference API?

Wrong URL format → use: `https://api-inference.huggingface.co/models/{model_id}`  
Missing or incorrect API token in headers  
The model (like LLaMA 3) isn’t available via the public Inference API

Try with `gpt2` and make sure your token is set correctly.
