# Model does not exist, inference API don't work

**URL:** <https://discuss.huggingface.co/t/model-does-not-exist-inference-api-dont-work/145242>\
**Category:** 🤗Transformers\
**Created:** [March 11, 2025, 4:07pm UTC](https://discuss.huggingface.co/t/model-does-not-exist-inference-api-dont-work/145242 "2025-03-11T16:07:53Z")\
**Posts on this page:** 6\
**Page:** 1

<div class="post-metadata">

**Author:** ![amusktweewt](https://avatars.discourse-cdn.com/v4/letter/a/dfb087/32.png) [@amusktweewt](https://discuss.huggingface.co/u/amusktweewt)\
**Post date:** [March 11, 2025, 4:07pm UTC](https://discuss.huggingface.co/t/model-does-not-exist-inference-api-dont-work/145242/1 "2025-03-11T16:07:53Z")

</div>

Hello!

I have started developing LLM style models, and honestly, things were going well, and had this one working a couple of weeks ago and my friends tried it successfully.

> **[amusktweewt/tiny-model-500M-chat-v2 · Hugging Face](https://huggingface.co/amusktweewt/tiny-model-500M-chat-v2)**
>
> We’re on a journey to advance and democratize artificial intelligence through open source and open science.

For some reason, now I can neither use my space or the inference provider, getting the following error “Server amusktweewt/tiny-model-500M-chat-v2 does not seem to support chat completion. Error: Model amusktweewt/tiny-model-500M-chat-v2 does not exist”.

I don’t know what happens because I changed nothing, literally the repo is frozen around a month ago and during that time it worked well, the model also works fine locally with a pipeline.

Thank you all for your time!

---

<div class="post-metadata">

**Author:** ![John6666](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/john6666/32/27664_2.png) [@John6666](https://discuss.huggingface.co/u/John6666)\
**Post date:** [March 11, 2025, 4:47pm UTC](https://discuss.huggingface.co/t/model-does-not-exist-inference-api-dont-work/145242/2 "2025-03-11T16:47:58Z")

</div>

Seems token issue or under maintain.

```py
HF_TOKEN = "hf_my_valid_pro_token"
#HF_TOKEN = False # if use it, fails with 503 error

from huggingface_hub import InferenceClient

client = InferenceClient(
    provider="hf-inference",
    api_key=HF_TOKEN
)

messages = [
    {
        "role": "user",
        "content": "What is the capital of France?"
    }
]

completion = client.chat.completions.create(
    model="amusktweewt/tiny-model-500M-chat-v2", 
    messages=messages, 
    max_tokens=500,
)

print(completion.choices[0].message)
# ChatCompletionOutputMessage(role='assistant', content='OUP for France - reduced price comparison board (BUFF) is the payoff for carbon emissions.', tool_calls=None)

```

---

<div class="post-metadata">

**Author:** ![meganariley](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/meganariley/32/56966_2.png) [@meganariley](https://discuss.huggingface.co/u/meganariley)\
**Post date:** [March 11, 2025, 7:49pm UTC](https://discuss.huggingface.co/t/model-does-not-exist-inference-api-dont-work/145242/3 "2025-03-11T19:49:46Z")

</div>

Hi! We’re taking a closer look into this and I’ll update you soon. Thanks for reporting!

---

<div class="post-metadata">

**Author:** ![meganariley](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/meganariley/32/56966_2.png) [@meganariley](https://discuss.huggingface.co/u/meganariley)\
**Post date:** [March 12, 2025, 2:39pm UTC](https://discuss.huggingface.co/t/model-does-not-exist-inference-api-dont-work/145242/4 "2025-03-12T14:39:24Z")

</div>

Hi @amusktweewt thanks again for reporting. This is now fixed! Let us know if you continue running into issues.

---

<div class="post-metadata">

**Author:** ![amusktweewt](https://avatars.discourse-cdn.com/v4/letter/a/dfb087/32.png) [@amusktweewt](https://discuss.huggingface.co/u/amusktweewt)\
**Post date:** [March 12, 2025, 3:26pm UTC](https://discuss.huggingface.co/t/model-does-not-exist-inference-api-dont-work/145242/5 "2025-03-12T15:26:42Z")

</div>

Thanks! it works perfectly now, both the space and the Inference API

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/hellohellohello/original/2X/d/de4155eb4aa4108ecb32a1389d7cc37ae69f88b7.png) [@system](https://discuss.huggingface.co/u/system)\
**Post date:** [March 13, 2025, 3:27am UTC](https://discuss.huggingface.co/t/model-does-not-exist-inference-api-dont-work/145242/6 "2025-03-13T03:27:39Z")

</div>

This topic was automatically closed 12 hours after the last reply. New replies are no longer allowed.