# API access no longer working despite Pro subscription

**URL:** <https://discuss.huggingface.co/t/api-access-no-longer-working-despite-pro-subscription/81102>\
**Category:** 🤗Hub\
**Created:** [April 10, 2024, 4:35pm UTC](https://discuss.huggingface.co/t/api-access-no-longer-working-despite-pro-subscription/81102 "2024-04-10T16:35:16Z")\
**Posts on this page:** 7\
**Page:** 1

<div class="post-metadata">

**Author:** ![arielflintashery](https://avatars.discourse-cdn.com/v4/letter/a/b77776/32.png) [@arielflintashery](https://discuss.huggingface.co/u/arielflintashery)\
**Post date:** [April 10, 2024, 4:35pm UTC](https://discuss.huggingface.co/t/api-access-no-longer-working-despite-pro-subscription/81102/1 "2024-04-10T16:35:16Z")

</div>

It seems as if I no longer have access to the Llama 2-70b model through the API.

I have HF Pro subscription, and have been running code fine up until 20 minutes ago. I stopped my script from sending anymore queries to amend some parameter, and sent it out again only to receive the following error as a response:

{‘error’: ‘The model meta-llama/Llama-2-70b-chat-hf is too large to be loaded automatically (137GB \> 10GB). Please use Spaces ([Spaces - Hugging Face](https://huggingface.co/spaces)) or Inference Endpoints ([Inference Endpoints - Hugging Face](https://huggingface.co/inference-endpoints)).’}

I created a new API token, but the issue persists.

To reiterate, I have an active and valid Pro subscription. If I can’t use the API, what am I paying for?

---

<div class="post-metadata">

**Author:** ![kswanjitsu](https://avatars.discourse-cdn.com/v4/letter/k/7cd45c/32.png) [@kswanjitsu](https://discuss.huggingface.co/u/kswanjitsu)\
**Post date:** [April 11, 2024, 1:19am UTC](https://discuss.huggingface.co/t/api-access-no-longer-working-despite-pro-subscription/81102/2 "2024-04-11T01:19:35Z")

</div>

I am having the exact same issue.

Edited to say:  
They may have taken down llama2 70b from the inference API based on other forum answers I’ve read. Because specifically c4ai-command-r-plus, larger than llama2 70b is working.

---

<div class="post-metadata">

**Author:** ![NicoloFontana](https://avatars.discourse-cdn.com/v4/letter/n/3bc359/32.png) [@NicoloFontana](https://discuss.huggingface.co/u/NicoloFontana)\
**Post date:** [April 11, 2024, 1:25pm UTC](https://discuss.huggingface.co/t/api-access-no-longer-working-despite-pro-subscription/81102/3 "2024-04-11T13:25:47Z")

</div>

I’m having the same problem.  
I contacted them and they answered me that they have “temporarily removed meta-llama/Llama-2-70b-chat-hf but it will be back to use with the Inference API soon, though no ETA just yet.”  
So we just need to wait.

(Also, I think that this holds for any other Llama2 version since they are all unavailable at the moment)

---

<div class="post-metadata">

**Author:** ![arielflintashery](https://avatars.discourse-cdn.com/v4/letter/a/b77776/32.png) [@arielflintashery](https://discuss.huggingface.co/u/arielflintashery)\
**Post date:** [April 11, 2024, 3:55pm UTC](https://discuss.huggingface.co/t/api-access-no-longer-working-despite-pro-subscription/81102/4 "2024-04-11T15:55:07Z")

</div>

Hi Karl,

Thanks for the response, it does seem as if there is no longer support for Llama 2. Would you mind sharing with me your code for the API query for the cohere model?

For some reason my code is failing to find the correct tokenizer…

Cheers

---

<div class="post-metadata">

**Author:** ![dieforgpu](https://avatars.discourse-cdn.com/v4/letter/d/e480ec/32.png) [@dieforgpu](https://discuss.huggingface.co/u/dieforgpu)\
**Post date:** [April 12, 2024, 2:40am UTC](https://discuss.huggingface.co/t/api-access-no-longer-working-despite-pro-subscription/81102/5 "2024-04-12T02:40:59Z")

</div>

I guess it’s working now. I had same issue yesterday, but now it seems to work fine.

---

<div class="post-metadata">

**Author:** ![radames](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/radames/32/28246_2.png) [@radames](https://discuss.huggingface.co/u/radames)\
**Post date:** [April 12, 2024, 8:30pm UTC](https://discuss.huggingface.co/t/api-access-no-longer-working-despite-pro-subscription/81102/6 "2024-04-12T20:30:47Z")

</div>

Sorry, folks, `meta-llama/Llama-2-70b-chat-hf/` is back online after temporarily going down.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/hellohellohello/original/2X/d/de4155eb4aa4108ecb32a1389d7cc37ae69f88b7.png) [@system](https://discuss.huggingface.co/u/system)\
**Post date:** [April 13, 2024, 8:30am UTC](https://discuss.huggingface.co/t/api-access-no-longer-working-despite-pro-subscription/81102/7 "2024-04-13T08:30:50Z")

</div>

This topic was automatically closed 12 hours after the last reply. New replies are no longer allowed.