# Pinning models doesn't seem to work

**URL:** <https://discuss.huggingface.co/t/pinning-models-doesnt-seem-to-work/13675>\
**Category:** 🤗Hub\
**Created:** [January 14, 2022, 1:40am UTC](https://discuss.huggingface.co/t/pinning-models-doesnt-seem-to-work/13675 "2022-01-14T01:40:23Z")\
**Posts on this page:** 6\
**Page:** 1

<div class="post-metadata">

**Author:** ![dmz](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/dmz/32/3720_2.png) [@dmz](https://discuss.huggingface.co/u/dmz)\
**Post date:** [January 14, 2022, 1:40am UTC](https://discuss.huggingface.co/t/pinning-models-doesnt-seem-to-work/13675/1 "2022-01-14T01:40:23Z")

</div>

We’ve pinned models (both using the API call and using the dashboard at [Dashboard - Hosted API - HuggingFace](https://api-inference.huggingface.co/dashboard/pinned_models)), but still get “currently loading” errors when we try to make inference API calls.

One example: model [https://huggingface.co/redwoodresearch/redwood\_deberta-v3-sift\_82b19d290a74410caa804fa47e94a80b](https://huggingface.co/redwoodresearch/redwood_deberta-v3-sift_82b19d290a74410caa804fa47e94a80b) (private but we can make it public if that would help). It’s currently (supposedly) pinned but still requires a minute of warmup after a period of inactivity.

Let me know if there’s anything we should do differently!

---

<div class="post-metadata">

**Author:** ![dmz](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/dmz/32/3720_2.png) [@dmz](https://discuss.huggingface.co/u/dmz)\
**Post date:** [January 20, 2022, 3:56am UTC](https://discuss.huggingface.co/t/pinning-models-doesnt-seem-to-work/13675/2 "2022-01-20T03:56:53Z")

</div>

@Narsil Seems like you’ve worked on pinned models before - any chance you could take a look?

---

<div class="post-metadata">

**Author:** ![davidkong0987](https://avatars.discourse-cdn.com/v4/letter/d/eb8c5e/32.png) [@davidkong0987](https://discuss.huggingface.co/u/davidkong0987)\
**Post date:** [April 5, 2022, 5:37pm UTC](https://discuss.huggingface.co/t/pinning-models-doesnt-seem-to-work/13675/3 "2022-04-05T17:37:55Z")

</div>

Were you able to solve this problem?

---

<div class="post-metadata">

**Author:** ![metamyth](https://avatars.discourse-cdn.com/v4/letter/m/6f9a4e/32.png) [@metamyth](https://discuss.huggingface.co/u/metamyth)\
**Post date:** [July 27, 2022, 8:09am UTC](https://discuss.huggingface.co/t/pinning-models-doesnt-seem-to-work/13675/4 "2022-07-27T08:09:58Z")

</div>

hey same problem. pinned model always loads up when at rest for some time. any solutions here?

---

<div class="post-metadata">

**Author:** ![Cbelem](https://avatars.discourse-cdn.com/v4/letter/c/65b543/32.png) [@Cbelem](https://discuss.huggingface.co/u/Cbelem)\
**Post date:** [August 5, 2022, 6:02pm UTC](https://discuss.huggingface.co/t/pinning-models-doesnt-seem-to-work/13675/5 "2022-08-05T18:02:33Z")

</div>

I have the same problem when pinning the model [allenai/tk-instruct-11b-def](https://huggingface.co/allenai/tk-instruct-11b-def), never even loaded. However, it is not working in the model’s page at hugging face which may suggest it is a problem on HuggingFace’s side.

On the other hand, I tried pinning a smaller model (the 3B) version and it worked like a charm 🙂

---

<div class="post-metadata">

**Author:** ![Narsil](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/narsil/32/40029_2.png) [@Narsil](https://discuss.huggingface.co/u/Narsil)\
**Post date:** [August 9, 2022, 2:17pm UTC](https://discuss.huggingface.co/t/pinning-models-doesnt-seem-to-work/13675/6 "2022-08-09T14:17:08Z")

</div>

@Cbelem ,

Actually pinning works. It’s just that this model is too big to be loaded by default.  
What is actually failing is the detection that this model is too big to be loaded by the machines we’re using. In order to run these large models we need to discuss it (Since we need different hardware than the standard one).

Hope that answers your questions.

Cheers,  
Nicolas