# Cannot Deploy My Private Model for Inference Endpoint

**URL:** <https://discuss.huggingface.co/t/cannot-deploy-my-private-model-for-inference-endpoint/37359>\
**Category:** Inference Endpoints on the Hub\
**Created:** [April 21, 2023, 2:10pm UTC](https://discuss.huggingface.co/t/cannot-deploy-my-private-model-for-inference-endpoint/37359 "2023-04-21T14:10:49Z")\
**Posts on this page:** 7\
**Page:** 1

<div class="post-metadata">

**Author:** ![weiqis](https://avatars.discourse-cdn.com/v4/letter/w/898d66/32.png) [@weiqis](https://discuss.huggingface.co/u/weiqis)\
**Post date:** [April 21, 2023, 2:10pm UTC](https://discuss.huggingface.co/t/cannot-deploy-my-private-model-for-inference-endpoint/37359/1 "2023-04-21T14:10:49Z")

</div>

Hi,

I have a private model that I’d like to deploy in Inference Endpoint. But I cannot find it from the model search box. Is it impossible to deploy a private model or do I miss anything?

I already turned on `inference` in the model metadata:

```auto
license: creativeml-openrail-m
language:
  - en
pipeline_tag: text-generation
tags:
  - endpoints
  - text-generation-inference
inference: true

```

Any suggestions will be appreciated. Thanks.

---

<div class="post-metadata">

**Author:** ![philschmid](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/philschmid/32/38022_2.png) [@philschmid](https://discuss.huggingface.co/u/philschmid)\
**Post date:** [April 21, 2023, 2:29pm UTC](https://discuss.huggingface.co/t/cannot-deploy-my-private-model-for-inference-endpoint/37359/2 "2023-04-21T14:29:08Z")

</div>

Hello @weiqis,

Private models can be deployed in the account that “owns” the repository. Meaning if you use an organization on inference endpoints, the model needs to be part of the organization.

Also to mention we had a bug until this afternoon where private repos where showing anymore but that’s fixed.

---

<div class="post-metadata">

**Author:** ![weiqis](https://avatars.discourse-cdn.com/v4/letter/w/898d66/32.png) [@weiqis](https://discuss.huggingface.co/u/weiqis)\
**Post date:** [April 21, 2023, 2:32pm UTC](https://discuss.huggingface.co/t/cannot-deploy-my-private-model-for-inference-endpoint/37359/3 "2023-04-21T14:32:01Z")

</div>

Hi @philschmid , thanks for your quick reply. But the model is under my own account, and I’m not currently in any organization yet. My inference endpoint is also under my own account. So I have the full ownership of the private model. I just checked and I’m still not able to see my models.

---

<div class="post-metadata">

**Author:** ![philschmid](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/philschmid/32/38022_2.png) [@philschmid](https://discuss.huggingface.co/u/philschmid)\
**Post date:** [April 21, 2023, 3:00pm UTC](https://discuss.huggingface.co/t/cannot-deploy-my-private-model-for-inference-endpoint/37359/4 "2023-04-21T15:00:32Z")

</div>

Can you share a screenshot of it?

---

<div class="post-metadata">

**Author:** ![weiqis](https://avatars.discourse-cdn.com/v4/letter/w/898d66/32.png) [@weiqis](https://discuss.huggingface.co/u/weiqis)\
**Post date:** [April 21, 2023, 3:26pm UTC](https://discuss.huggingface.co/t/cannot-deploy-my-private-model-for-inference-endpoint/37359/5 "2023-04-21T15:26:28Z")

</div>

Absolutely. Here is my model (I don’t have any other information other than the metadata in my model card):

 ![Screenshot from 2023-04-21 11-22-12](https://us1.discourse-cdn.com/hellohellohello/original/2X/9/9cbbcb2fdc4de8cee1b6b7a25fd92ed74fbcf365.png)  
And here is the inference engine where I tried to search my model:  
 ![Screenshot from 2023-04-21 11-22-44](https://us1.discourse-cdn.com/hellohellohello/original/2X/9/95b5ca2d54b7d54dcc913baaedf066d8a22867e3.png)

---

<div class="post-metadata">

**Author:** ![beurkinger](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/beurkinger/32/15611_2.png) [@beurkinger](https://discuss.huggingface.co/u/beurkinger)\
**Post date:** [April 24, 2023, 12:01pm UTC](https://discuss.huggingface.co/t/cannot-deploy-my-private-model-for-inference-endpoint/37359/6 "2023-04-24T12:01:48Z")

</div>

Hi @weiqis ! The issue should now be fixed. Please tell us if you are now able to import your private models.

Best,  
Thibault

---

<div class="post-metadata">

**Author:** ![weiqis](https://avatars.discourse-cdn.com/v4/letter/w/898d66/32.png) [@weiqis](https://discuss.huggingface.co/u/weiqis)\
**Post date:** [April 24, 2023, 1:32pm UTC](https://discuss.huggingface.co/t/cannot-deploy-my-private-model-for-inference-endpoint/37359/7 "2023-04-24T13:32:00Z")

</div>

Yep, I can see all my private models now. Thanks!