# Can't run Janus with HuggingFaceEndpoint

**URL:** <https://discuss.huggingface.co/t/cant-run-janus-with-huggingfaceendpoint/144369>\
**Category:** Intermediate\
**Created:** [March 6, 2025, 5:56am UTC](https://discuss.huggingface.co/t/cant-run-janus-with-huggingfaceendpoint/144369 "2025-03-06T05:56:34Z")\
**Posts on this page:** 6\
**Page:** 1

<div class="post-metadata">

**Author:** ![LZY-SPCA](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/lzy-spca/32/42547_2.png) [@LZY-SPCA](https://discuss.huggingface.co/u/LZY-SPCA)\
**Post date:** [March 6, 2025, 5:56am UTC](https://discuss.huggingface.co/t/cant-run-janus-with-huggingfaceendpoint/144369/1 "2025-03-06T05:56:34Z")

</div>

I’m trying to integrate huggingface endpoint with LangChain project using HuggingFaceEndPoint proviede by LangChain.

```auto
llm = HuggingFaceEndpoint(
    repo_id="deepseek-ai/Janus-Pro-7B",
    task="image-text-to-text",
    max_new_tokens=512,
    do_sample=False,
    repetition_penalty=1.03
)

```

But it returns with 500 Server Error, and unknown variant ‘any-to-any’. I’m using task like ‘image-text-to-text’ and ‘image-to-text’ and they have same return value.

 ![image](https://us1.discourse-cdn.com/hellohellohello/original/3X/6/d/6db7a259062ee0e1f77efd598c16a56b6b3514e8.png)  
Not only Janus-Pro-7B can’t run, other VLM like Qwen2.5-VL-7B-Instruct and glm-4v-9b can’t run. I suspect this HuggingFaceEndpoint could not run VLM.

---

<div class="post-metadata">

**Author:** ![John6666](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/john6666/32/27664_2.png) [@John6666](https://discuss.huggingface.co/u/John6666)\
**Post date:** [March 6, 2025, 6:00am UTC](https://discuss.huggingface.co/t/cant-run-janus-with-huggingfaceendpoint/144369/2 "2025-03-06T06:00:43Z")

</div>

Oh…

> **[deepseek-ai/Janus-Pro-7B · Hugging Face](https://huggingface.co/deepseek-ai/Janus-Pro-7B)**
>
> We’re on a journey to advance and democratize artificial intelligence through open source and open science.

> This model is not currently available via any of the supported Inference Providers.  
> The model cannot be deployed to the HF Inference API: The HF Inference API does not support any-to-any models for transformers library.

---

<div class="post-metadata">

**Author:** ![LZY-SPCA](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/lzy-spca/32/42547_2.png) [@LZY-SPCA](https://discuss.huggingface.co/u/LZY-SPCA)\
**Post date:** [March 6, 2025, 6:16am UTC](https://discuss.huggingface.co/t/cant-run-janus-with-huggingfaceendpoint/144369/3 "2025-03-06T06:16:29Z")

</div>

Thanks! What VLM can I use with HF inference API?

---

<div class="post-metadata">

**Author:** ![John6666](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/john6666/32/27664_2.png) [@John6666](https://discuss.huggingface.co/u/John6666)\
**Post date:** [March 6, 2025, 6:18am UTC](https://discuss.huggingface.co/t/cant-run-janus-with-huggingfaceendpoint/144369/4 "2025-03-06T06:18:27Z")

</div>

This?

> **[Qwen/Qwen2-VL-7B-Instruct · Hugging Face](https://huggingface.co/Qwen/Qwen2-VL-7B-Instruct)**
>
> We’re on a journey to advance and democratize artificial intelligence through open source and open science.

---

<div class="post-metadata">

**Author:** ![John6666](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/john6666/32/27664_2.png) [@John6666](https://discuss.huggingface.co/u/John6666)\
**Post date:** [March 6, 2025, 6:18am UTC](https://discuss.huggingface.co/t/cant-run-janus-with-huggingfaceendpoint/144369/5 "2025-03-06T06:18:45Z")

</div>

This? Qwen/Qwen2-VL-7B-Instruct

---

<div class="post-metadata">

**Author:** ![LZY-SPCA](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/lzy-spca/32/42547_2.png) [@LZY-SPCA](https://discuss.huggingface.co/u/LZY-SPCA)\
**Post date:** [March 6, 2025, 6:23am UTC](https://discuss.huggingface.co/t/cant-run-janus-with-huggingfaceendpoint/144369/6 "2025-03-06T06:23:59Z")

</div>

Sorry!This model return this`huggingface_hub.errors.HfHubHTTPError: 503 Server Error: Service Temporarily Unavailable for url: https://router.huggingface.co/hf-inference/models/Qwen/Qwen2.5-VL-7B-Instruct/v1/chat/completions`  
And I can exclude network reason because I can run `microsoft/Phi-3-mini-4k-instruct`