# Too large to be loaded automatically (16GB \> 10GB) issue with QWEN 2.5 VL 7B

**URL:** <https://discuss.huggingface.co/t/too-large-to-be-loaded-automatically-16gb-10gb-issue-with-qwen-2-5-vl-7b/150425>\
**Category:** Inference Endpoints on the Hub\
**Created:** [April 14, 2025, 3:15pm UTC](https://discuss.huggingface.co/t/too-large-to-be-loaded-automatically-16gb-10gb-issue-with-qwen-2-5-vl-7b/150425 "2025-04-14T15:15:46Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![Injaz](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/injaz/32/45458_2.png) [@Injaz](https://discuss.huggingface.co/u/Injaz)\
**Post date:** [April 14, 2025, 3:15pm UTC](https://discuss.huggingface.co/t/too-large-to-be-loaded-automatically-16gb-10gb-issue-with-qwen-2-5-vl-7b/150425/1 "2025-04-14T15:15:46Z")

</div>

got the following error  
Error processing file Contract F 506 b 5 end date 14042025 (1).pdf: Error code: 403 - {‘error’: ‘The model Qwen/Qwen2.5-VL-7B-Instruct is too large to be loaded automatically (16GB \> 10GB).’}

while working on  
[Qwen2.5-VL-7B-Instruct](https://huggingface.co/Qwen/Qwen2.5-VL-7B-Instruct) for an OCR task, first i was working on inference providers via hugging face (HF inference API) and got this so i started to run a dedicated endpoint with the suggested GPU and the issue still persists so i upgraded to higher resources and still the same knowing that this whole thing worked till yesterday and i was testing this file yesterday and got the expected response so any help to solve this.

---

<div class="post-metadata">

**Author:** ![John6666](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/john6666/32/27664_2.png) [@John6666](https://discuss.huggingface.co/u/John6666)\
**Post date:** [April 15, 2025, 2:41am UTC](https://discuss.huggingface.co/t/too-large-to-be-loaded-automatically-16gb-10gb-issue-with-qwen-2-5-vl-7b/150425/2 "2025-04-15T02:41:19Z")

</div>

Same here. Maybe related to this incident.

> [@404 - "{\\"error\\":\\"Model XLabs-AI/flux-RealismLora does not exist\\"}"](https://discuss.huggingface.co/t/404-error-model-xlabs-ai-flux-realismlora-does-not-exist/150363):
>
> I am using model via hugging inference API in n8n , it was working fine till yesterday, now its giving me this response: 404 - “{"error":"Model XLabs-AI/flux-RealismLora does not exist"}” Thanks in advance

---

<div class="post-metadata">

**Author:** ![Injaz](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/injaz/32/45458_2.png) [@Injaz](https://discuss.huggingface.co/u/Injaz)\
**Post date:** [April 15, 2025, 1:54pm UTC](https://discuss.huggingface.co/t/too-large-to-be-loaded-automatically-16gb-10gb-issue-with-qwen-2-5-vl-7b/150425/3 "2025-04-15T13:54:06Z")

</div>

i think, for Qwen they have removed it from the hugging face serverless calls, and now available only using dedicated server.