# Inference widget not loading model

**URL:** <https://discuss.huggingface.co/t/inference-widget-not-loading-model/96569>\
**Category:** Models\
**Created:** [July 10, 2024, 11:01am UTC](https://discuss.huggingface.co/t/inference-widget-not-loading-model/96569 "2024-07-10T11:01:04Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![Detsutut](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/detsutut/32/27379_2.png) [@Detsutut](https://discuss.huggingface.co/u/Detsutut)\
**Post date:** [July 10, 2024, 11:01am UTC](https://discuss.huggingface.co/t/inference-widget-not-loading-model/96569/1 "2024-07-10T11:01:04Z")

</div>

The inference widget for text generation is stuck at model loading for a while and eventually stops throwing a “model time out” error.

This happens for all the models I trained using lora with unsloth and pushed to the hub merged to float16, like this one: bmi-labmedinfo/Igea-1B-Instruct-v0.1

Other info:

- same issue for gated and ungated models
- no issue working locally using AutoModelForCausalLM.from\_pretrained() and then model.generate()
- no issue with quantized versions in HF spaces
- console returns ‘503 (Service Unavailable)’ after page loading, then ‘504 (Gateway Timeout)’
- the problem persists since last week

 ![image](https://us1.discourse-cdn.com/hellohellohello/original/3X/6/8/684e0954fb99189cca52c768c19d92ddfd2535c3.png)