# Unable to run quantized model with Zero GPU space

**URL:** <https://discuss.huggingface.co/t/unable-to-run-quantized-model-with-zero-gpu-space/91598>\
**Category:** Spaces\
**Created:** [June 11, 2024, 5:44pm UTC](https://discuss.huggingface.co/t/unable-to-run-quantized-model-with-zero-gpu-space/91598 "2024-06-11T17:44:35Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![tanyuzhou](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/tanyuzhou/32/28101_2.png) [@tanyuzhou](https://discuss.huggingface.co/u/tanyuzhou)\
**Post date:** [June 11, 2024, 5:44pm UTC](https://discuss.huggingface.co/t/unable-to-run-quantized-model-with-zero-gpu-space/91598/1 "2024-06-11T17:44:35Z")

</div>

Hi guys! I am trying to deploy a 4-bit llm model in a Zero GPU space, and encountered problems when load the pretrained model outside the method with @spaces.GPU decoration.

I posted a discussion on zero-gpu org, is anybody can help me with this issue?

[Zero GPU does not support 4-bit quantization with bitsandbytes?](https://huggingface.co/spaces/zero-gpu-explorers/README/discussions/71)