# Hello experts please help on running local DeepSeek-R1-0528-Qwen3-8B

**URL:** <https://discuss.huggingface.co/t/hello-experts-please-help-on-running-local-deepseek-r1-0528-qwen3-8b/158664>\
**Category:** Beginners\
**Created:** [June 9, 2025, 10:27pm UTC](https://discuss.huggingface.co/t/hello-experts-please-help-on-running-local-deepseek-r1-0528-qwen3-8b/158664 "2025-06-09T22:27:14Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![jimxu7](https://avatars.discourse-cdn.com/v4/letter/j/a88e4f/32.png) [@jimxu7](https://discuss.huggingface.co/u/jimxu7)\
**Post date:** [June 9, 2025, 10:27pm UTC](https://discuss.huggingface.co/t/hello-experts-please-help-on-running-local-deepseek-r1-0528-qwen3-8b/158664/1 "2025-06-09T22:27:14Z")

</div>

Has anyone installed GeForce RTX 5070 12GB to accelerate the DeepSeek-R1-0528-Qwen3-8B model? I am trying on a budget, not wanting to buy RTX 5080 16GB for a local setup.

---

<div class="post-metadata">

**Author:** ![John6666](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/john6666/32/27664_2.png) [@John6666](https://discuss.huggingface.co/u/John6666)\
**Post date:** [June 10, 2025, 4:27am UTC](https://discuss.huggingface.co/t/hello-experts-please-help-on-running-local-deepseek-r1-0528-qwen3-8b/158664/2 "2025-06-10T04:27:04Z")

</div>

The 8B model is larger than expected and actually does not fit into 16GB of VRAM. If you quantize it to reduce the size, it can fit into 6GB, but the process is slightly more complicated than not quantizing it, and conversion work is required.  
However, it’s not that difficult now.

Using Ollama eliminates most of the setup work, and if you use models from Hugging Face, you don’t even need to perform the conversion. It runs smoothly on GeForce, Radeon, and CPUs without any complicated settings. I highly recommend it.

> **[Use Ollama with any GGUF Model on Hugging Face Hub](https://huggingface.co/docs/hub/ollama)**
>
> We’re on a journey to advance and democratize artificial intelligence through open source and open science.

> **[bartowski/deepseek-ai\_DeepSeek-R1-0528-Qwen3-8B-GGUF · Hugging Face](https://huggingface.co/bartowski/deepseek-ai_DeepSeek-R1-0528-Qwen3-8B-GGUF)**
>
> We’re on a journey to advance and democratize artificial intelligence through open source and open science.

---

<div class="post-metadata">

**Author:** ![jimxu7](https://avatars.discourse-cdn.com/v4/letter/j/a88e4f/32.png) [@jimxu7](https://discuss.huggingface.co/u/jimxu7)\
**Post date:** [June 10, 2025, 2:39pm UTC](https://discuss.huggingface.co/t/hello-experts-please-help-on-running-local-deepseek-r1-0528-qwen3-8b/158664/3 "2025-06-10T14:39:15Z")

</div>

Thanks much John! That is very helpful.
