# Error loading llama\_cpp\_binaries

**URL:** <https://discuss.huggingface.co/t/error-loading-llama-cpp-binaries/156393>\
**Category:** Beginners\
**Created:** [May 22, 2025, 4:12pm UTC](https://discuss.huggingface.co/t/error-loading-llama-cpp-binaries/156393 "2025-05-22T16:12:06Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![xonger](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/xonger/32/48084_2.png) [@xonger](https://discuss.huggingface.co/u/xonger)\
**Post date:** [May 22, 2025, 4:12pm UTC](https://discuss.huggingface.co/t/error-loading-llama-cpp-binaries/156393/1 "2025-05-22T16:12:06Z")

</div>

## I am having a problem loading my first model . As far as I can tell my localhost is running fine. I download Mistral-7b v0.3 ( because I only have 8gb ram ) and I go to load the model but it cant find llama\_cpp\_binaries. As far as I can tell I dont need binaries for this. I dont know what I did wrong. Any advice helps. THANK YOU!

10:43:58-713195 INFO Loading “Mistral-7B-Instruct-v0.3.Q4\_K\_M.gguf”  
10:43:58-713195 ERROR Failed to load the model.  
Traceback (most recent call last):  
File “C:\Windows\System32\text-generation-webui\modules\ui\_model\_menu.py”, line 190, in load\_model\_wrapper  
shared.model, shared.tokenizer = load\_model(selected\_model, loader)  
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^  
File “C:\Windows\System32\text-generation-webui\modules\models.py”, line 43, in load\_model  
output = load\_func\_maploader  
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^  
File “C:\Windows\System32\text-generation-webui\modules\models.py”, line 66, in llama\_cpp\_server\_loader  
from modules.llama\_cpp\_server import LlamaServer  
File “C:\Windows\System32\text-generation-webui\modules\llama\_cpp\_server.py”, line 12, in   
import llama\_cpp\_binaries  
ModuleNotFoundError: No module named ‘llama\_cpp\_binaries’

---

<div class="post-metadata">

**Author:** ![John6666](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/john6666/32/27664_2.png) [@John6666](https://discuss.huggingface.co/u/John6666)\
**Post date:** [May 23, 2025, 12:15am UTC](https://discuss.huggingface.co/t/error-loading-llama-cpp-binaries/156393/2 "2025-05-23T00:15:32Z")

</div>

This?

> **[GitHub - oobabooga/llama-cpp-binaries: llama.cpp server in a Python wheel.](https://github.com/oobabooga/llama-cpp-binaries)**
>
> llama.cpp server in a Python wheel.

---

<div class="post-metadata">

**Author:** ![SeaElement](https://avatars.discourse-cdn.com/v4/letter/s/858c86/32.png) [@SeaElement](https://discuss.huggingface.co/u/SeaElement)\
**Post date:** [September 14, 2025, 11:41am UTC](https://discuss.huggingface.co/t/error-loading-llama-cpp-binaries/156393/3 "2025-09-14T11:41:15Z")

</div>

I believe you are using the wrong version of Python. llama\_cpp\_binaries needs Python 3.11 or newer. After installing the correct version, you’ll need to update you PATH environment variables accordingly. I made a [Google Doc tutorial](https://docs.google.com/document/d/1PiIrndSHx9ojv3agD26Uet6u45GORZx753zFrtJYsjk/edit?usp=sharing) for Windows on how to do that.