# Failed to create LLM 'llama' from .GGUF

**URL:** <https://discuss.huggingface.co/t/failed-to-create-llm-llama-from-gguf/132965>\
**Category:** Beginners\
**Created:** [December 25, 2024, 6:24am UTC](https://discuss.huggingface.co/t/failed-to-create-llm-llama-from-gguf/132965 "2024-12-25T06:24:11Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![VolcanoJ](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/volcanoj/32/38101_2.png) [@VolcanoJ](https://discuss.huggingface.co/u/VolcanoJ)\
**Post date:** [December 25, 2024, 6:24am UTC](https://discuss.huggingface.co/t/failed-to-create-llm-llama-from-gguf/132965/1 "2024-12-25T06:24:11Z")

</div>

I was able to get some code together that let me run several of the models stored here successfully. I focused on llama 7b GGUF models. Then I wanted to fine tune it using LoRA. Then I merged the weights back in, quantized it, and converted it to GGUF. However, when I try to load the new GGUF model using the same code for the model I downloaded I get the error:  
Error loading model: Failed to create LLM ‘llama’ from ‘D:\models\finalModel\finalModel.gguf’.  
I’ve torn apart the ctransformer AutoModelForCausalLM.from\_pretrained() method and executed in a scratch environment and both models seem to be loading pretty much the same up until they get to avx2/ctransformers.dll and then it switches from python to c++ and I can’t continue inspecting them.  
I’ve parsed the binaries as best I can and see they both have the Magic Number set to GGUF and a matching tensor count. I’m not sure how to figure out what is causing that error or what other comparisons I can do.