# Ctransformers error : Failed to create LLM 'stablelm'

**URL:** <https://discuss.huggingface.co/t/ctransformers-error-failed-to-create-llm-stablelm/63834>\
**Category:** 🤗Transformers\
**Created:** [November 28, 2023, 9:11am UTC](https://discuss.huggingface.co/t/ctransformers-error-failed-to-create-llm-stablelm/63834 "2023-11-28T09:11:52Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![jonathanjordan21](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/jonathanjordan21/32/21627_2.png) [@jonathanjordan21](https://discuss.huggingface.co/u/jonathanjordan21)\
**Post date:** [November 28, 2023, 9:11am UTC](https://discuss.huggingface.co/t/ctransformers-error-failed-to-create-llm-stablelm/63834/1 "2023-11-28T09:11:52Z")

</div>

I often get error from `ctransformers` when importing some GGUF models with `model_type = stablelm` in Google Colab. Here is the code example

```python
from ctransformers import AutoModelForCausalLM

llm = AutoModelForCausalLM.from_pretrained("TheBloke/Marx-3B-v3-GGUF", model_file="marx-3b-v3.Q3_K_S.gguf", model_type='stablelm')
print(llm("AI is going to"))

```

It actually downloaded the `.gguf` file from repo, but returned this error message

```python
RuntimeError: Failed to create LLM 'stablelm' from '/root/.cache/huggingface/hub/models--TheBloke--Marx-3B-v3-GGUF/blobs/fb16032da1b4f68d465cb7b2164c5305be8a008657ed0cd6cbb91b3a94b032ee'.

```

---

<div class="post-metadata">

**Author:** ![marcsun13](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/marcsun13/32/19059_2.png) [@marcsun13](https://discuss.huggingface.co/u/marcsun13)\
**Post date:** [November 30, 2023, 5:26pm UTC](https://discuss.huggingface.co/t/ctransformers-error-failed-to-create-llm-stablelm/63834/2 "2023-11-30T17:26:50Z")

</div>

Hi @jonathanjordan21, please raise this issue on ctransformers library.