# About using llama-cpp-python

**URL:** <https://discuss.huggingface.co/t/about-using-llama-cpp-python/96024>\
**Category:** Beginners\
**Created:** [July 8, 2024, 1:04am UTC](https://discuss.huggingface.co/t/about-using-llama-cpp-python/96024 "2024-07-08T01:04:25Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![ks99999](https://avatars.discourse-cdn.com/v4/letter/k/b782af/32.png) [@ks99999](https://discuss.huggingface.co/u/ks99999)\
**Post date:** [July 8, 2024, 1:04am UTC](https://discuss.huggingface.co/t/about-using-llama-cpp-python/96024/1 "2024-07-08T01:04:25Z")

</div>

I would like to create a chat demo of a quantized model using llama-cpp-python.

When I implement the Python code and try it with cpu\_basic / free, I can chat.  
cpu\_basic is worked well.

However, when I upgrade to cpu upgrade, $0.03/h, it does not work.

Specifically, when I try to load the model with llama\_cpp\_python, there is no response after the function call and the subsequent processing is not executed.

I think the reason it does not work well when the CPU or memory is increased is because there is some insufficient setting or machine constraint.

If you have any solutions (suggestions), could you please tell me?

 ![ss](https://us1.discourse-cdn.com/hellohellohello/original/3X/4/1/41d7465a342426846bc8d46427992c9dac27f885.png)