# How do I run this model

**URL:** <https://discuss.huggingface.co/t/how-do-i-run-this-model/39401>\
**Category:** Beginners\
**Created:** [May 10, 2023, 1:34pm UTC](https://discuss.huggingface.co/t/how-do-i-run-this-model/39401 "2023-05-10T13:34:55Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![webslug](https://avatars.discourse-cdn.com/v4/letter/w/47e85d/32.png) [@webslug](https://discuss.huggingface.co/u/webslug)\
**Post date:** [May 10, 2023, 1:34pm UTC](https://discuss.huggingface.co/t/how-do-i-run-this-model/39401/1 "2023-05-10T13:34:55Z")

</div>

Hi there, I’ve recently installed Llama with GPT4ALL and I know how to load single bin files into it but I recently came across this model which I want to try but it has two bin files.

In the past when I have tried models which use two or more **bin** files, they never seem to work in GPT4ALL / Llama and I’m completely confused.

This is the model I want to try out… I assume I can use Llama.cpp to run it? I am very confused. Help!!!

[https://huggingface.co/mosaicml/mpt-7b-storywriter/discussions/14](https://huggingface.co/mosaicml/mpt-7b-storywriter/discussions/14)

This is my llama run.bat file

title llama.cpp  
:start  
set GPU=1  
main -i --interactive-first -t 8 -r “### Human:” --temp 0 -c 2048 -n -1 --ignore-eos --repeat\_penalty 1.2 --instruct -m ggml-vic13b-uncensored-q5\_1.bin  
pause  
goto start

---

<div class="post-metadata">

**Author:** ![aidan1337](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/aidan1337/32/20992_2.png) [@aidan1337](https://discuss.huggingface.co/u/aidan1337)\
**Post date:** [November 7, 2023, 12:54pm UTC](https://discuss.huggingface.co/t/how-do-i-run-this-model/39401/2 "2023-11-07T12:54:05Z")

</div>

I have the same problem. I dont understand how to use llama.cpp with 2 bin files. Im using falcon-7b