# Deploying custom inference script with llama2 finetuned model

**URL:** <https://discuss.huggingface.co/t/deploying-custom-inference-script-with-llama2-finetuned-model/63280>\
**Category:** Amazon SageMaker\
**Created:** [November 23, 2023, 12:00pm UTC](https://discuss.huggingface.co/t/deploying-custom-inference-script-with-llama2-finetuned-model/63280 "2023-11-23T12:00:33Z")\
**Posts on this page:** 1\
**Showing post:** 2

<div class="post-metadata">

**Author:** ![philschmid](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/philschmid/32/38022_2.png) [@philschmid](https://discuss.huggingface.co/u/philschmid)\
**Post date:** [November 23, 2023, 1:22pm UTC](https://discuss.huggingface.co/t/deploying-custom-inference-script-with-llama2-finetuned-model/63280/2 "2023-11-23T13:22:29Z")

</div>

You cannot use the llm container with a custom inference script.

---

_[View the full topic](https://discuss.huggingface.co/t/deploying-custom-inference-script-with-llama2-finetuned-model/63280)._