# Llama 3.2 1G error

**URL:** <https://discuss.huggingface.co/t/llama-3-2-1g-error/109902>\
**Category:** Beginners\
**Created:** [October 3, 2024, 2:09am UTC](https://discuss.huggingface.co/t/llama-3-2-1g-error/109902 "2024-10-03T02:09:48Z")\
**Posts on this page:** 1\
**Showing post:** 2

<div class="post-metadata">

**Author:** ![John6666](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/john6666/32/27664_2.png) [@John6666](https://discuss.huggingface.co/u/John6666)\
**Post date:** [October 3, 2024, 3:00am UTC](https://discuss.huggingface.co/t/llama-3-2-1g-error/109902/2 "2024-10-03T03:00:11Z")

</div>

Like this:

> [@How to use gated model in inference](https://discuss.huggingface.co/t/how-to-use-gated-model-in-inference/108911/2):
>
> You could do it by making the code look like this. Sample code import transformers import torch model\_id = "meta-llama/Meta-Llama-3.1-8B-Instruct" pipeline = transformers.pipeline( "text-generation", model=model\_id, model\_kwargs={"torch\_dtype": torch.bfloat16}, device\_map="auto", ) messages = [{"role": "system", "content": "You are a pirate chatbot who always responds in pirate speak!"}, {"role": "user", "content": "Who are you?"},] outputs = pipeline( messag…

---

_[View the full topic](https://discuss.huggingface.co/t/llama-3-2-1g-error/109902)._