# Train huggingface

**URL:** <https://discuss.huggingface.co/t/train-huggingface/61488>\
**Category:** Beginners\
**Created:** [November 8, 2023, 8:48am UTC](https://discuss.huggingface.co/t/train-huggingface/61488 "2023-11-08T08:48:06Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![Nghengu123](https://avatars.discourse-cdn.com/v4/letter/n/35a633/32.png) [@Nghengu123](https://discuss.huggingface.co/u/Nghengu123)\
**Post date:** [November 8, 2023, 8:48am UTC](https://discuss.huggingface.co/t/train-huggingface/61488/1 "2023-11-08T08:48:06Z")

</div>

I’m a Beginner in Fine-tuning model. I follow step by step some video on Youtube. But when i try to autotrain the Model LLama2 i catch this Error

 ![image_2023-11-08_154556929](https://us1.discourse-cdn.com/hellohellohello/original/3X/2/b/2beb9b12c047f5afde9995095eddaf30d3aaa526.png)  
Autotrain code : !autotrain llm --train --project\_name [Name] --model TinyPixel/Llama-2-7B-bf16-sharded --data\_path [MyPath] --use\_peft --use\_int4 --learning\_rate 2e-4 --train\_batch\_size 2 --num\_train\_epochs 3 --trainer sft --model\_max\_length 2048 --push\_to\_hub --repo\_id [MyPath] --token [mytoken] --block\_size 2048  
Please help me!

---

<div class="post-metadata">

**Author:** ![realshyfox](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/realshyfox/32/28549_2.png) [@realshyfox](https://discuss.huggingface.co/u/realshyfox)\
**Post date:** [November 10, 2023, 9:11am UTC](https://discuss.huggingface.co/t/train-huggingface/61488/2 "2023-11-10T09:11:04Z")

</div>

Hello Nghengu123  
I am not a pro myself but struggling with some issues also.  
But as I see it seems a dataset formatting issue.  
Try using a stripped version of the original dataset to see if it´s working on your model.  
As I do remember you must create a guanaco format dataset.

---

<div class="post-metadata">

**Author:** ![Nghengu123](https://avatars.discourse-cdn.com/v4/letter/n/35a633/32.png) [@Nghengu123](https://discuss.huggingface.co/u/Nghengu123)\
**Post date:** [November 10, 2023, 12:17pm UTC](https://discuss.huggingface.co/t/train-huggingface/61488/3 "2023-11-10T12:17:53Z")

</div>

Can you help me, what is Guanaco format ? It’s new for me , i dont have any knowledge about this format ?.?. How can i strip dataset. Additionally, what column do you think cause to that issue.  
Here is column in dataset  
 ![image_2023-11-10_191733207](https://us1.discourse-cdn.com/hellohellohello/original/3X/5/e/5e4f819a70d69dd6d8486ebedd54b6d708c34712.png)