# Transformer's trainer runtime error

**URL:** <https://discuss.huggingface.co/t/transformers-trainer-runtime-error/129375>\
**Category:** 🤗Transformers\
**Created:** [December 5, 2024, 9:14am UTC](https://discuss.huggingface.co/t/transformers-trainer-runtime-error/129375 "2024-12-05T09:14:49Z")\
**Posts on this page:** 1\
**Showing post:** 2

<div class="post-metadata">

**Author:** ![John6666](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/john6666/32/27664_2.png) [@John6666](https://discuss.huggingface.co/u/John6666)\
**Post date:** [December 5, 2024, 10:23am UTC](https://discuss.huggingface.co/t/transformers-trainer-runtime-error/129375/2 "2024-12-05T10:23:24Z")

</div>

Possibly same error.

> [@Transformer's Trainer Memory shared Error](https://discuss.huggingface.co/t/transformers-trainer-memory-shared-error/129381):
>
> I performed fine tuning flan-t5-small using peft. here is my code #loading dataset huggingface\_dataset\_name = "knkarthick/dialogsum" dataset = load\_dataset(huggingface\_dataset\_name) dataset #loading original model model\_name='google/flan-t5-base' original\_model = AutoModelForSeq2SeqLM.from\_pretrained(model\_name, torch\_dtype=torch.bfloat16).to('cuda') tokenizer = AutoTokenizer.from\_pretrained(model\_name) def tokenize\_function(example): start\_prompt = 'Summarize the following conversatio…

---

_[View the full topic](https://discuss.huggingface.co/t/transformers-trainer-runtime-error/129375)._
