# Problem fine-tuning a model with Seq2Seq Trainer

**URL:** <https://discuss.huggingface.co/t/problem-fine-tuning-a-model-with-seq2seq-trainer/24157>\
**Category:** Beginners\
**Created:** [October 8, 2022, 10:20pm UTC](https://discuss.huggingface.co/t/problem-fine-tuning-a-model-with-seq2seq-trainer/24157 "2022-10-08T22:20:25Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![Rosy99](https://avatars.discourse-cdn.com/v4/letter/r/db5fbb/32.png) [@Rosy99](https://discuss.huggingface.co/u/Rosy99)\
**Post date:** [October 8, 2022, 10:20pm UTC](https://discuss.huggingface.co/t/problem-fine-tuning-a-model-with-seq2seq-trainer/24157/1 "2022-10-08T22:20:26Z")

</div>

Hi I’m following the tutorial [Summarization](https://huggingface.co/docs/transformers/tasks/summarization) for fine tuning a model similar to bart on the text summarization task

```auto
training_args = Seq2SeqTrainingArguments(
   output_dir="./results",
   evaluation_strategy="epoch",
   learning_rate=2e-5,
   per_device_train_batch_size=8,
   per_device_eval_batch_size=8,
   weight_decay=0.01,
   save_total_limit=3,
   num_train_epochs=1,
   remove_unused_columns=False
)

trainer = Seq2SeqTrainer(
   model=model,
   args=training_args,
   train_dataset=tokenized_train_df,
   eval_dataset=tokenized_val_df ,
   tokenizer=tokenizer,
   data_collator=data_collator,
)

trainer.train()

```

I have around 53000 rows in my train dataset and 17000 rows in my validation dataset, but even i’m following every step from the tutorial, everything crashes without even an error message, can anyone help me understanding this??

---

<div class="post-metadata">

**Author:** ![sd3ntato](https://avatars.discourse-cdn.com/v4/letter/s/838e76/32.png) [@sd3ntato](https://discuss.huggingface.co/u/sd3ntato)\
**Post date:** [June 25, 2023, 2:01pm UTC](https://discuss.huggingface.co/t/problem-fine-tuning-a-model-with-seq2seq-trainer/24157/2 "2023-06-25T14:01:26Z")

</div>

we need to see how you instantiate the model