# How to continue training without trainer

**URL:** <https://discuss.huggingface.co/t/how-to-continue-training-without-trainer/14065>\
**Category:** 🤗Transformers\
**Created:** [January 24, 2022, 6:24pm UTC](https://discuss.huggingface.co/t/how-to-continue-training-without-trainer/14065 "2022-01-24T18:24:57Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![zheyuye](https://avatars.discourse-cdn.com/v4/letter/z/fbc32d/32.png) [@zheyuye](https://discuss.huggingface.co/u/zheyuye)\
**Post date:** [January 24, 2022, 6:24pm UTC](https://discuss.huggingface.co/t/how-to-continue-training-without-trainer/14065/1 "2022-01-24T18:24:57Z")

</div>

I am trying to continue training my model from a checkpoint, without Trainer. The model for continued training seemed incoherent with the previously saved model on both loss and evaluateion results. I am wondering f I didn’t save model correctly and missing Optimizer memory info. Here is the way how i save the model

```auto
accelerator.wait_for_everyone()
            unwrapped_model = accelerator.unwrap_model(model)
            unwrapped_model.save_pretrained(args.output_dir, save_function=accelerator.save)
            if accelerator.is_main_process:
                tokenizer.save_pretrained(args.output_dir)

```