# Custom model with two pretrained models fails multi GPU training when using the Trainer

**URL:** <https://discuss.huggingface.co/t/custom-model-with-two-pretrained-models-fails-multi-gpu-training-when-using-the-trainer/32869>\
**Category:** 🤗Transformers\
**Created:** [March 2, 2023, 8:59am UTC](https://discuss.huggingface.co/t/custom-model-with-two-pretrained-models-fails-multi-gpu-training-when-using-the-trainer/32869 "2023-03-02T08:59:36Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![shamanez](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/shamanez/32/17994_2.png) [@shamanez](https://discuss.huggingface.co/u/shamanez)\
**Post date:** [March 2, 2023, 8:59am UTC](https://discuss.huggingface.co/t/custom-model-with-two-pretrained-models-fails-multi-gpu-training-when-using-the-trainer/32869/1 "2023-03-02T08:59:37Z")

</div>

How can I wrap the custom model class to use the trainer in multiple GPU settings