# Distributed training on different gpus

**URL:** <https://discuss.huggingface.co/t/distributed-training-on-different-gpus/52741>\
**Category:** Beginners\
**Created:** [August 30, 2023, 2:58am UTC](https://discuss.huggingface.co/t/distributed-training-on-different-gpus/52741 "2023-08-30T02:58:25Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![zisisnotzis](https://avatars.discourse-cdn.com/v4/letter/z/958977/32.png) [@zisisnotzis](https://discuss.huggingface.co/u/zisisnotzis)\
**Post date:** [August 30, 2023, 2:58am UTC](https://discuss.huggingface.co/t/distributed-training-on-different-gpus/52741/1 "2023-08-30T02:58:26Z")

</div>

Is there any way to do distributed training (e.g. DDP) on different GPUs (e.g. from 1080 to 4090) efficiently? like without being bounded by the weakest GPU? (I have some older GPUs of different models and I want to utilize them)