# Which data parallel does trainer use? DP or DDP?

**URL:** <https://discuss.huggingface.co/t/which-data-parallel-does-trainer-use-dp-or-ddp/16021>\
**Category:** 🤗Transformers\
**Created:** [March 24, 2022, 6:03am UTC](https://discuss.huggingface.co/t/which-data-parallel-does-trainer-use-dp-or-ddp/16021 "2022-03-24T06:03:27Z")\
**Posts on this page:** 1\
**Showing post:** 5

<div class="post-metadata">

**Author:** ![John6666](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/john6666/32/27664_2.png) [@John6666](https://discuss.huggingface.co/u/John6666)\
**Post date:** [August 30, 2025, 2:42am UTC](https://discuss.huggingface.co/t/which-data-parallel-does-trainer-use-dp-or-ddp/16021/5 "2025-08-30T02:42:00Z")

</div>

Hmm… Have you tried [launching it via `accelerate` or `torchrun`](https://discuss.huggingface.co/t/how-to-run-single-node-multi-gpu-training-with-hf-trainer/19503)?

```bash
# single node, 2 GPUs
torchrun --nproc_per_node=2 train.py
# or
accelerate launch --num_processes=2 train.py

```

### [Accelerator selection](https://huggingface.co/docs/transformers/v4.56.0/en/accelerator_selection)

---

_[View the full topic](https://discuss.huggingface.co/t/which-data-parallel-does-trainer-use-dp-or-ddp/16021)._