# How to run the Causal Language modelling example on multiple gpu?

**URL:** <https://discuss.huggingface.co/t/how-to-run-the-causal-language-modelling-example-on-multiple-gpu/106947>\
**Category:** 🤗Transformers\
**Created:** [September 16, 2024, 4:48pm UTC](https://discuss.huggingface.co/t/how-to-run-the-causal-language-modelling-example-on-multiple-gpu/106947 "2024-09-16T16:48:07Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![mayank64ce](https://avatars.discourse-cdn.com/v4/letter/m/0ea827/32.png) [@mayank64ce](https://discuss.huggingface.co/u/mayank64ce)\
**Post date:** [September 16, 2024, 4:48pm UTC](https://discuss.huggingface.co/t/how-to-run-the-causal-language-modelling-example-on-multiple-gpu/106947/1 "2024-09-16T16:48:07Z")

</div>

How can i run [transformers/examples/pytorch/language-modeling/run\_clm\_no\_trainer.py at main · huggingface/transformers · GitHub](https://github.com/huggingface/transformers/blob/main/examples/pytorch/language-modeling/run_clm_no_trainer.py) on 2 gpus ?