# Failed to commit 504 Server Error Gateway Time-out for url

**URL:** <https://discuss.huggingface.co/t/failed-to-commit-504-server-error-gateway-time-out-for-url/133105>\
**Category:** Beginners\
**Created:** [December 26, 2024, 1:20pm UTC](https://discuss.huggingface.co/t/failed-to-commit-504-server-error-gateway-time-out-for-url/133105 "2024-12-26T13:20:38Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![hhyyjj](https://avatars.discourse-cdn.com/v4/letter/h/7ba0ec/32.png) [@hhyyjj](https://discuss.huggingface.co/u/hhyyjj)\
**Post date:** [December 26, 2024, 1:20pm UTC](https://discuss.huggingface.co/t/failed-to-commit-504-server-error-gateway-time-out-for-url/133105/1 "2024-12-26T13:20:38Z")

</div>

Hi!  
I try to use the following python code to upload my own dataset:  
from huggingface\_hub import HfApi  
api = HfApi()  
api.upload\_large\_folder(repo\_id=“hhyyjj/egoexo”, repo\_type=“dataset”,folder\_path=“Downloads/processed\_xmem”)

Initially, everything worked well, but after uploading about 96GB of data, I encountered an error. Here’s a screenshot of the error message:

 ![image](https://us1.discourse-cdn.com/hellohellohello/original/3X/3/1/31e2e812252d8121c124f97b8b0e86f0d2a7244c.jpeg)  
Does anyone know how to resolve this issue? I’d greatly appreciate any advice or solutions!  
Thanks in advance!

---

<div class="post-metadata">

**Author:** ![John6666](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/john6666/32/27664_2.png) [@John6666](https://discuss.huggingface.co/u/John6666)\
**Post date:** [December 26, 2024, 4:18pm UTC](https://discuss.huggingface.co/t/failed-to-commit-504-server-error-gateway-time-out-for-url/133105/2 "2024-12-26T16:18:54Z")

</div>

Perhaps the size was too large.😅 Although it is not prohibited, there is a possibility that it will become unstable. The following function seems to be more stable when uploading large folders.

> **[HfApi Client](https://huggingface.co/docs/huggingface_hub/v0.27.0/en/package_reference/hf_api#huggingface_hub.HfApi.upload_large_folder)**
>
> We’re on a journey to advance and democratize artificial intelligence through open source and open science.
