# Fail to upload datasets

**URL:** <https://discuss.huggingface.co/t/fail-to-upload-datasets/168661>\
**Category:** 🤗Datasets\
**Created:** [September 25, 2025, 4:09am UTC](https://discuss.huggingface.co/t/fail-to-upload-datasets/168661 "2025-09-25T04:09:13Z")\
**Posts on this page:** 5\
**Page:** 1

<div class="post-metadata">

**Author:** ![VLM-Forgetting](https://avatars.discourse-cdn.com/v4/letter/v/a698b9/32.png) [@VLM-Forgetting](https://discuss.huggingface.co/u/VLM-Forgetting)\
**Post date:** [September 25, 2025, 4:09am UTC](https://discuss.huggingface.co/t/fail-to-upload-datasets/168661/1 "2025-09-25T04:09:13Z")

</div>

I am using `huggingface-cli upload-larger-folder` to upload my dataset, but after some of the files are preuploaded, I meet the following warning:

```auto
"WARN","fields":{"message":"Status Code: 504. Retrying...","request_id":""},"filename":"/home/runner/work/xet-core/xet-core/cas_client/src/http_client.rs","line_number":236}
{"timestamp":"2025-09-25T04:04:07.388106Z","level":"WARN","fields":{"message":"Retry attempt #0. Sleeping 2.821052789s before the next attempt"},"filename":"/root/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/reqwest-retry-0.7.0/src/middleware.rs","line_number":171}

```

The command is still running but keep reporting the same warning once upon a time. What should I do?

---

<div class="post-metadata">

**Author:** ![John6666](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/john6666/32/27664_2.png) [@John6666](https://discuss.huggingface.co/u/John6666)\
**Post date:** [September 25, 2025, 5:43am UTC](https://discuss.huggingface.co/t/fail-to-upload-datasets/168661/2 "2025-09-25T05:43:20Z")

</div>

The warning itself is just a retry notification, so it’s not a problem in itself.  
However, if it occurs too frequently, it might indicate some kind of issue. One possible [temporary measure is to set `HF_HUB_DISABLE_XET`](https://discuss.huggingface.co/t/runtimeerror-cas-service-error-when-pushing-large-dataset-to-hugging-face-hub/162648/3).  
And ensure `pip install -U huggingface_hub[hf_xet]` .

---

<div class="post-metadata">

**Author:** ![VLM-Forgetting](https://avatars.discourse-cdn.com/v4/letter/v/a698b9/32.png) [@VLM-Forgetting](https://discuss.huggingface.co/u/VLM-Forgetting)\
**Post date:** [September 25, 2025, 6:28am UTC](https://discuss.huggingface.co/t/fail-to-upload-datasets/168661/3 "2025-09-25T06:28:06Z")

</div>

> [@John6666](#):
>
> [`HF_HUB_DISABLE_XET`](https://discuss.huggingface.co/t/runtimeerror-cas-service-error-when-pushing-large-dataset-to-hugging-face-hub/162648/3).

disabling [`HF_HUB_DISABLE_XET`](https://discuss.huggingface.co/t/runtimeerror-cas-service-error-when-pushing-large-dataset-to-hugging-face-hub/162648/3) works for me, thanks!

---

<div class="post-metadata">

**Author:** ![John6666](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/john6666/32/27664_2.png) [@John6666](https://discuss.huggingface.co/u/John6666)\
**Post date:** [September 25, 2025, 6:30am UTC](https://discuss.huggingface.co/t/fail-to-upload-datasets/168661/4 "2025-09-25T06:30:18Z")

</div>

Great! Just to be sure, I’ll ping it. @jsulz

---

<div class="post-metadata">

**Author:** ![jsulz](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/jsulz/32/28279_2.png) [@jsulz](https://discuss.huggingface.co/u/jsulz)\
**Post date:** [September 25, 2025, 3:33pm UTC](https://discuss.huggingface.co/t/fail-to-upload-datasets/168661/5 "2025-09-25T15:33:35Z")

</div>

Thanks for the ping, @John6666!

Those errors are indeed not a problem. As the retry message indicates, the thread that received the error response will retry in some amount of time. If there is an error that prevents the upload (or download) from completing successfully, an error message and stack trace will be printed. If that is the case, let me know and I can debug further.

@VLM-Forgetting how often did this error appear and what version of `hf-xet` do you have installed in your Python environment (you can run `hf env` in the terminal to see this)?