# Upload dataset rate limit

**URL:** <https://discuss.huggingface.co/t/upload-dataset-rate-limit/89484>\
**Category:** 🤗Datasets\
**Created:** [May 30, 2024, 7:31pm UTC](https://discuss.huggingface.co/t/upload-dataset-rate-limit/89484 "2024-05-30T19:31:15Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![tsbpp](https://avatars.discourse-cdn.com/v4/letter/t/8491ac/32.png) [@tsbpp](https://discuss.huggingface.co/u/tsbpp)\
**Post date:** [May 30, 2024, 7:31pm UTC](https://discuss.huggingface.co/t/upload-dataset-rate-limit/89484/1 "2024-05-30T19:31:15Z")

</div>

Hi, I tried using parallel to upload datasets, but it quickly hit the rate limit. I now switch back to upload it one by one but it still says rate limit. I also tried upgrade to pro user but it doesn’t help

---

<div class="post-metadata">

**Author:** ![severo](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/severo/32/27449_2.png) [@severo](https://discuss.huggingface.co/u/severo)\
**Post date:** [May 31, 2024, 8:08am UTC](https://discuss.huggingface.co/t/upload-dataset-rate-limit/89484/2 "2024-05-31T08:08:59Z")

</div>

cc @Wauplin for the rate-limit

also: [Repository limitations and recommendations](https://huggingface.co/docs/hub/repositories-recommendations) in case it helps

---

<div class="post-metadata">

**Author:** ![Wauplin](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/wauplin/32/40815_2.png) [@Wauplin](https://discuss.huggingface.co/u/Wauplin)\
**Post date:** [May 31, 2024, 8:52am UTC](https://discuss.huggingface.co/t/upload-dataset-rate-limit/89484/3 "2024-05-31T08:52:22Z")

</div>

Rate limits are lifted after 1h so it should get back to normal soon. Depending on your dataset size, you might be interested in looking at this experimental feature that upload large datasets in an reliable way (avoiding rate limits as much as possible): [[Feedback welcome] CLI to upload arbitrary huge folder by Wauplin · Pull Request #2254 · huggingface/huggingface\_hub · GitHub](https://github.com/huggingface/huggingface_hub/pull/2254).
