# Deleting Duplicate Saved Datasets

**URL:** <https://discuss.huggingface.co/t/deleting-duplicate-saved-datasets/22508>\
**Category:** 🤗Datasets\
**Created:** [September 4, 2022, 10:42am UTC](https://discuss.huggingface.co/t/deleting-duplicate-saved-datasets/22508 "2022-09-04T10:42:16Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![hose](https://avatars.discourse-cdn.com/v4/letter/h/b5a626/32.png) [@hose](https://discuss.huggingface.co/u/hose)\
**Post date:** [September 4, 2022, 10:42am UTC](https://discuss.huggingface.co/t/deleting-duplicate-saved-datasets/22508/1 "2022-09-04T10:42:16Z")

</div>

My dataset is eating too much space  
I want to remove duplicates and obsolete datasets that I no longer use  
how do i do that?

background  
I checked the PC\_user/.cache file and found that the dataset was downloaded redundantly.Inside hugginhface/datasets/downloads/extracted, something that looks like the main body of libirispeech is saved, but something else ( yalp\_rebiew\_full squad, etc.) could not be found Instead, there was a terrible amount of cache lined up.If possible, I would like to wipe out these as well.

---

<div class="post-metadata">

**Author:** ![lhoestq](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/lhoestq/32/52888_2.png) [@lhoestq](https://discuss.huggingface.co/u/lhoestq)\
**Post date:** [September 6, 2022, 12:09pm UTC](https://discuss.huggingface.co/t/deleting-duplicate-saved-datasets/22508/2 "2022-09-06T12:09:53Z")

</div>

In .cache/huggingface/datasets you can delete all the datasets that you no longer use (they are stored as Arrow files inside directories named after the datasets you used).

In .cache/huggingface/datasets/downloads you can also remove the raw data files that were downloaded to generate the Arrow datasets

---

<div class="post-metadata">

**Author:** ![hose](https://avatars.discourse-cdn.com/v4/letter/h/b5a626/32.png) [@hose](https://discuss.huggingface.co/u/hose)\
**Post date:** [September 7, 2022, 9:31am UTC](https://discuss.huggingface.co/t/deleting-duplicate-saved-datasets/22508/3 "2022-09-07T09:31:38Z")

</div>

Should I do it manually? Will that cause any problems?

---

<div class="post-metadata">

**Author:** ![lhoestq](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/lhoestq/32/52888_2.png) [@lhoestq](https://discuss.huggingface.co/u/lhoestq)\
**Post date:** [September 7, 2022, 3:08pm UTC](https://discuss.huggingface.co/t/deleting-duplicate-saved-datasets/22508/4 "2022-09-07T15:08:28Z")

</div>

First, in case you want to keep librispeech or any audio dataset, please locate the folder containing the audio files in downloads/exctracted. You might want to keep this one for librispeech.

Other than that you can remove the rest