# Read CSV multi threading

**URL:** <https://discuss.huggingface.co/t/read-csv-multi-threading/8490>\
**Category:** 🤗Datasets\
**Created:** [July 19, 2021, 11:04am UTC](https://discuss.huggingface.co/t/read-csv-multi-threading/8490 "2021-07-19T11:04:49Z")\
**Posts on this page:** 1\
**Showing post:** 5

<div class="post-metadata">

**Author:** ![lhoestq](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/lhoestq/32/52888_2.png) [@lhoestq](https://discuss.huggingface.co/u/lhoestq)\
**Post date:** [July 20, 2021, 1:46pm UTC](https://discuss.huggingface.co/t/read-csv-multi-threading/8490/5 "2021-07-20T13:46:02Z")

</div>

Once you have you processed data, you can save them using `save_to_disk` to save them in the directory of your choice. When this is done, you can completely delete your cache and reload your processed dataset with `load_from_disk` for example (see the [documentation](https://huggingface.co/docs/datasets/processing.html#saving-a-processed-dataset-on-disk-and-reload-it))

Also note that if you really need to, you can load any arrow file with `Dataset.from_file("path/to/any/arrow/file")`

---

_[View the full topic](https://discuss.huggingface.co/t/read-csv-multi-threading/8490)._