# Dataset list error - returns partial information

**URL:** <https://discuss.huggingface.co/t/dataset-list-error-returns-partial-information/30279>\
**Category:** 🤗Hub\
**Created:** [January 24, 2023, 10:39am UTC](https://discuss.huggingface.co/t/dataset-list-error-returns-partial-information/30279 "2023-01-24T10:39:18Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![borgr](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/borgr/32/24353_2.png) [@borgr](https://discuss.huggingface.co/u/borgr)\
**Post date:** [January 24, 2023, 10:39am UTC](https://discuss.huggingface.co/t/dataset-list-error-returns-partial-information/30279/1 "2023-01-24T10:39:18Z")

</div>

Hi,  
We tried to use HfApi to get a list of the datasets.  
When we run api.list\_datasets() - we got exactly 10000 DatasetInfos , although the web count 19,351.  
Is it possible that the api uses pagination? If it is so, can you please explain how to use it? If not, can you please explain what are we missing?

---

<div class="post-metadata">

**Author:** ![severo](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/severo/32/27449_2.png) [@severo](https://discuss.huggingface.co/u/severo)\
**Post date:** [January 24, 2023, 5:12pm UTC](https://discuss.huggingface.co/t/dataset-list-error-returns-partial-information/30279/2 "2023-01-24T17:12:31Z")

</div>

Yes, the [Hub API](https://huggingface.co/docs/hub/api) now returns a paginated response for the lists. The huggingface\_hub library takes care of the pagination and returns the complete list, but you’ll have to update it to 0.11.0 or more recent ([Release Extended HfApi, pagination, simplified login and more · huggingface/huggingface\_hub · GitHub](https://github.com/huggingface/huggingface_hub/releases/tag/v0.11.0)).