# Error loading Wikipedia Dataset

**URL:** <https://discuss.huggingface.co/t/error-loading-wikipedia-dataset/26599>\
**Category:** 🤗Datasets\
**Created:** [November 23, 2022, 4:56pm UTC](https://discuss.huggingface.co/t/error-loading-wikipedia-dataset/26599 "2022-11-23T16:56:15Z")\
**Posts on this page:** 7\
**Page:** 1

<div class="post-metadata">

**Author:** ![JosepRC](https://avatars.discourse-cdn.com/v4/letter/j/5f9b8f/32.png) [@JosepRC](https://discuss.huggingface.co/u/JosepRC)\
**Post date:** [November 23, 2022, 4:56pm UTC](https://discuss.huggingface.co/t/error-loading-wikipedia-dataset/26599/1 "2022-11-23T16:56:15Z")

</div>

Last week, the following code was working:  
dataset = load\_dataset(‘wikipedia’, ‘20220301.en’)

This week, it raises the following error:

> MissingBeamOptions: Trying to generate a dataset using Apache Beam, yet no Beam Runner or PipelineOptions() has been provided in `load_dataset` or in the builder arguments. For big datasets it has to run on large-scale data processing tools like Dataflow, Spark, etc. More information about Apache Beam runners at [Apache Beam Capability Matrix](https://beam.apache.org/documentation/runners/capability-matrix/)  
> If you really want to run it locally because you feel like the Dataset is small enough, you can use the local beam runner called `DirectRunner` (you may run out of memory).  
> Example of usage:  
> `load_dataset('wikipedia', '20220301.en', beam_runner='DirectRunner')`

When I try to follow the example of usage, the error is this one:

> Couldn’t find file at [https://dumps.wikimedia.org/enwiki/20220301/dumpstatus.json](https://dumps.wikimedia.org/enwiki/20220301/dumpstatus.json)

Does someone know how to load the English Wikipedia dataset?

---

<div class="post-metadata">

**Author:** ![varadgunjal](https://avatars.discourse-cdn.com/v4/letter/v/58956e/32.png) [@varadgunjal](https://discuss.huggingface.co/u/varadgunjal)\
**Post date:** [November 29, 2022, 9:24pm UTC](https://discuss.huggingface.co/t/error-loading-wikipedia-dataset/26599/2 "2022-11-29T21:24:53Z")

</div>

Can confirm I’m facing the same error

---

<div class="post-metadata">

**Author:** ![JosepRC](https://avatars.discourse-cdn.com/v4/letter/j/5f9b8f/32.png) [@JosepRC](https://discuss.huggingface.co/u/JosepRC)\
**Post date:** [November 30, 2022, 3:52pm UTC](https://discuss.huggingface.co/t/error-loading-wikipedia-dataset/26599/3 "2022-11-30T15:52:48Z")

</div>

My temporary solution has been to install a previous version of the datasets package, in my case 2.6.1:

> !pip install datasets==2.6.1

Let’s hope it is fixed soon!

---

<div class="post-metadata">

**Author:** ![varadgunjal](https://avatars.discourse-cdn.com/v4/letter/v/58956e/32.png) [@varadgunjal](https://discuss.huggingface.co/u/varadgunjal)\
**Post date:** [November 30, 2022, 4:28pm UTC](https://discuss.huggingface.co/t/error-loading-wikipedia-dataset/26599/4 "2022-11-30T16:28:51Z")

</div>

Yes, I can confirm that reverting to 2.6.1 worked for me as well.

---

<div class="post-metadata">

**Author:** ![kexin1](https://avatars.discourse-cdn.com/v4/letter/k/839c29/32.png) [@kexin1](https://discuss.huggingface.co/u/kexin1)\
**Post date:** [December 1, 2022, 5:34am UTC](https://discuss.huggingface.co/t/error-loading-wikipedia-dataset/26599/5 "2022-12-01T05:34:04Z")

</div>

same error stuck for days

---

<div class="post-metadata">

**Author:** ![lhoestq](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/lhoestq/32/52888_2.png) [@lhoestq](https://discuss.huggingface.co/u/lhoestq)\
**Post date:** [December 1, 2022, 2:39pm UTC](https://discuss.huggingface.co/t/error-loading-wikipedia-dataset/26599/6 "2022-12-01T14:39:33Z")

</div>

Thanks for reporting. I opened a PR to fix this at [Fix loading from HF GCP cache by lhoestq · Pull Request #5321 · huggingface/datasets · GitHub](https://github.com/huggingface/datasets/pull/5321)

In the meantime please use `datasets==2.6.2`

---

<div class="post-metadata">

**Author:** ![TrueStateAI](https://avatars.discourse-cdn.com/v4/letter/t/e36b37/32.png) [@TrueStateAI](https://discuss.huggingface.co/u/TrueStateAI)\
**Post date:** [July 5, 2023, 10:44pm UTC](https://discuss.huggingface.co/t/error-loading-wikipedia-dataset/26599/7 "2023-07-05T22:44:41Z")

</div>

This error is also raised for this dataset when no name is specified in the load\_dataset method. I.e. load\_dataset(“wikipedia”, None, split=“train”). While this is a rookie mistake, I found the resulting error to be misleading, hence the reply.