# Any simple functionality to use multiple metrics together?

**URL:** <https://discuss.huggingface.co/t/any-simple-functionality-to-use-multiple-metrics-together/6227>\
**Category:** 🤗Transformers\
**Created:** [May 18, 2021, 11:48am UTC](https://discuss.huggingface.co/t/any-simple-functionality-to-use-multiple-metrics-together/6227 "2021-05-18T11:48:48Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![ad26kr](https://avatars.discourse-cdn.com/v4/letter/a/71e660/32.png) [@ad26kr](https://discuss.huggingface.co/u/ad26kr)\
**Post date:** [May 18, 2021, 11:48am UTC](https://discuss.huggingface.co/t/any-simple-functionality-to-use-multiple-metrics-together/6227/1 "2021-05-18T11:48:48Z")

</div>

Some tasks like question generation requires multiple metrics (BLEU, METEOR, ROUGE).

It would be quite helpful if there is a function such as `load_metric(['bleu', 'meteor', 'rouge'])`

---

<div class="post-metadata">

**Author:** ![lewtun](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/lewtun/32/30995_2.png) [@lewtun](https://discuss.huggingface.co/u/lewtun)\
**Post date:** [May 18, 2021, 12:48pm UTC](https://discuss.huggingface.co/t/any-simple-functionality-to-use-multiple-metrics-together/6227/2 "2021-05-18T12:48:09Z")

</div>

hey @ad26kr, thanks for the suggestion!

one complication i see is that some metrics like `glue` are paired a subtask:

```auto
metric = load_metric('glue', sub_task)

```

so it’s not clear what should happen if someone passes something like `load_metric(["bleu", "glue"])` in your proposal. nevertheless, i invite you to open a feature request on the `datasets` library where it can be discussed in more detail: [Issues · huggingface/datasets · GitHub](https://github.com/huggingface/datasets/issues)

---

<div class="post-metadata">

**Author:** ![tanmoyio](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/tanmoyio/32/2515_2.png) [@tanmoyio](https://discuss.huggingface.co/u/tanmoyio)\
**Post date:** [August 16, 2021, 12:45pm UTC](https://discuss.huggingface.co/t/any-simple-functionality-to-use-multiple-metrics-together/6227/3 "2021-08-16T12:45:26Z")

</div>

Do we still have this feature?

---

<div class="post-metadata">

**Author:** ![MaryaAI](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/maryaai/32/14313_2.png) [@MaryaAI](https://discuss.huggingface.co/u/MaryaAI)\
**Post date:** [September 13, 2021, 8:49am UTC](https://discuss.huggingface.co/t/any-simple-functionality-to-use-multiple-metrics-together/6227/5 "2021-09-13T08:49:43Z")

</div>

Please. Did you add multi-metric feature to huggingface or not yet?
