# Models for Multilingual Classification Tasks

**URL:** <https://discuss.huggingface.co/t/models-for-multilingual-classification-tasks/13003>\
**Category:** Models\
**Created:** [December 21, 2021, 10:21am UTC](https://discuss.huggingface.co/t/models-for-multilingual-classification-tasks/13003 "2021-12-21T10:21:17Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![mox](https://avatars.discourse-cdn.com/v4/letter/m/f04885/32.png) [@mox](https://discuss.huggingface.co/u/mox)\
**Post date:** [December 21, 2021, 10:21am UTC](https://discuss.huggingface.co/t/models-for-multilingual-classification-tasks/13003/1 "2021-12-21T10:21:17Z")

</div>

Hello,

I want to build a multilingual classification model (english, hindi, malayalam…) and wanted to ask if anyone has some suggentions which models to use. I would like to explore the performance of different models.  
So which models are good in general for the usecase of a text classification with different languages?

Thanks in advance!

---

<div class="post-metadata">

**Author:** ![nielsr](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/nielsr/32/39617_2.png) [@nielsr](https://discuss.huggingface.co/u/nielsr)\
**Post date:** [December 21, 2021, 1:53pm UTC](https://discuss.huggingface.co/t/models-for-multilingual-classification-tasks/13003/2 "2021-12-21T13:53:17Z")

</div>

Some great multilingual models:

- [multilingual BERT](https://huggingface.co/bert-base-multilingual-cased)/[DistilBERT](https://huggingface.co/distilbert-base-multilingual-cased)
- [XLM-RoBERTa](https://huggingface.co/docs/transformers/model_doc/xlmroberta)
- [RemBERT](https://huggingface.co/docs/transformers/model_doc/rembert)
- [CANINE](https://huggingface.co/docs/transformers/model_doc/canine)

These are all encoder-only Transformer models (great for classification, question-answering, NER,…).  
CANINE is a relatively new model that is tokenizer-free, meaning it’s a character-level model and does not require an explicit tokenization step.

For summarization/translation/etc. (seq2seq tasks), [mT5](https://huggingface.co/docs/transformers/model_doc/mt5) is a great model.

---

<div class="post-metadata">

**Author:** ![mox](https://avatars.discourse-cdn.com/v4/letter/m/f04885/32.png) [@mox](https://discuss.huggingface.co/u/mox)\
**Post date:** [December 21, 2021, 2:40pm UTC](https://discuss.huggingface.co/t/models-for-multilingual-classification-tasks/13003/3 "2021-12-21T14:40:15Z")

</div>

Thanks for your answer! I am looking for classification models, so the first ones look good for me! 🙂