# Quantization of Transformers model

**URL:** <https://discuss.huggingface.co/t/quantization-of-transformers-model/89220>\
**Category:** 🤗Transformers\
**Created:** [May 29, 2024, 3:28pm UTC](https://discuss.huggingface.co/t/quantization-of-transformers-model/89220 "2024-05-29T15:28:54Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![fairp](https://avatars.discourse-cdn.com/v4/letter/f/2acd7d/32.png) [@fairp](https://discuss.huggingface.co/u/fairp)\
**Post date:** [May 29, 2024, 3:28pm UTC](https://discuss.huggingface.co/t/quantization-of-transformers-model/89220/1 "2024-05-29T15:28:54Z")

</div>

Which is the best way to quantize a sentence transformer model in your opinion. I am referring to multilingual bert-based models.