# Huggingface Optimizer

**URL:** <https://discuss.huggingface.co/t/huggingface-optimizer/40909>\
**Category:** 🤗Optimum\
**Created:** [May 25, 2023, 5:25am UTC](https://discuss.huggingface.co/t/huggingface-optimizer/40909 "2023-05-25T05:25:24Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![gordonhu](https://avatars.discourse-cdn.com/v4/letter/g/9dc877/32.png) [@gordonhu](https://discuss.huggingface.co/u/gordonhu)\
**Post date:** [May 25, 2023, 5:25am UTC](https://discuss.huggingface.co/t/huggingface-optimizer/40909/1 "2023-05-25T05:25:24Z")

</div>

Hi, We should incorporate the newly released Sophia optimizer into huggingface !

---

<div class="post-metadata">

**Author:** ![regisss](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/regisss/32/22467_2.png) [@regisss](https://discuss.huggingface.co/u/regisss)\
**Post date:** [May 25, 2023, 7:20am UTC](https://discuss.huggingface.co/t/huggingface-optimizer/40909/2 "2023-05-25T07:20:00Z")

</div>

Hi @gordonhu! Optimizers are managed in Transformers so I recommend that you open a feature request there 🙂

---

<div class="post-metadata">

**Author:** ![gordonhu](https://avatars.discourse-cdn.com/v4/letter/g/9dc877/32.png) [@gordonhu](https://discuss.huggingface.co/u/gordonhu)\
**Post date:** [May 25, 2023, 7:46am UTC](https://discuss.huggingface.co/t/huggingface-optimizer/40909/3 "2023-05-25T07:46:37Z")

</div>

Thank you for letting me know!