# E5 embedding models

**URL:** <https://discuss.huggingface.co/t/e5-embedding-models/146117>\
**Category:** 🤗Transformers\
**Created:** [March 17, 2025, 12:50pm UTC](https://discuss.huggingface.co/t/e5-embedding-models/146117 "2025-03-17T12:50:54Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![koleckar](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/koleckar/32/43462_2.png) [@koleckar](https://discuss.huggingface.co/u/koleckar)\
**Post date:** [March 17, 2025, 12:50pm UTC](https://discuss.huggingface.co/t/e5-embedding-models/146117/1 "2025-03-17T12:50:54Z")

</div>

Hello everyone,  
we are unable to find any existing pre-training/fine-tuning scripts for e5-models family.  
Can someone help us?

Thank you very much for any answers.  
W/regards  
David Koleckar

---

<div class="post-metadata">

**Author:** ![John6666](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/john6666/32/27664_2.png) [@John6666](https://discuss.huggingface.co/u/John6666)\
**Post date:** [March 17, 2025, 4:54pm UTC](https://discuss.huggingface.co/t/e5-embedding-models/146117/2 "2025-03-17T16:54:47Z")

</div>

I wonder if the model is for SentenceTransformer rather than Transformers, so it’s different in terms of usability.

> **[Training and Finetuning Embedding Models with Sentence Transformers v3](https://huggingface.co/blog/train-sentence-transformers)**
>
> We’re on a journey to advance and democratize artificial intelligence through open source and open science.

> <https://github.com/microsoft/unilm/issues/1066>
>
> Dear author:
> The following informations is about the paper and project of E5: \[…Text Embeddings by Weakly-Supervised Contrastive Pre-training\](https://arxiv.org/pdf/2212.03533.pdf). Liang Wang, Nan Yang, Xiaolong Huang, Binxing Jiao, Linjun Yang, Daxin Jiang, Rangan Majumder, Furu Wei, arXiv 2022
> I want to fine-tune on my dataset. However, I do not know how to do it, there is no more information on the main site of GitHub: https://github.com/microsoft/unilm/tree/master/e5.  
> 1. I don't know how to prepare my data. Same as what is the data structure should I design.
> 2. What the tools should I use?
> Can you provide more information or train\_script / finetune\_script on the GitHub .
> Thank you very much.
