# Replace roberta embedding with bge\_base embedding in layoutlmv3

**URL:** <https://discuss.huggingface.co/t/replace-roberta-embedding-with-bge-base-embedding-in-layoutlmv3/52684>\
**Category:** 🤗Transformers\
**Created:** [August 29, 2023, 3:25pm UTC](https://discuss.huggingface.co/t/replace-roberta-embedding-with-bge-base-embedding-in-layoutlmv3/52684 "2023-08-29T15:25:12Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![shm141](https://avatars.discourse-cdn.com/v4/letter/s/cab0a1/32.png) [@shm141](https://discuss.huggingface.co/u/shm141)\
**Post date:** [August 29, 2023, 3:25pm UTC](https://discuss.huggingface.co/t/replace-roberta-embedding-with-bge-base-embedding-in-layoutlmv3/52684/1 "2023-08-29T15:25:12Z")

</div>

I’m experimenting Funsd like dataset for token classification using layoutLmv3, I’m trying to replace roberta embedding with bge\_base, Is it possible to replace the embedding? will it improve the accuracy?