# Modify bert embeddings

**URL:** <https://discuss.huggingface.co/t/modify-bert-embeddings/13831>\
**Category:** 🤗Transformers\
**Created:** [January 18, 2022, 6:43am UTC](https://discuss.huggingface.co/t/modify-bert-embeddings/13831 "2022-01-18T06:43:29Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![ShivaniSri](https://avatars.discourse-cdn.com/v4/letter/s/3ab097/32.png) [@ShivaniSri](https://discuss.huggingface.co/u/ShivaniSri)\
**Post date:** [January 18, 2022, 6:43am UTC](https://discuss.huggingface.co/t/modify-bert-embeddings/13831/1 "2022-01-18T06:43:29Z")

</div>

I want to modify bert embeddings (multiply bert embeddings with a vector) and forward it to bert encoder layer

bert = AutoModel.from\_pretrained(‘bert-base-uncased’)

How to modify embeddings