# Word embedding with BERT

**URL:** <https://discuss.huggingface.co/t/word-embedding-with-bert/15188>\
**Category:** 🤗Transformers\
**Created:** [February 28, 2022, 5:12am UTC](https://discuss.huggingface.co/t/word-embedding-with-bert/15188 "2022-02-28T05:12:47Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![toyl](https://avatars.discourse-cdn.com/v4/letter/t/73ab20/32.png) [@toyl](https://discuss.huggingface.co/u/toyl)\
**Post date:** [February 28, 2022, 5:12am UTC](https://discuss.huggingface.co/t/word-embedding-with-bert/15188/1 "2022-02-28T05:12:47Z")

</div>

how can I join the embeddings from the word position and all its trailing “##” subwords? as the embedding, I got for subwords like

```auto
man on snow ##board on the snow
man is throwing fr ##is catch

```

and I need the word without ## and also need the meaning as snow ##board should be snowboard and fr ##is should be frisbee and a lot of words like that