# BartForConditionalGeneration: Adding additional layers of embedding

**URL:** <https://discuss.huggingface.co/t/bartforconditionalgeneration-adding-additional-layers-of-embedding/86309>\
**Category:** Models\
**Created:** [May 12, 2024, 5:30am UTC](https://discuss.huggingface.co/t/bartforconditionalgeneration-adding-additional-layers-of-embedding/86309 "2024-05-12T05:30:53Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![animeshk](https://avatars.discourse-cdn.com/v4/letter/a/7feea3/32.png) [@animeshk](https://discuss.huggingface.co/u/animeshk)\
**Post date:** [May 12, 2024, 5:30am UTC](https://discuss.huggingface.co/t/bartforconditionalgeneration-adding-additional-layers-of-embedding/86309/1 "2024-05-12T05:30:53Z")

</div>

In this file:

```auto
https://github.com/huggingface/transformers/blob/main/src/transformers/models/bart/modeling_bart.py

```

I think-

> Inside the BartEncoder, on this [line](https://github.com/huggingface/transformers/blob/e0c3cee17085914bbe505c159beeb8ae39bc37dd/src/transformers/models/bart/modeling_bart.py#L1166), I have to add other embeddings

Could anyone tell me - are there any other places I need to modify to add additional layers of embedding (e.g., 2 other embedding with positional embedding)?

---

<div class="post-metadata">

**Author:** ![animeshk](https://avatars.discourse-cdn.com/v4/letter/a/7feea3/32.png) [@animeshk](https://discuss.huggingface.co/u/animeshk)\
**Post date:** [May 12, 2024, 5:23pm UTC](https://discuss.huggingface.co/t/bartforconditionalgeneration-adding-additional-layers-of-embedding/86309/2 "2024-05-12T17:23:45Z")

</div>

@ArthurZ Could you please help here?

---

<div class="post-metadata">

**Author:** ![ArthurZ](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/arthurz/32/26972_2.png) [@ArthurZ](https://discuss.huggingface.co/u/ArthurZ)\
**Post date:** [July 11, 2024, 8:18am UTC](https://discuss.huggingface.co/t/bartforconditionalgeneration-adding-additional-layers-of-embedding/86309/3 "2024-07-11T08:18:46Z")

</div>

Hey! Sorry for the late answer, I think your intuition is correct
