# How to parameter efficient finetune Decoder in encoder-decoder model

**URL:** <https://discuss.huggingface.co/t/how-to-parameter-efficient-finetune-decoder-in-encoder-decoder-model/83242>\
**Category:** Beginners\
**Created:** [April 23, 2024, 3:34am UTC](https://discuss.huggingface.co/t/how-to-parameter-efficient-finetune-decoder-in-encoder-decoder-model/83242 "2024-04-23T03:34:03Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![Abhishekkgupta](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/abhishekkgupta/32/25855_2.png) [@Abhishekkgupta](https://discuss.huggingface.co/u/Abhishekkgupta)\
**Post date:** [April 23, 2024, 3:34am UTC](https://discuss.huggingface.co/t/how-to-parameter-efficient-finetune-decoder-in-encoder-decoder-model/83242/1 "2024-04-23T03:34:03Z")

</div>

I have been trying to finetune the decoder by inserting an adapter after the ffn block of a large encoder-decoder model for the MT task, but the blue score is bad when compared to full finetuning.  
Please, can anyone suggest a better method to finetune or refer me to some resources to finetune the decoder of a model

---

<div class="post-metadata">

**Author:** ![vivek9840](https://avatars.discourse-cdn.com/v4/letter/v/eb8c5e/32.png) [@vivek9840](https://discuss.huggingface.co/u/vivek9840)\
**Post date:** [April 23, 2024, 10:11pm UTC](https://discuss.huggingface.co/t/how-to-parameter-efficient-finetune-decoder-in-encoder-decoder-model/83242/2 "2024-04-23T22:11:57Z")

</div>

just a question, where you padding the model from left or right? because i made a mistake about it while infer and i got degreded result compare to left padding. i am not experienced in terms of perf, but have you tried hyper parametering it. or try the parameters other have tried? they are usually good starting points.