# GPT-GPT encoder decoder

**URL:** <https://discuss.huggingface.co/t/gpt-gpt-encoder-decoder/5968>\
**Category:** 🤗Transformers\
**Created:** [May 4, 2021, 9:37am UTC](https://discuss.huggingface.co/t/gpt-gpt-encoder-decoder/5968 "2021-05-04T09:37:17Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![Yeah](https://avatars.discourse-cdn.com/v4/letter/y/dbc845/32.png) [@Yeah](https://discuss.huggingface.co/u/Yeah)\
**Post date:** [May 4, 2021, 9:37am UTC](https://discuss.huggingface.co/t/gpt-gpt-encoder-decoder/5968/1 "2021-05-04T09:37:18Z")

</div>

May i create an encoder decoder in transformer, in which the encoder and decoder part both are GPT2.  
Anyone has suggestion for that?

Thanks a lot and appreciate for any feedback.