# Possible encoder decoder models

**URL:** <https://discuss.huggingface.co/t/possible-encoder-decoder-models/6742>\
**Category:** Beginners\
**Created:** [June 11, 2021, 9:44pm UTC](https://discuss.huggingface.co/t/possible-encoder-decoder-models/6742 "2021-06-11T21:44:46Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![scienceapptest](https://avatars.discourse-cdn.com/v4/letter/s/bcef8e/32.png) [@scienceapptest](https://discuss.huggingface.co/u/scienceapptest)\
**Post date:** [June 11, 2021, 9:44pm UTC](https://discuss.huggingface.co/t/possible-encoder-decoder-models/6742/1 "2021-06-11T21:44:46Z")

</div>

Hi huggingface team,

Is there a list of compatible models that work with the `EncoderDecoder` model?

For instance the docs mention `BERT` Encoder/Decoder and I think @patrickvonplaten has written some beautiful notebooks using `RoBERTa`, but can it be used for models like the `Reformer` or `ALBERT`? in other words, is something like below possible?

```auto
config_encoder = AlbertConfig()
config_decoder = AlbertConfig()

config = EncoderDecoderConfig.from_encoder_decoder_configs(config_encoder, config_decoder)

```