# fine tuning encoder decoder for custom language translation

**URL:** <https://discuss.huggingface.co/t/fine-tuning-encoder-decoder-for-custom-language-translation/5674>\
**Category:** Models\
**Created:** [April 22, 2021, 2:20am UTC](https://discuss.huggingface.co/t/fine-tuning-encoder-decoder-for-custom-language-translation/5674 "2021-04-22T02:20:39Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![yansoares](https://avatars.discourse-cdn.com/v4/letter/y/898d66/32.png) [@yansoares](https://discuss.huggingface.co/u/yansoares)\
**Post date:** [April 22, 2021, 2:20am UTC](https://discuss.huggingface.co/t/fine-tuning-encoder-decoder-for-custom-language-translation/5674/1 "2021-04-22T02:20:39Z")

</div>

Hello everyone,  
I would like to know if you can train a BERT2GPT model (or other models) for translation of customized languages ​​(from scratch). I need to translate gloss signals from ASL to English.

I have already looked for tutorials on the internet, but most of them are for the task of generating text, I cannot find tutorials for translating text.

I read about EncoderDecoder, I think it’s possible, I just don’t know how to make a notebook to perform training from scratch using the hugging face models.

Could you help me? Has anyone done something like that?