# Regarding outputs in Encoder

**URL:** <https://discuss.huggingface.co/t/regarding-outputs-in-encoder/16654>\
**Category:** Beginners\
**Created:** [April 10, 2022, 2:15am UTC](https://discuss.huggingface.co/t/regarding-outputs-in-encoder/16654 "2022-04-10T02:15:44Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![utsavdutta98](https://avatars.discourse-cdn.com/v4/letter/u/b9e5f3/32.png) [@utsavdutta98](https://discuss.huggingface.co/u/utsavdutta98)\
**Post date:** [April 10, 2022, 2:15am UTC](https://discuss.huggingface.co/t/regarding-outputs-in-encoder/16654/1 "2022-04-10T02:15:44Z")

</div>

Hi!

Say I have a sentence “This is hugging face”.  
And I pass it through an encoder, say BERT.

The encoder takes in the attention mask and input ids and the output is (512,768) dimensional.

My question was, what do these outputs refer to? Each each (1,768) encoder output representation correspond to it’s corresponding input token. And if so, are only the first (3,768) representations relevant?