# Undestarding output\_attentions= True

**URL:** <https://discuss.huggingface.co/t/undestarding-output-attentions-true/63466>\
**Category:** 🤗Transformers\
**Created:** [November 25, 2023, 4:23am UTC](https://discuss.huggingface.co/t/undestarding-output-attentions-true/63466 "2023-11-25T04:23:43Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![Mari22](https://avatars.discourse-cdn.com/v4/letter/m/57b2e6/32.png) [@Mari22](https://discuss.huggingface.co/u/Mari22)\
**Post date:** [November 25, 2023, 4:23am UTC](https://discuss.huggingface.co/t/undestarding-output-attentions-true/63466/1 "2023-11-25T04:23:43Z")

</div>

I have a question about output\_attentions, and I need to make a heatmap about the attention of the final layer of the BERT model. But I do not know if the output\_attentions[0] is the first or last layer. I tried to check the documentation, but I did not find it.