# Attention and hidden state details from t5

**URL:** <https://discuss.huggingface.co/t/attention-and-hidden-state-details-from-t5/2029>\
**Category:** Beginners\
**Created:** [November 12, 2020, 4:24pm UTC](https://discuss.huggingface.co/t/attention-and-hidden-state-details-from-t5/2029 "2020-11-12T16:24:54Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![pcpathik](https://avatars.discourse-cdn.com/v4/letter/p/b77776/32.png) [@pcpathik](https://discuss.huggingface.co/u/pcpathik)\
**Post date:** [November 12, 2020, 4:24pm UTC](https://discuss.huggingface.co/t/attention-and-hidden-state-details-from-t5/2029/1 "2020-11-12T16:24:54Z")

</div>

I would like to know how to get the attention and hidden state details from t5-small

When I am trying to load the pre-trained model with output\_hidden\_states=True, output\_attentions=True , I get list out of index error in modeling\_tf\_t5.py file at line 574

any help on how to make it work?