# Can I get logits for each sequence I acqired from model.generate()?

**URL:** <https://discuss.huggingface.co/t/can-i-get-logits-for-each-sequence-i-acqired-from-model-generate/2239>\
**Category:** Beginners\
**Created:** [November 26, 2020, 7:24am UTC](https://discuss.huggingface.co/t/can-i-get-logits-for-each-sequence-i-acqired-from-model-generate/2239 "2020-11-26T07:24:24Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![Byenary](https://avatars.discourse-cdn.com/v4/letter/b/b5a626/32.png) [@Byenary](https://discuss.huggingface.co/u/Byenary)\
**Post date:** [November 26, 2020, 7:24am UTC](https://discuss.huggingface.co/t/can-i-get-logits-for-each-sequence-i-acqired-from-model-generate/2239/1 "2020-11-26T07:24:24Z")

</div>

Hi, I’m currently stucked in getting logits from model.generate. I’m wondering if it is possible to get logits of each seqeucne returned by model.generate. (like logits for each token returned by model.logits)

---

<div class="post-metadata">

**Author:** ![Jung](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/jung/32/21989_2.png) [@Jung](https://discuss.huggingface.co/u/Jung)\
**Post date:** [November 27, 2020, 11:35pm UTC](https://discuss.huggingface.co/t/can-i-get-logits-for-each-sequence-i-acqired-from-model-generate/2239/2 "2020-11-27T23:35:06Z")

</div>

Hi, one way to do that is to modify `generation_utils`

> **[transformers.generation\_utils — transformers 3.5.0 documentation](https://huggingface.co/transformers/_modules/transformers/generation_utils.html)**

For examples, we can extract logits of greedy search in the `scores` variable (there are many options on next-token search eg. greedy, beam or sample searches)