# Text Generation output keep repeat input sentences. Am I missing somethings

**URL:** <https://discuss.huggingface.co/t/text-generation-output-keep-repeat-input-sentences-am-i-missing-somethings/61166>\
**Category:** Beginners\
**Created:** [November 6, 2023, 3:39am UTC](https://discuss.huggingface.co/t/text-generation-output-keep-repeat-input-sentences-am-i-missing-somethings/61166 "2023-11-06T03:39:04Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![illnino](https://avatars.discourse-cdn.com/v4/letter/i/76d3ee/32.png) [@illnino](https://discuss.huggingface.co/u/illnino)\
**Post date:** [November 6, 2023, 3:39am UTC](https://discuss.huggingface.co/t/text-generation-output-keep-repeat-input-sentences-am-i-missing-somethings/61166/1 "2023-11-06T03:39:04Z")

</div>

I use gpt2 train them by some dataset save it to local model.  
When I use it its keep repeating the input

 ![Screenshot 2023-11-06 101226](https://us1.discourse-cdn.com/hellohellohello/original/3X/d/6/d61c5fd4b12310199f6b0fa9d0e1b97e87e6f697.png)

```auto
import torch
from transformers import pipeline

generator = pipeline(
    "text-generation", 
    model="./boba", 
    torch_dtype=torch.bfloat16, 
    device_map="auto"
    )
outputs = generator(
    "Hello, I'm a language model,", 
    max_length=30, 
    num_return_sequences=5,
    repetition_penalty=2.0
    )

for o in outputs:
    print(o)

print("\n")

```

---

<div class="post-metadata">

**Author:** ![tiago-machado](https://avatars.discourse-cdn.com/v4/letter/t/58956e/32.png) [@tiago-machado](https://discuss.huggingface.co/u/tiago-machado)\
**Post date:** [May 27, 2024, 8:35pm UTC](https://discuss.huggingface.co/t/text-generation-output-keep-repeat-input-sentences-am-i-missing-somethings/61166/2 "2024-05-27T20:35:53Z")

</div>

Have you found any solution? I’m facing the same problem. However, I’m using vicuna instead

---

<div class="post-metadata">

**Author:** ![illnino](https://avatars.discourse-cdn.com/v4/letter/i/76d3ee/32.png) [@illnino](https://discuss.huggingface.co/u/illnino)\
**Post date:** [May 31, 2024, 1:00pm UTC](https://discuss.huggingface.co/t/text-generation-output-keep-repeat-input-sentences-am-i-missing-somethings/61166/3 "2024-05-31T13:00:22Z")

</div>

Not sure. I’ve change model to DialogGPT

---

<div class="post-metadata">

**Author:** ![nielsr](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/nielsr/32/39617_2.png) [@nielsr](https://discuss.huggingface.co/u/nielsr)\
**Post date:** [May 31, 2024, 1:04pm UTC](https://discuss.huggingface.co/t/text-generation-output-keep-repeat-input-sentences-am-i-missing-somethings/61166/4 "2024-05-31T13:04:57Z")

</div>

Hi,

By default greedy decoding is used and text generation is deterministic. You can pass the `do_sample` flag to the generator to get non-deterministic behaviour.

See this blog post for an overview: [How to generate text: using different decoding methods for language generation with Transformers](https://huggingface.co/blog/how-to-generate)