# Chatbot Start Prompt for GPT-J

**URL:** <https://discuss.huggingface.co/t/chatbot-start-prompt-for-gpt-j/23576>\
**Category:** 🤗Transformers\
**Created:** [September 25, 2022, 12:03am UTC](https://discuss.huggingface.co/t/chatbot-start-prompt-for-gpt-j/23576 "2022-09-25T00:03:21Z")\
**Posts on this page:** 7\
**Page:** 1

<div class="post-metadata">

**Author:** ![Eichhof](https://avatars.discourse-cdn.com/v4/letter/e/f4b2a3/32.png) [@Eichhof](https://discuss.huggingface.co/u/Eichhof)\
**Post date:** [September 25, 2022, 12:03am UTC](https://discuss.huggingface.co/t/chatbot-start-prompt-for-gpt-j/23576/1 "2022-09-25T00:03:21Z")

</div>

Hello

I’m using GPT-J (EleutherAI/gpt-j-6B) as a chatbot. As a prompt, I provide a sample conversation as shown below. When now a new conversation starts, I append the input of the user to this sample conversation (“Hello, how are you doing?” in the example below).

Now, the problem is that the conversation is sometimes inconsistent because GPT-J might want to continue the sample conversation but the new user input could break that.

How can this be solved?

> This is a discussion between a Human and a Chatbot.
> 
> Human:  
> Can you do push-ups?
> 
> Chatbot:  
> Of course I can. It’s a piece of cake! Believe it or not, I can do 30 push-ups a minute.
> 
> Human:  
> Really? I think that’s impossible!
> 
> Chatbot:  
> You mean 30 push-ups?
> 
> Human:  
> Yeah!
> 
> Chatbot:  
> It’s easy. If you do exercise everyday, you can make it, too.
> 
> Human:  
> Hello, how are you doing?
> 
> Chatbot:

---

<div class="post-metadata">

**Author:** ![Eichhof](https://avatars.discourse-cdn.com/v4/letter/e/f4b2a3/32.png) [@Eichhof](https://discuss.huggingface.co/u/Eichhof)\
**Post date:** [September 30, 2022, 9:42pm UTC](https://discuss.huggingface.co/t/chatbot-start-prompt-for-gpt-j/23576/2 "2022-09-30T21:42:26Z")

</div>

Does somebody have an idea?

---

<div class="post-metadata">

**Author:** ![Eichhof](https://avatars.discourse-cdn.com/v4/letter/e/f4b2a3/32.png) [@Eichhof](https://discuss.huggingface.co/u/Eichhof)\
**Post date:** [October 28, 2022, 9:21pm UTC](https://discuss.huggingface.co/t/chatbot-start-prompt-for-gpt-j/23576/3 "2022-10-28T21:21:01Z")

</div>

No hints or tips?

---

<div class="post-metadata">

**Author:** ![PanEa](https://avatars.discourse-cdn.com/v4/letter/p/0ea827/32.png) [@PanEa](https://discuss.huggingface.co/u/PanEa)\
**Post date:** [October 29, 2022, 10:14am UTC](https://discuss.huggingface.co/t/chatbot-start-prompt-for-gpt-j/23576/4 "2022-10-29T10:14:00Z")

</div>

you may add some example conversations/episodes as few-shots, which can lead the model to generate much better. also you need a special line or token to seperate each episode incase the information in previous episodes been used in the last one

---

<div class="post-metadata">

**Author:** ![Eichhof](https://avatars.discourse-cdn.com/v4/letter/e/f4b2a3/32.png) [@Eichhof](https://discuss.huggingface.co/u/Eichhof)\
**Post date:** [October 31, 2022, 12:23am UTC](https://discuss.huggingface.co/t/chatbot-start-prompt-for-gpt-j/23576/5 "2022-10-31T00:23:36Z")

</div>

Thank you very much for your answer. How many conversations and how many turns per conversation do you think are reasonable given the restricted history of 2024 tokens and that I also want to store the history of the conversation?

What special line / token would you use?

---

<div class="post-metadata">

**Author:** ![binarakr15](https://avatars.discourse-cdn.com/v4/letter/b/f08c70/32.png) [@binarakr15](https://discuss.huggingface.co/u/binarakr15)\
**Post date:** [May 21, 2026, 11:14pm UTC](https://discuss.huggingface.co/t/chatbot-start-prompt-for-gpt-j/23576/6 "2026-05-21T23:14:18Z")

</div>

I agree with your point. Asking ChatGPT to explain things step by step is very useful because it makes difficult topics easier to understand. I also find that asking for examples helps connect the explanation to real tasks.

---

<div class="post-metadata">

**Author:** ![sophiacarters](https://avatars.discourse-cdn.com/v4/letter/s/a587f6/32.png) [@sophiacarters](https://discuss.huggingface.co/u/sophiacarters)\
**Post date:** [September 22, 2026, 5:05am UTC](https://discuss.huggingface.co/t/chatbot-start-prompt-for-gpt-j/23576/7 "2026-09-22T05:05:00Z")

</div>

I agree with your point. Asking ChatGPT to explain things step by step is very useful because it makes difficult topics easier to understand. I also find that asking for examples helps connect the explanation to real tasks.
