# Models taking too much time and not giving desired answers

**URL:** <https://discuss.huggingface.co/t/models-taking-too-much-time-and-not-giving-desired-answers/67317>\
**Category:** 🤗Transformers\
**Created:** [December 28, 2023, 8:11pm UTC](https://discuss.huggingface.co/t/models-taking-too-much-time-and-not-giving-desired-answers/67317 "2023-12-28T20:11:26Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![avaneesh-ramesh-07](https://avatars.discourse-cdn.com/v4/letter/a/977dab/32.png) [@avaneesh-ramesh-07](https://discuss.huggingface.co/u/avaneesh-ramesh-07)\
**Post date:** [December 28, 2023, 8:11pm UTC](https://discuss.huggingface.co/t/models-taking-too-much-time-and-not-giving-desired-answers/67317/1 "2023-12-28T20:11:26Z")

</div>

Hello all,

I am trying to use the codellama/CodeLlama-7b-Instruct-hf and the meta-llama/Llama-2-7b-hf models to summarize a given dataset. I am facing a couple problems:

1. My code creates a pipeline using the Transformers Library along with these respective models. However, when I pass a prompt to the pipeline, my command prompt successfully loads the checkpoint shards, but takes a very long time to run and answer my prompt. Is there another CodeLlama model I can use that will take a shorter time, or another way to mitigate this?

2. I have experimented with different NLP tasks, and have not found a way to pass a CSV dataset in order to obtain a summary of the dataset. I have specifically tried to use the table-question-answering task, where I passed in a pandas dataframe of my dataset along with a query asking for common trends within the dataset, but it didn’t return the expected response. The actual response is attached.

 ![image](https://us1.discourse-cdn.com/hellohellohello/original/3X/3/a/3a6e8e50c89efb8aecba554ff835ae80958eae31.png)

Is there another task/model combination that will help me achieve the desired result?

Thanks,

---

<div class="post-metadata">

**Author:** ![PradyumSomebody](https://avatars.discourse-cdn.com/v4/letter/p/0ea827/32.png) [@PradyumSomebody](https://discuss.huggingface.co/u/PradyumSomebody)\
**Post date:** [June 15, 2024, 9:43am UTC](https://discuss.huggingface.co/t/models-taking-too-much-time-and-not-giving-desired-answers/67317/2 "2024-06-15T09:43:07Z")

</div>

"my command prompt successfully loads the checkpoint shards, but takes a very long time to run and answer my prompt. "  
how long has it been taking…?  
also what gpu/cpu