# First time to AI - apps. Do I need a GPU in order to run a model using transformers?

**URL:** <https://discuss.huggingface.co/t/first-time-to-ai-apps-do-i-need-a-gpu-in-order-to-run-a-model-using-transformers/112499>\
**Category:** 🤗Transformers\
**Created:** [October 17, 2024, 9:17am UTC](https://discuss.huggingface.co/t/first-time-to-ai-apps-do-i-need-a-gpu-in-order-to-run-a-model-using-transformers/112499 "2024-10-17T09:17:40Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![pcmagas](https://avatars.discourse-cdn.com/v4/letter/p/2bfe46/32.png) [@pcmagas](https://discuss.huggingface.co/u/pcmagas)\
**Post date:** [October 17, 2024, 9:17am UTC](https://discuss.huggingface.co/t/first-time-to-ai-apps-do-i-need-a-gpu-in-order-to-run-a-model-using-transformers/112499/1 "2024-10-17T09:17:40Z")

</div>

I made this app using transformers and huggingface:

```auto
from pathlib import Path
from typing import Union

from pypdf import PdfReader
from transformers import pipeline

question_answerer = pipeline(task="question-answering", model="deepset/tinyroberta-squad2")
question="Έχω ασφάλεια αυτοκινήτου, και είναι ασρφαλισμένο σε περίπτωση φωτιάς (=πυρκαγιάς), τι χρήματα παίρνω?"

def get_text_from_pdf(pdf_file: Union[str, Path]) -> str:
    """Read the PDF from the given path and return a string with its entire content."""
    reader = PdfReader(pdf_file)

    # Extract text from all pages
    full_text = ""
    for page in reader.pages:
        full_text += page.extract_text()
    return full_text

pdf_text = get_text_from_pdf("./pdf.pdf")
answer = question_answerer(question, pdf_text)
print(answer)

```

But taking the response is slow. So made me having these questions:

- Is model running locally or remotely?
- Do I need a GPU to run this model in a decent time?

What is the recommended GPU requirements in o4r5der for the script above to run?

---

<div class="post-metadata">

**Author:** ![John6666](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/john6666/32/27664_2.png) [@John6666](https://discuss.huggingface.co/u/John6666)\
**Post date:** [October 17, 2024, 12:21pm UTC](https://discuss.huggingface.co/t/first-time-to-ai-apps-do-i-need-a-gpu-in-order-to-run-a-model-using-transformers/112499/2 "2024-10-17T12:21:20Z")

</div>

Assume you are running the script locally, not in Colab or something.

> Is model running locally or remotely?

Locally.

> Do I need a GPU to run this model in a decent time?

I think it would definitely be faster with a GPU.

> GPU requirements in o4r5der for the script above to run?

**This model is only about 300 MB; it looks like a GeForce with 1 GB of VRAM would be fine** , so even the cheapest one will work.  
However, **generally speaking, the minimum is 12GB of VRAM** if you are going to do a lot of things with AI. That’s about what mine is! I would say I am the weakest in HF.  
And anyway, buy a newer one from **nVidia**. The other requirements are rather unimportant.