# Resource required to fine tune a large model?

**URL:** <https://discuss.huggingface.co/t/resource-required-to-fine-tune-a-large-model/25969>\
**Category:** Beginners\
**Created:** [November 12, 2022, 2:35pm UTC](https://discuss.huggingface.co/t/resource-required-to-fine-tune-a-large-model/25969 "2022-11-12T14:35:22Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![dnrkdnrk](https://avatars.discourse-cdn.com/v4/letter/d/f04885/32.png) [@dnrkdnrk](https://discuss.huggingface.co/u/dnrkdnrk)\
**Post date:** [November 12, 2022, 2:35pm UTC](https://discuss.huggingface.co/t/resource-required-to-fine-tune-a-large-model/25969/1 "2022-11-12T14:35:22Z")

</div>

Hi!

I am a student just started learning about NLP.  
I recently found below model in huggingface slight\_smile:, was was blown away by the performance of the model.

> **[kakaobrain/kogpt · Hugging Face](https://huggingface.co/kakaobrain/kogpt)**
>
> We’re on a journey to advance and democratize artificial intelligence through open source and open science.

So I have been playing with it and wanted to fine tune to change its tone and feed in some more data to have fluency in certain subject. The problems is that I have never dealt with such a large model, and it crushes due to shortage of GPU power. I have no idea how much resources are needed to deal with such large model so I am not sure whether I should invest on a new GPU or get a cloud VM subscription.

If any of you have tested it, I would like to ask you to share some information about how you did it and how much resources were needed. Thanks for your time!
