# Model size doubles after finetuning

**URL:** <https://discuss.huggingface.co/t/model-size-doubles-after-finetuning/17807>\
**Category:** Models\
**Created:** [May 11, 2022, 8:31am UTC](https://discuss.huggingface.co/t/model-size-doubles-after-finetuning/17807 "2022-05-11T08:31:16Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![sripaad](https://avatars.discourse-cdn.com/v4/letter/s/9de0a6/32.png) [@sripaad](https://discuss.huggingface.co/u/sripaad)\
**Post date:** [May 11, 2022, 8:31am UTC](https://discuss.huggingface.co/t/model-size-doubles-after-finetuning/17807/1 "2022-05-11T08:31:16Z")

</div>

I noticed that deberta-v3-small(~273 MB) and MiniLM-L6-H768(~157 MB) model size increased by a lot to 541MB and 313MB respectively post finetuning.  
More details :  
AutoModelForSequenceClassification(5 labels)  
used default trainer and training args with minor changes  
warmup = 0.3  
decay = 0.03  
32 bs  
I am having trouble understanding why, does anyone have any clue?