# Combine LORA with full finetuning

**URL:** <https://discuss.huggingface.co/t/combine-lora-with-full-finetuning/53490>\
**Category:** Intermediate\
**Created:** [September 4, 2023, 1:37pm UTC](https://discuss.huggingface.co/t/combine-lora-with-full-finetuning/53490 "2023-09-04T13:37:00Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![donatojb](https://avatars.discourse-cdn.com/v4/letter/d/848f3c/32.png) [@donatojb](https://discuss.huggingface.co/u/donatojb)\
**Post date:** [September 4, 2023, 1:37pm UTC](https://discuss.huggingface.co/t/combine-lora-with-full-finetuning/53490/1 "2023-09-04T13:37:01Z")

</div>

Hi, I added some custom layers to a LLM and I would like to train all the custom parameters fully but use LORA for the LLM parameters. Is it possible to combine LORA in some layers and full finetuning in other layers?

Thank you