# Regarding GGUF Quantize model

**URL:** <https://discuss.huggingface.co/t/regarding-gguf-quantize-model/84477>\
**Category:** Models\
**Created:** [April 30, 2024, 7:55am UTC](https://discuss.huggingface.co/t/regarding-gguf-quantize-model/84477 "2024-04-30T07:55:16Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![akarshan8001](https://avatars.discourse-cdn.com/v4/letter/a/977dab/32.png) [@akarshan8001](https://discuss.huggingface.co/u/akarshan8001)\
**Post date:** [April 30, 2024, 7:55am UTC](https://discuss.huggingface.co/t/regarding-gguf-quantize-model/84477/1 "2024-04-30T07:55:17Z")

</div>

I have use PEFT lora technique to fine tune a mistral model i used bit and byte for my quantization so wanted to where its saving ,mu quantize model and how i can use quantize model with my adapter layer. if any reference please share article