# 如何将模型转换为gguf格式？

**URL:** <https://discuss.huggingface.co/t/gguf/88663>\
**Category:** Beginners\
**Created:** [May 27, 2024, 1:52am UTC](https://discuss.huggingface.co/t/gguf/88663 "2024-05-27T01:52:05Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![sfhehfswfh](https://avatars.discourse-cdn.com/v4/letter/s/f6c823/32.png) [@sfhehfswfh](https://discuss.huggingface.co/u/sfhehfswfh)\
**Post date:** [May 27, 2024, 1:52am UTC](https://discuss.huggingface.co/t/gguf/88663/1 "2024-05-27T01:52:05Z")

</div>

How to convert models microsoft/Phi-3-vision-128k-instruct to GGUF format. One for Windows and macOS (silicon and intel), The original installation method never worked on my end, I needed a more convenient method. interchip machine.

---

<div class="post-metadata">

**Author:** ![Andynsn](https://avatars.discourse-cdn.com/v4/letter/a/e9c0ed/32.png) [@Andynsn](https://discuss.huggingface.co/u/Andynsn)\
**Post date:** [July 26, 2024, 8:50am UTC](https://discuss.huggingface.co/t/gguf/88663/2 "2024-07-26T08:50:40Z")

</div>

use llama.cpp， for example，python convert-hf-to-gguf.py Qwen/Qwen1.5-7B-Chat --outfile models/7B/qwen1\_5-7b-chat-fp16.gguf