# Issue in Model Loading

**URL:** <https://discuss.huggingface.co/t/issue-in-model-loading/105248>\
**Category:** Models\
**Created:** [September 4, 2024, 10:50am UTC](https://discuss.huggingface.co/t/issue-in-model-loading/105248 "2024-09-04T10:50:01Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![saurabh2203](https://avatars.discourse-cdn.com/v4/letter/s/d9b06d/32.png) [@saurabh2203](https://discuss.huggingface.co/u/saurabh2203)\
**Post date:** [September 4, 2024, 10:50am UTC](https://discuss.huggingface.co/t/issue-in-model-loading/105248/1 "2024-09-04T10:50:01Z")

</div>

Hi , I tried to load , **meta-llama/Meta-Llama-3.1-70B** INT4 version but i am getting the fatal error as we have 32 GB Ram in my server…here model is loaded successfully but during prediction i am getting fatal error …can somebody help me on this