# Deploying models onto spaces

**URL:** <https://discuss.huggingface.co/t/deploying-models-onto-spaces/41345>\
**Category:** Beginners\
**Created:** [May 29, 2023, 5:28pm UTC](https://discuss.huggingface.co/t/deploying-models-onto-spaces/41345 "2023-05-29T17:28:05Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![TS0001](https://avatars.discourse-cdn.com/v4/letter/t/57b2e6/32.png) [@TS0001](https://discuss.huggingface.co/u/TS0001)\
**Post date:** [May 29, 2023, 5:28pm UTC](https://discuss.huggingface.co/t/deploying-models-onto-spaces/41345/1 "2023-05-29T17:28:05Z")

</div>

I have tried to deploy many of the models on the LLM leaderboard ([Open LLM Leaderboard - a Hugging Face Space by HuggingFaceH4](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)) onto a space as a Gradio app. The deploy looks ok, but all the models I have tried don’t return a response, they just time out.

I have a paid account, and am selecting an A10G for the hardware.

I am sure I am making a rookie mistake, any help would be much appreciated.

---

<div class="post-metadata">

**Author:** ![tmarkov](https://avatars.discourse-cdn.com/v4/letter/t/df705f/32.png) [@tmarkov](https://discuss.huggingface.co/u/tmarkov)\
**Post date:** [August 1, 2023, 11:43pm UTC](https://discuss.huggingface.co/t/deploying-models-onto-spaces/41345/2 "2023-08-01T23:43:30Z")

</div>

Bump, because I’m having the exact same problem.

I’ve tried to deploy a 7B model ([Ejafa/vicuna\_7B\_vanilla\_1.1 · Hugging Face](https://huggingface.co/Ejafa/vicuna_7B_vanilla_1.1?text=Suggest+a+murder+mystery+movie+with+a+female+detective)) onto T4 medium hardware, and it won’t produce response to even simple prompts. Stuck on “processing” for minutes.

Code I used to deploy is as suggested by HF interface:

```auto
import gradio as gr

gr.Interface.load("models/Ejafa/vicuna_7B_vanilla_1.1").launch()

```

---

<div class="post-metadata">

**Author:** ![TS0001](https://avatars.discourse-cdn.com/v4/letter/t/57b2e6/32.png) [@TS0001](https://discuss.huggingface.co/u/TS0001)\
**Post date:** [August 1, 2023, 11:57pm UTC](https://discuss.huggingface.co/t/deploying-models-onto-spaces/41345/3 "2023-08-01T23:57:20Z")

</div>

I gave up trying to deploy on HF in the end, and switched to Runpod. This tutorial was my starting point.

[![](https://us1.discourse-cdn.com/hellohellohello/original/3X/f/e/febbdeda5c80929a8a531230166d55f4755ee0a4.jpeg "RUN TextGen AI WebUI LLM On Runpod & Colab! Cloud Computing POWER!") ](https://www.youtube.com/watch?v=TP2yID7Ubr4)