# Inference speed

**URL:** <https://discuss.huggingface.co/t/inference-speed/55325>\
**Category:** Spaces\
**Created:** [September 17, 2023, 10:41am UTC](https://discuss.huggingface.co/t/inference-speed/55325 "2023-09-17T10:41:48Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![m-ali01](https://avatars.discourse-cdn.com/v4/letter/m/4da419/32.png) [@m-ali01](https://discuss.huggingface.co/u/m-ali01)\
**Post date:** [September 17, 2023, 10:41am UTC](https://discuss.huggingface.co/t/inference-speed/55325/1 "2023-09-17T10:41:48Z")

</div>

Hello,

Does anyone have a benchmark of inference speed with llama-2 using huggingface spaces?

Another related question: are models hosted through the huggingface inference endpoint result in higher tokens/s than hf spaces using the same gpu?

Thanks