# ASR on inference endpoints

**URL:** <https://discuss.huggingface.co/t/asr-on-inference-endpoints/57022>\
**Category:** Intermediate\
**Created:** [October 1, 2023, 7:37pm UTC](https://discuss.huggingface.co/t/asr-on-inference-endpoints/57022 "2023-10-01T19:37:58Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![ejmiddle](https://avatars.discourse-cdn.com/v4/letter/e/e19b73/32.png) [@ejmiddle](https://discuss.huggingface.co/u/ejmiddle)\
**Post date:** [October 1, 2023, 7:37pm UTC](https://discuss.huggingface.co/t/asr-on-inference-endpoints/57022/1 "2023-10-01T19:37:58Z")

</div>

Hi there,

I am a bit lost on which path to continue on the following task:  
I want to use whisper large v2 on quite a bit of audio files. Current working options are simply the openai api (costly) and local inference with pipelines (slow). Another hopefully simple option would be using inference endpoints instead, based on the openai/whisper-large-v2 repo.

However, it seems like I cannot pass arguments there, like chunk\_size, language etc. (at least this is what I understand from the documentation). So the questions are

- Is it correct, that I actually cannot pass arguments if simply setting up the inference endpoint with openai/whisper-large-v2 repo? If wrong, how to do it?
- If correct: What is an alternative? I find custom handlers as a possible solution, but I am a bit lost on what the logic then is. I would somehow have to combine the repositories philschmid/openai-whisper-endpoint and openai/whisper-large-v2. Doing so does not seem straightforward to me

Any suggestions on this?

Thank you so much  
Andi

---

<div class="post-metadata">

**Author:** ![brianjking](https://avatars.discourse-cdn.com/v4/letter/b/db5fbb/32.png) [@brianjking](https://discuss.huggingface.co/u/brianjking)\
**Post date:** [February 11, 2024, 10:30pm UTC](https://discuss.huggingface.co/t/asr-on-inference-endpoints/57022/2 "2024-02-11T22:30:03Z")

</div>

Did you ever figure this out? When I deploy on inference endpoints for Whisper, it never works. I’ve not had this issue before with other models.
