# Need help on wav2vec 2.0 models training

**URL:** <https://discuss.huggingface.co/t/need-help-on-wav2vec-2-0-models-training/8880>\
**Category:** 🤗Transformers\
**Created:** [July 31, 2021, 5:55pm UTC](https://discuss.huggingface.co/t/need-help-on-wav2vec-2-0-models-training/8880 "2021-07-31T17:55:19Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![Krawist](https://avatars.discourse-cdn.com/v4/letter/k/bbce88/32.png) [@Krawist](https://discuss.huggingface.co/u/Krawist)\
**Post date:** [July 31, 2021, 5:55pm UTC](https://discuss.huggingface.co/t/need-help-on-wav2vec-2-0-models-training/8880/1 "2021-07-31T17:55:19Z")

</div>

Hello guys, I’m using transformers library and I want to build speech recognition systems base on wav2vec 2.0

I have different problems

1. Base on the exemple here [Wav2Vec2 — transformers 4.7.0 documentation](https://huggingface.co/transformers/master/model_doc/wav2vec2.html#wav2vec2forpretraining)  
I have tried to pretrain a model. But I have seen in the github on fairseq wav2vec that the loss object at the end, I can call a backward method on, but here I can.

2. how can I perform batch training in wav2vec.

Guys please I need help, even another documentation or examples.

---

<div class="post-metadata">

**Author:** ![ahmedlone123](https://avatars.discourse-cdn.com/v4/letter/a/c4cdca/32.png) [@ahmedlone123](https://discuss.huggingface.co/u/ahmedlone123)\
**Post date:** [July 31, 2021, 6:06pm UTC](https://discuss.huggingface.co/t/need-help-on-wav2vec-2-0-models-training/8880/2 "2021-07-31T18:06:04Z")

</div>

[https://github.com/huggingface/blog/blob/master/fine-tune-wav2vec2-english.md](https://github.com/huggingface/blog/blob/master/fine-tune-wav2vec2-english.md)

try this

---

<div class="post-metadata">

**Author:** ![Krawist](https://avatars.discourse-cdn.com/v4/letter/k/bbce88/32.png) [@Krawist](https://discuss.huggingface.co/u/Krawist)\
**Post date:** [July 31, 2021, 6:26pm UTC](https://discuss.huggingface.co/t/need-help-on-wav2vec-2-0-models-training/8880/3 "2021-07-31T18:26:36Z")

</div>

Thanks you
