# Dynamic Padding not working for Custom Dataset

**URL:** <https://discuss.huggingface.co/t/dynamic-padding-not-working-for-custom-dataset/5295>\
**Category:** 🤗Datasets\
**Created:** [April 4, 2021, 2:12pm UTC](https://discuss.huggingface.co/t/dynamic-padding-not-working-for-custom-dataset/5295 "2021-04-04T14:12:25Z")\
**Posts on this page:** 6\
**Page:** 1

<div class="post-metadata">

**Author:** ![bayartsogt](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/bayartsogt/32/3707_2.png) [@bayartsogt](https://discuss.huggingface.co/u/bayartsogt)\
**Post date:** [April 4, 2021, 2:12pm UTC](https://discuss.huggingface.co/t/dynamic-padding-not-working-for-custom-dataset/5295/1 "2021-04-04T14:12:25Z")

</div>

Thank you for building a great platform!

I am trying to use custom torch.utils.data.Dataset instead of datasets.Dataset and I am getting following error:

```auto
ValueError: Caught ValueError in DataLoader worker process 0.
Original Traceback (most recent call last):
  File "/usr/local/lib/python3.7/dist-packages/transformers/feature_extraction_utils.py", line 158, in convert_to_tensors
    tensor = as_tensor(value)
ValueError: expected sequence of length 105600 at dim 2 (got 92160)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/dist-packages/torch/utils/data/_utils/worker.py", line 202, in _worker_loop
    data = fetcher.fetch(index)
  File "/usr/local/lib/python3.7/dist-packages/torch/utils/data/_utils/fetch.py", line 47, in fetch
    return self.collate_fn(data)
  File "<ipython-input-8-1e61eb8cbac4>", line 94, in __call__
    return_tensors="pt",
  File "/usr/local/lib/python3.7/dist-packages/transformers/models/wav2vec2/processing_wav2vec2.py", line 127, in pad
    return self.current_processor.pad(*args, **kwargs)
  File "/usr/local/lib/python3.7/dist-packages/transformers/feature_extraction_sequence_utils.py", line 225, in pad
    return BatchFeature(batch_outputs, tensor_type=return_tensors)
  File "/usr/local/lib/python3.7/dist-packages/transformers/feature_extraction_utils.py", line 73, in __init__
    self.convert_to_tensors(tensor_type=tensor_type)
  File "/usr/local/lib/python3.7/dist-packages/transformers/feature_extraction_utils.py", line 165, in convert_to_tensors
    "Unable to create tensor, you should probably activate padding "
ValueError: Unable to create tensor, you should probably activate padding with 'padding=True' to have batched tensors with the same length.

```

I passed `data_collactor` which, in my understanding, responsible for dynamic padding. Here is code

```python
# -------------- Custom Dataset --------------
class Dataset(torch.utils.data.Dataset):
    def __init__ (self, df):
        self.df = df

    def __len__ (self):
        return self.df.shape[0]

    def __getitem__ (self, idx):
        row = self.df.iloc[idx]
        speech_array, sampling_rate = sf.read(row['file'])
        
        input_values = processor(speech_array, sampling_rate=16_000).input_values
        with processor.as_target_processor():
            labels = processor(row["sentence"]).input_ids

        return {
            "input_values": input_values,
            "labels": labels
        }

# --------------- Trainer Part --------------
from transformers import Trainer
data_collator = DataCollatorCTCWithPadding(processor=processor, padding=True)

trainer = Trainer(
    model=model,
    data_collator=data_collator,
    args=training_args,
    compute_metrics=compute_metrics,
    train_dataset=all_train,
    eval_dataset=cv_test,
    tokenizer=processor.feature_extractor,
)

```

Has anybody faced same issue?

---

<div class="post-metadata">

**Author:** ![bayartsogt](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/bayartsogt/32/3707_2.png) [@bayartsogt](https://discuss.huggingface.co/u/bayartsogt)\
**Post date:** [April 4, 2021, 8:57pm UTC](https://discuss.huggingface.co/t/dynamic-padding-not-working-for-custom-dataset/5295/2 "2021-04-04T20:57:23Z")

</div>

This error solved!

Actually, this was not error but I got confused by how `input_values` method of `Wav2Vec2Processor` works.

```python
speech_array, sampling_rate = sf.read(row.file)
# speech_array.shape = (8900,)

input_values = processor(speech_array, sampling_rate=16_000).input_values
# input_values.shape = (1, 8900)

```

However, when you use it with `huggingface datasets`, it will return 1D array

```python
def prepare_dataset(batch):
    batch["input_values"] = processor(batch["speech"], sampling_rate=16_000).input_values
    
    with processor.as_target_processor():
        batch["labels"] = processor(batch["target_text"]).input_ids
    return batch

dataset = dataset.map(prepare_dataset, remove_columns=common_voice_train.column_names)
# np.array(dataset[0]["input_values"]).shape = (8900,)

```

---

<div class="post-metadata">

**Author:** ![truong9499](https://avatars.discourse-cdn.com/v4/letter/t/3ab097/32.png) [@truong9499](https://discuss.huggingface.co/u/truong9499)\
**Post date:** [October 21, 2021, 9:05am UTC](https://discuss.huggingface.co/t/dynamic-padding-not-working-for-custom-dataset/5295/3 "2021-10-21T09:05:45Z")

</div>

Can you tell me how you solved this error?

---

<div class="post-metadata">

**Author:** ![alerio](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/alerio/32/28595_2.png) [@alerio](https://discuss.huggingface.co/u/alerio)\
**Post date:** [February 5, 2022, 9:00pm UTC](https://discuss.huggingface.co/t/dynamic-padding-not-working-for-custom-dataset/5295/4 "2022-02-05T21:00:53Z")

</div>

Second this - how did you solve this error?

---

<div class="post-metadata">

**Author:** ![ChainYo](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/chainyo/32/4243_2.png) [@ChainYo](https://discuss.huggingface.co/u/ChainYo)\
**Post date:** [February 9, 2022, 1:43pm UTC](https://discuss.huggingface.co/t/dynamic-padding-not-working-for-custom-dataset/5295/5 "2022-02-09T13:43:20Z")

</div>

You need to make the 1D tensor to 2D tensor in order to match the expected length.

This is the trick I use to do it automatically:

```python
import torchaudio
import torch
import speechbrain as sb

info = torchaudio.info(audio_file)
sig = sb.dataio.dataio.read_audio(audio_file)

if info.num_channels > 1:
    sig = torch.mean(sig, dim=1)
resampled = torchaudio.transforms.Resample(
    info.sample_rate, 16000,
)(sig)

```

You can use anything that loads an audio file, you don’t have to use speechbrain, it’s not mandatory 🙂

---

<div class="post-metadata">

**Author:** ![alerio](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/alerio/32/28595_2.png) [@alerio](https://discuss.huggingface.co/u/alerio)\
**Post date:** [February 9, 2022, 6:35pm UTC](https://discuss.huggingface.co/t/dynamic-padding-not-working-for-custom-dataset/5295/6 "2022-02-09T18:35:40Z")

</div>

Thanks for your suggestions. However it does not work on my end - the dataset I’m using is already 1 channel, and I believe that the error mentioned in OP is related to padding. Presumably `prepare_dataset` should pad `labels` to the same length as `input_values` dynamically but somehow it did not pad at al.