# Tokenizing Issue Fine Tuning BERT

**URL:** <https://discuss.huggingface.co/t/tokenizing-issue-fine-tuning-bert/34658>\
**Category:** Beginners\
**Created:** [March 25, 2023, 8:06pm UTC](https://discuss.huggingface.co/t/tokenizing-issue-fine-tuning-bert/34658 "2023-03-25T20:06:46Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![blepine](https://avatars.discourse-cdn.com/v4/letter/b/ad7895/32.png) [@blepine](https://discuss.huggingface.co/u/blepine)\
**Post date:** [March 25, 2023, 8:06pm UTC](https://discuss.huggingface.co/t/tokenizing-issue-fine-tuning-bert/34658/1 "2023-03-25T20:06:47Z")

</div>

So I am following the documentation for Fine-Tuning [here](https://colab.research.google.com/drive/1U7SX7jNYsNQG5BY1xEQQHu48Pn6Vgnyt?usp=sharing#scrollTo=unjuTtKUjZI3)

My dataset is different, in that all of my labels are in one column. I was able to get them into a labels list in the same way, and make the two dictionaries, id2label and label2id.

I’m running into issues with the preprocess function where its returning 'KeyError: ‘trusting’" where trusting is one of my labels

I’m assuming it’s something to do with the labels\_batch line, but I’m not certain.

Thanks in advance!

 ![Screenshot 2023-03-25 at 1.05.26 PM](https://us1.discourse-cdn.com/hellohellohello/original/2X/1/162aef0651d39557812ceaa6dc4c0d04b66be8ae.png)
