# TFViT model keeps throwing error while training it using TFTrainer

**URL:** <https://discuss.huggingface.co/t/tfvit-model-keeps-throwing-error-while-training-it-using-tftrainer/44411>\
**Category:** 🤗Transformers\
**Created:** [June 24, 2023, 6:10pm UTC](https://discuss.huggingface.co/t/tfvit-model-keeps-throwing-error-while-training-it-using-tftrainer/44411 "2023-06-24T18:10:25Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![AnaniyaX](https://avatars.discourse-cdn.com/v4/letter/a/8797f3/32.png) [@AnaniyaX](https://discuss.huggingface.co/u/AnaniyaX)\
**Post date:** [June 24, 2023, 6:10pm UTC](https://discuss.huggingface.co/t/tfvit-model-keeps-throwing-error-while-training-it-using-tftrainer/44411/1 "2023-06-24T18:10:25Z")

</div>

So I wanted to train TFViT for image captioning problem but the problem is I kept getting  
the model I used

```auto
model = TFVisionEncoderDecoderModel.from_encoder_decoder_pretrained(config.ENCODER, config.DECODER)

```

```auto
ile "/usr/local/lib/python3.10/dist-packages/transformers/trainer_tf.py", line 710, in distributed_training_steps *
        self.args.strategy.run(self.apply_gradients, inputs)
    File "/usr/local/lib/python3.10/dist-packages/transformers/trainer_tf.py", line 655, in apply_gradients *
        self.optimizer.apply_gradients(list(zip(gradients, self.model.trainable_variables)))
    File "/usr/local/lib/python3.10/dist-packages/keras/optimizers/optimizer.py", line 1174, in apply_gradients **
        return super().apply_gradients(grads_and_vars, name=name)
    File "/usr/local/lib/python3.10/dist-packages/keras/optimizers/optimizer.py", line 637, in apply_gradients
        self.build(trainable_variables)
    File "/usr/local/lib/python3.10/dist-packages/keras/optimizers/adam.py", line 139, in build
        self.add_variable_from_reference(
    File "/usr/local/lib/python3.10/dist-packages/keras/optimizers/optimizer.py", line 1105, in add_variable_from_reference
        with strategy.extended.colocate_vars_with(model_variable):

    AttributeError: 'NoneType' object has no attribute 'extended'

```

```auto
TensorFlow version: 2.12.0
Transformers version: 4.30.2

```