# Custom PretrainedModel does not loaded correctly

**URL:** <https://discuss.huggingface.co/t/custom-pretrainedmodel-does-not-loaded-correctly/26277>\
**Category:** Beginners\
**Created:** [November 17, 2022, 11:27pm UTC](https://discuss.huggingface.co/t/custom-pretrainedmodel-does-not-loaded-correctly/26277 "2022-11-17T23:27:25Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![LearnToGrow](https://avatars.discourse-cdn.com/v4/letter/l/5fc32e/32.png) [@LearnToGrow](https://discuss.huggingface.co/u/LearnToGrow)\
**Post date:** [November 17, 2022, 11:27pm UTC](https://discuss.huggingface.co/t/custom-pretrainedmodel-does-not-loaded-correctly/26277/1 "2022-11-17T23:27:25Z")

</div>

```auto
class CustomClassifier(nn.Module):
        .....

class MultipleClassifiers(PreTrainedModel):
        def __init__ (self, encoder:AutoModel, config: AutoConfig) -> None:
                super(). __init__ (config)
                self.encoder = encoder
                self.output_heads = nn.ModuleDict()
                classifier1 = CustomClassfier(encoder, num_classes=100)
                classifier2 = CustomClassfier(encoder, num_classes=1000)
        ...

config = AutoConfig.from_pretrained("distilbert-base")
encoder = AutoModel("distilbert-base")
model = MultipleClassifiers(encoder, config)

# I trained the model using Trainer.
# The problem is when I wan to load the trained model:
model = AutoModel.from_pretrained("path") # load RobertaModel not MultipleClassifiers
model = AutoModelForSequenceClassification.from_pretrained("path") # RobertaForSequenceClassification

```

How to modify the config or anything else to force the model loading MultipleClassifiers AutoModelForSequenceClassification because I want to use it with TextClassificationPipeline