# AWS SageMaker Endpoint Error | Mistral 7B Instruct v3 :

**URL:** <https://discuss.huggingface.co/t/aws-sagemaker-endpoint-error-mistral-7b-instruct-v3/103622>\
**Category:** Amazon SageMaker\
**Created:** [August 23, 2024, 12:23am UTC](https://discuss.huggingface.co/t/aws-sagemaker-endpoint-error-mistral-7b-instruct-v3/103622 "2024-08-23T00:23:50Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![NormalMatt](https://avatars.discourse-cdn.com/v4/letter/n/9e8a1a/32.png) [@NormalMatt](https://discuss.huggingface.co/u/NormalMatt)\
**Post date:** [August 23, 2024, 12:23am UTC](https://discuss.huggingface.co/t/aws-sagemaker-endpoint-error-mistral-7b-instruct-v3/103622/1 "2024-08-23T00:23:50Z")

</div>

Finetuned Mistral 7B Instruct v3 having issues deployed to AWS Endpoint using Sagemaker HuggingFace library.

`Exception: data did not match any variant of untagged enum PyPreTokenizerTypeWrapper at line 6952 column 3`

`Error: ShardCannotStart`

> Model Info:  
> sagemaker config  
> instance\_type = “ml.g5.12xlarge”  
> instance\_type = “ml.g5.12xlarge”  
> ‘MAX\_INPUT\_LENGTH’: json.dumps(1024)  
> ‘MAX\_TOTAL\_TOKENS’: json.dumps(2048)  
> ‘MAX\_BATCH\_TOTAL\_TOKENS’: json.dumps(8192)  
> “transformers\_version”: “4.44.1”