# Inference Hyperparameters

**URL:** <https://discuss.huggingface.co/t/inference-hyperparameters/9539>\
**Category:** Amazon SageMaker\
**Created:** [August 27, 2021, 7:45pm UTC](https://discuss.huggingface.co/t/inference-hyperparameters/9539 "2021-08-27T19:45:26Z")\
**Posts on this page:** 1\
**Showing post:** 10

<div class="post-metadata">

**Author:** ![Oigres](https://avatars.discourse-cdn.com/v4/letter/o/a8b319/32.png) [@Oigres](https://discuss.huggingface.co/u/Oigres)\
**Post date:** [September 15, 2021, 1:35pm UTC](https://discuss.huggingface.co/t/inference-hyperparameters/9539/10 "2021-09-15T13:35:31Z")

</div>

Okay.

[Here](https://discuss.huggingface.co/t/how-are-the-inputs-tokenized-when-model-deployment/9692/6) you suggested to me to add the `Truncation` parameter. This is a parameter related with the tokenizer. Why it can be used as “pipeline parameter”. I’m looking for a solution like:

```python
parameters = {
                  'truncation': True,
                  'max_length': 256,
                  'padding': True,
}

```

But I don’t know if the names are right or they aren’t (except `Truncation`, since you suggested the name). Seems that “max\_length” parameter has not any effect on predictions because such predictions are exactly the same with different values.

---

_[View the full topic](https://discuss.huggingface.co/t/inference-hyperparameters/9539)._