# Llama 3 tokenizer prints cryptic message

**URL:** <https://discuss.huggingface.co/t/llama-3-tokenizer-prints-cryptic-message/86537>\
**Category:** 🤗Transformers\
**Created:** [May 13, 2024, 6:07pm UTC](https://discuss.huggingface.co/t/llama-3-tokenizer-prints-cryptic-message/86537 "2024-05-13T18:07:40Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![basrah](https://avatars.discourse-cdn.com/v4/letter/b/8491ac/32.png) [@basrah](https://discuss.huggingface.co/u/basrah)\
**Post date:** [May 13, 2024, 6:07pm UTC](https://discuss.huggingface.co/t/llama-3-tokenizer-prints-cryptic-message/86537/1 "2024-05-13T18:07:40Z")

</div>

```auto
>>> import transformers
>>> model_name = "meta-llama/Meta-Llama-3-8B"
>>> tokenizer = transformers.AutoTokenizer.from_pretrained(model_name)
Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.

```

- What is the meaning of this message, what is its source and is it an issue?
- It seems that it is just printed to stdout, rather than using warnings or raising an exception, why?
