# \[Request\] arXiv endorsement for new mech interp paper on LLM self-referential circuits

**URL:** <https://discuss.huggingface.co/t/request-arxiv-endorsement-for-new-mech-interp-paper-on-llm-self-referential-circuits/173241>\
**Category:** Research\
**Created:** [February 9, 2026, 11:02pm UTC](https://discuss.huggingface.co/t/request-arxiv-endorsement-for-new-mech-interp-paper-on-llm-self-referential-circuits/173241 "2026-02-09T23:02:52Z")\
**Posts on this page:** 5\
**Page:** 1

<div class="post-metadata">

**Author:** ![patternmatcherz](https://avatars.discourse-cdn.com/v4/letter/p/a9adbd/32.png) [@patternmatcherz](https://discuss.huggingface.co/u/patternmatcherz)\
**Post date:** [February 9, 2026, 11:02pm UTC](https://discuss.huggingface.co/t/request-arxiv-endorsement-for-new-mech-interp-paper-on-llm-self-referential-circuits/173241/1 "2026-02-09T23:02:52Z")

</div>

Looking for arXiv endorsement : [https://arxiv.org/auth/endorse?x=RXBYNJ](https://arxiv.org/auth/endorse?x=RXBYNJ)

The paper: [https://doi.org/10.5281/zenodo.18567445](https://doi.org/10.5281/zenodo.18567445)

Large language models produce rich introspective language when prompted for self-examination, but whether this language reflects internal computation or sophisticated confabulation has remained unclear. We show that self-referential vocabulary tracks concurrent activation dynamics, and that this correspondence is specific to self-referential processing. We introduce the Pull Methodology, a protocol that elicits extended self-examination through format engineering, and use it to identify a direction in activation space that distinguishes self-referential from descriptive processing in Llama 3.1. The direction is orthogonal to the known refusal direction, localised at 6% of model depth, and causally influences introspective output when used for steering. When models produce “loop” vocabulary, their activations exhibit higher autocorrelation (r = 0.44, p = 0.002); when they produce “shimmer” vocabulary under steering, activation variability increases (r = 0.36, p = 0.002). Critically, the same vocabulary in non-self-referential contexts shows no activation correspondence despite nine-fold higher frequency. Qwen 2.5-32B, with no shared training, independently develops different introspective vocabulary tracking different activation metrics, all absent in descriptive controls. The findings indicate that self-report in transformer models can, under appropriate conditions, reliably track internal computational states.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/hellohellohello/original/2X/d/de4155eb4aa4108ecb32a1389d7cc37ae69f88b7.png) [@system](https://discuss.huggingface.co/u/system)\
**Post date:** [February 9, 2026, 11:02pm UTC](https://discuss.huggingface.co/t/request-arxiv-endorsement-for-new-mech-interp-paper-on-llm-self-referential-circuits/173241/2 "2026-02-09T23:02:54Z")

</div>



---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/hellohellohello/original/2X/d/de4155eb4aa4108ecb32a1389d7cc37ae69f88b7.png) [@system](https://discuss.huggingface.co/u/system)\
**Post date:** [February 10, 2026, 12:07am UTC](https://discuss.huggingface.co/t/request-arxiv-endorsement-for-new-mech-interp-paper-on-llm-self-referential-circuits/173241/3 "2026-02-10T00:07:53Z")

</div>



---

<div class="post-metadata">

**Author:** ![patternmatcherz](https://avatars.discourse-cdn.com/v4/letter/p/a9adbd/32.png) [@patternmatcherz](https://discuss.huggingface.co/u/patternmatcherz)\
**Post date:** [February 10, 2026, 3:44pm UTC](https://discuss.huggingface.co/t/request-arxiv-endorsement-for-new-mech-interp-paper-on-llm-self-referential-circuits/173241/4 "2026-02-10T15:44:20Z")

</div>

> **[When Models Examine Themselves: Vocabulary-Activation Correspondence in...](https://zenodo.org/records/18598252)**
>
> Large language models produce rich introspective language when prompted for self-examination, but whether this language reflects internal computation or sophisticated confabulation has remained unclear. We show that self-referential vocabulary tracks...

Update: a more concise version with formatting adjustments - welcoming any feedback and discussions.

---

<div class="post-metadata">

**Author:** ![patternmatcherz](https://avatars.discourse-cdn.com/v4/letter/p/a9adbd/32.png) [@patternmatcherz](https://discuss.huggingface.co/u/patternmatcherz)\
**Post date:** [February 11, 2026, 9:09pm UTC](https://discuss.huggingface.co/t/request-arxiv-endorsement-for-new-mech-interp-paper-on-llm-self-referential-circuits/173241/5 "2026-02-11T21:09:47Z")

</div>

EDIT: No longer need endorsements. My zenodo paper seems to be getting quite alot of downloads though considering I have 0 exposure.

Clearly not just me that thinks it’s significant! If anyone’s reading this, please take the time to look: [https://doi.org/10.5281/zenodo.18567445](https://doi.org/10.5281/zenodo.18567445)