Attention as Lattice Gauge Theory: Relations Interact Only Through Wilson Loops
arXiv cs.AI · 28 Oct 2026, 03:58 AEST
The study presents a novel approach to attention mechanisms in AI, framing them through the lens of lattice gauge theory. It demonstrates that relations can only interact through Wilson loops, leading to unique forms of edge attention.
Key facts
- Relations compose through the entity they share - Alice is Bob's mother and Bob is Carol's father, so Alice is Carol's grandmother - and the order matters, since a father's mother is not a mother's father; verifying a composed relation means closing the loop.
- In the pure-gauge sector, relations that share no cycle cannot interact at all.
- The only gauge-invariant score of a triangle is a class function of its holonomy $H = T_{ij} T_{jk} T_{ki}$ - a Wilson loop.
- With no training and composition alone, it infers unobserved $S_4$ relations on sparse graphs at 0.88 with a fifth of the edges corrupted, at or slightly below specialist synchronization algorithms.
- Its holonomy score flags corrupted triangles at AUC 0.99 where commuting scores are capped at 0.76 by a second selection rule.
Read aloud
The study presents a novel approach to attention mechanisms in A I, framing them through the lens of lattice gauge theory. It demonstrates that relations can only interact through Wilson loops, leading to unique forms of edge attention. Relations compose through the entity they share - Alice is Bob's mother and Bob is Carol's father, so Alice is Carol's grandmother - and the order matters, since a father's mother is not a mother's father; verifying a composed relation means closing the loop. In the pure-gauge sector, relations that share no cycle cannot interact at all. The only gauge-invariant score of a triangle is a class function of its holonomy $H = T ij T jk T ki $ - a Wilson loop. With no training and composition alone, it infers unobserved $S 4$ relations on sparse graphs at zero point eight eight with a fifth of the edges corrupted, at or slightly below specialist synchronization algorithms. Its holonomy score flags corrupted triangles at AUC zero point nine nine where commuting scores are capped at zero point seven six by a second selection rule.
Sources in this cluster
- Attention as Lattice Gauge Theory: Relations Interact Only Through Wilson Loops
arXiv cs.AI · 28 Oct 2026, 03:58 AEST