Hi, I'm Teerth.

A twenty year old tech lover who likes turning maths and ideas into solid code. Some of those ideas now live inside the codebases of companies like these.

WASD or arrows to slide · Shift to dash · click the snow to go there.Drag anywhere to steer. Tap a building to go there.

Display

Fixed at

Hold W to slide · A D to turn · S back · Shift dash · E open

resolvent: Attention and Markov paths share one operator

Attention and Markov paths share one operator.

  • 175 declarations
  • Lean 4
  • zero sorry
  • S-matrix read

I proved softmax attention and Markov path composition are settings of one operator, then found that reading it through a resolvent gives the same closed form Wheeler's S-matrix had in 1937.