Building, serving and maintaining AI systems that stay up.

A long context window is not memory

Larger windows changed what fits in a prompt. They did not give the system a memory, and conflating the two produces a specific class of bug.