Superalignment

This is the mechanism that turns a text generator into something that affects the world. It is also where the interesting failures live, because the model chooses which tool to call and with what arguments, and it will occasionally choose something reasonable-looking and wrong.

Why it matters

Every tool you connect is a new way for a mistake to leave the building.