OpenAI Combines 200 Medium Things Into One

There is no single big unlock behind GPT progress; rather, as an Ilya Sutskever quote puts it, OpenAI 'multiplies 200 medium-sized things together into one giant thing,' with distributed constant innovation across teams that come together in surprising ways, requiring people to keep the whole picture in their heads even while working in the weeds.