The transformer architecture is the reason ChatGPT exists. It’s the reason we can have this conversation with a machine at all. And it’s only been around since 2017.
Before transformers, we used Recurrent Neural Networks (RNNs) to process text. An RNN reads words one at a time, in sequence, like you reading this sentence left to right. Each word gets pro…


