Mambas & Transformers: what it means for application builders.
In 2017, Google published a deep learning architecture called Transformer. It revolutionised the fields of Artificial Intelligence and Machine Learning. Fast forward to 2024: transformer-based Large Language Models (LLMs) power routinely used chatbots able to understand and answer using natural language. The Transformer architecture is so successful that some believe it won’t be dethroned for the next few years.