Talk AI To Me

Linear Transformers

Explore transformers that replace softmax attention with linear attention functions, reducing complexity from quadratic to linear.