Transformer Architectures

OpenAI CEO Sam Altman said a new AI architecture is coming that represents a 'massive upgrade' comparable to the Transformer's leap over LSTM. He also

Amazon researchers propose T-REX, a transformer-based model for grocery basket recommendations. It addresses unique challenges like repetitive purchas

Pinterest's PinCLIP multimodal AI model enhances product discovery by 20% over standard VLMs. It addresses cold-start content with a 15% engagement up

SORT is an optimized Transformer architecture designed for industrial-scale product ranking. It overcomes data sparsity to deliver hyper-personalized

Researchers have developed Utonia, a single self-supervised transformer that learns unified 3D representations across diverse point cloud data types i

Google's TITANS architecture represents a fundamental shift from transformer limitations by implementing cognitive neuroscience principles for adaptiv

Liquid AI's LFM2-24B-A2B model introduces a novel hybrid architecture blending convolutions with attention, addressing critical scaling bottlenecks in