GPT-OSS-120B

Ingredient list

1. #1Chain-of-Thought Prompting

   Invented by Google · 2022-01 · Velocity 4y

   “GPT-OSS-120B is a reasoning model that pushes the frontier of accuracy, implying it uses step-by-step reasoning techniques.”

   reasoningmedium
2. #2Rotary Position Embedding (RoPE)

   Invented by Zhuiyi Technology · 2021-04 · Velocity 5y

   “As a large language model in the GPT lineage, it almost certainly uses Rotary Position Embedding (RoPE), which is standard in modern transformer architectures.”

   architecturemedium
3. #3Transformer Self-Attention

   Invented by Google · 2017-06 · Velocity 9y

   “GPT-OSS-120B is a 120-billion parameter model, which fundamentally relies on the transformer self-attention architecture.”

   architecturehigh