Amazon introduces priming to build hybrid AI models from pretrained Transformers
According to Amazon, priming lets developers test hybrid model designs using less than 0.5% of a source Transformer’s pretraining tokens.
• Amazon says priming builds hybrid AI models from pretrained Transformers at over 99% lower pretraining cost.
• In AWS tests, a 32-billion-parameter hybrid matched its source on reasoning benchmarks and decoded up to twice as fast.
• Amazon has released eight-billion and 32-billion parameter hybrid models, code and a vLLM plugin under Apache 2.0.
Read more
October 13, 2026 28
