vLLM Semantic Router Releases d3-ultra: A 27B Open Multimodal Decision Model
vLLM Semantic Router Releases d3-ultra: A 27B Open Multimodal Decision Model
The vLLM Semantic Router team released d3-ultra, a 26.09B-parameter dense multimodal decision model under Apache-2.0 that does not generate text but reads an input once and returns probabilities for typed questions (choice, yes/no, score, box, track), with 131,072 tokens of context per question. It scored 87.2 on the team's private SR-Text test, the highest of six decision models compared, but trailed its sibling d3-turbo on SR-Box grounding (58.2% vs 60.0% over 10 domains). It was tested on one AMD Instinct MI325X with BF16 weights, where 255 questions about a photo took 2.16 s, and is available via Transformers, the vLLM Semantic Router Engine, a free API and a Hugging Face Space.
Source: MarkTechPost · marktechpost.com