📰 Newspapers

As decision model use skyrockets, is customization is the next frontier?

As decision model use skyrockets, is customization is the next frontier?

Sqwish Labs has a new wrinkle on the decision model: Train it with your own data to max its capabilities.

In October, more than one in four requests on Vercel’s AI model router went to decision models, not LLMs — an enormous share of work for a kind of computerized intelligence that was invented only a month earlier.

Decision models are LLMs that don’t produce output tokens; instead, they’re tuned to use their general intelligence to quickly and cheaply decide between preset options, while registering its level of confidence in the choice. They’re useful in production environments, where fast decisions can be more important than the reasoning provided by a slower and more expensive frontier model.

TypeSafe became a $7.5 billion company after releasing its Jev family of models, which continues to dominate usage (at least where we can see metrics from services like OpenRouter, which handled more than 1.5 billion queries to TypeSafe’s models last week).

However, it’s easy to make a decision model, and dozens were released in the wake of Jev. One Amazon engineer made one in a weekend, and soon every hyperscaler had its own option. On Tuesday, Microsoft CEO Satya Nadella said that his company is rolling out its decision model, Microsoft-Decision-1.1, for wide use on Azure immediately.

The action is happening on both ends of the ecosystem: Sqwish, a UK-based AI startup behind a decision model called kettei fat, announced a $3 million pre-seed…

In brief

In October, more than one in four requests on Vercel’s AI model router went to decision models, not LLMs — an enormous share of work for a kind of computerized intelligence that was invented only a month earlier. On Tuesday, Microsoft CEO Satya Nadella said that his company is rolling out its decision model, Microsoft-Decision-1.1, for wide use on Azure immediately.

This is the opening of the story, shared with credit to TechCrunch. The rest of the report — with every detail — continues on the publisher’s website.

Continue reading at TechCrunch ↗

Cookie settings

Choose which cookies we may use. You can change this at any time from Cookie settings in the footer. Details of each cookie are in the Cookie Policy.

Strictly necessary

Needed for sign-in, security, payments and remembering these choices. Always on.

Preferences

Remember settings such as dark mode.

Analytics & performance

Help us count visits, understand which pages, devices and countries our readers use, and measure how well the site performs – anonymous and aggregated.

Advertising & marketing

Lets advertising partners show and personalise adverts, measure impressions, clicks and visits, prevent ad fraud and pay us – this is how the free site is funded.

🔔 News notifications

Get headlines from NewsHub on this device — even when the site is closed.

You can switch this off at any time. Works on Android, Windows, Mac and Linux browsers; on iPhone/iPad add the site to your Home Screen first.