OpenAI has made its Decisions API generally available, entering a fast-growing market for so-called decision models created by the start-up TypeSafe, TechCrunch reports.
TypeSafe's Jev model chooses between a set of options very quickly and gives a confidence score, letting developers swap it in for slower, costlier large language models in some tasks. TypeSafe, founded by a former OpenAI researcher, is now valued at $7.6bn.
OpenAI's API product lead, Nikunj Handa, said the company reworked its existing ChatGPT Luna model for speed rather than training a dedicated one, cutting response times to between 100 and 180 milliseconds. The public version, first shown in September, adds voice and image inputs. Early users include Box, Datadog, Ramp and Speak. On two public benchmarks OpenAI's model ranks below Jev and rivals from Liquid and Base Lab.
Source: TechCrunch
