OpenAI has announced broad access to the Decisions API, a new specialized tool designed for ultra-fast and cost-effective AI decision-making. The innovation rollout comes as the tech giant seeks to capture a leading position in a promising segment previously dominated by niche startup TypeSafe with its Jev system. Processing time for the new product has been successfully reduced from the traditional 1-3 seconds down to a record-breaking 100-180 milliseconds.
Technological Features and Performance Speed
Decision-making models allow artificial intelligence to swiftly choose from available options and assess its own confidence level in the result. Instead of building an entirely new architecture from scratch, OpenAI's development team reconfigured the existing ChatGPT Luna model, optimizing it for rapid request processing and reduced operating costs. Nikunj Handa, Head of API Product at OpenAI, noted that the company's engineers closely studied the market success of similar solutions and swiftly created their own competitive version.
The primary technological breakthrough of the Decisions API is its response speed, dropping to 100-180 milliseconds. In the long term, developers plan to introduce specialized training that will reduce latency down to 60 milliseconds. Such a metric will open up opportunities for the full processing of every single frame in a video stream in real time.
Initial Deployment Results and Competitive Landscape
During the preliminary testing phase, companies such as Datadog, Ramp, and Speak utilized the new interface to replace previous OpenAI tools. Notably, the popular tutoring service Speak managed to cut the delay between user actions from 1.4 seconds down to 0.13 seconds, while also improving the overall sensitivity of the Dots voice assistant.
Nevertheless, the rapid decision-making solutions market remains highly competitive. TypeSafe CEO Diogo Almeida expressed skepticism regarding standard benchmarks, recommending that businesses evaluate models on real-world operational scenarios. In public indices, developments from Liquid and Base Lab remain leaders, while the updated Jev system retains popularity on the OpenRouter platform and ranks high in the specialized JevMan benchmark.
Future Prospects and Market Impact
The emergence of accessible tools with minimal response times marks the industry's transition to fundamentally new artificial intelligence usage scenarios. Previously, complex automation tasks were hindered by high latency and significant computational costs, but model optimization erases these barriers. The combination of high speed, multimodality, and reduced costs enables businesses to integrate AI into voice interfaces, interactive support systems, and next-generation multimedia applications.
