OpenAI said Thursday that its API will now include a number of new voice intelligence features designed to help developers create apps that can talk, transcribe, and translate conversations with users. The companyâs new GPTâRealtimeâ2 is another voice model, built to create a realistic vocal simulation that can converse with users. 5) this one is built with GPTâ5âclass reasoning that OpenAI says was created to deal with more complicated requests from users.
The company is also launching GPTâRealtimeâTranslate, which, just as it sounds, is designed to provide real-time translation services that âkeep paceâ with the user, conversationally. The feature includes more than 70 input languages (that is, the languages that it can comprehend) and 13 output languages (the languages it relays to the speaker). Finally, the company has also launched a new transcription capability, GPT-Realtime-Whisper, which gives users live speech-to-text capabilities that are captured as interactions occur.
âTogether, the models we are launching move real-time audio from simple call-and-response toward voice interfaces that can actually do work: listen, reason, translate, transcribe, and take action as a conversation unfolds,â the company said. Who will these updates be good for? Companies that want to expand customer service capabilities are an obvious target.
However, OpenAI also notes that its new features will assist with a wide array of areas, including education, media, events, and creator platforms, among others. As useful as these tools seem from an enterprise perspective, it also seems plausible that they could be misused. The company said it has built guardrails to stop its new features from being abused to create spam, fraud, or other forms of online abuse.
Certain triggers have been embedded in the system so that âconversations can be halted if they are detected as violating our harmful content guidelines,â OpenAI said. All of the new voice models are included in OpenAIâs Realtime API. Translate and Whisper are billed by the minute, while GPT-Realtime-2 is billed by token consumption.
