OpenAI launches new tools to accelerate the development of AI voice assistants

OpenAI introduced a range of new tools on Tuesday aimed at streamlining the development of AI-powered applications, as it competes with major tech companies in the rapidly evolving generative AI landscape. 

The Microsoft-backed startup also announced the immediate release of a real-time tool, now available for testing, which enables developers to build AI voice applications using a unified set of instructions.

Previously, developers had to follow a multi-step process that involved transcribing audio, generating a response using a text-based model, and then utilizing a separate text-to-speech system.

OpenAI

A significant portion of OpenAI’s revenue is driven by businesses that leverage its services to develop their own AI applications, making the introduction of advanced features a crucial aspect of its value proposition.

Competition is intensifying as technology giants, including Alphabet Inc. (GOOGL), are integrating AI models that can analyze various types of information, such as video, audio, and text, across their operations.

During Tuesday’s rollout, OpenAI unveiled a fine-tuning tool for models post-training, enabling developers to enhance the responses generated by these models using both images and text.

OpenAI

This fine-tuning process can incorporate human feedback, allowing individuals to provide the model with examples of effective and ineffective responses based on its outputs.

According to OpenAI, employing images for model fine-tuning will strengthen their image comprehension abilities, facilitating applications like improved visual search and enhanced object detection for autonomous vehicles.