OpenAI recently revealed 4 new AI tools that are now accessible.

OpenAI revealed four additional functions of its developer-focused API at the DevDay conference in San Francisco, aiming to enhance accessibility and efficiency of AI-based products. The updates include improved customization, reduced costs, and advanced features in speech and computer vision technologies.

Model Compression

OpenAI’s new Model Distillation feature simplifies the optimization of smaller models like the GPT-4 mini by leveraging the output of larger models. The process, previously complex and multi-staged, can now be done more easily on the OpenAI platform. In a bid to promote its use, OpenAI is providing millions of free tokens until October’s end for developers to begin exploring distillation techniques.

Prompt caching refers to the process of storing prompts for later use.

OpenAI introduced Prompt Caching to help developers save money by enabling the reuse of prompts with lengthy prefixes without having to pay the full price each time. This feature is beneficial for applications utilizing AI models with precise and uniform directives. By identifying the same prefix within an hour, the cost of input is lowered by 50%, resulting in substantial savings for developers who frequently employ prompts.

Vision Optimization

Vision Fine-Tuning is a significant advancement that enables adjustments to be made to GPT-4 using both images and text, expanding its capabilities for visual search enhancements, object detection for autonomous vehicles, and medical image analysis. OpenAI has begun providing developers with complimentary tokens to evaluate the tool, with a charge per million tokens expected to be implemented starting in November.

API that operates instantly

The new Realtime API enables the development of applications that can engage in real-time conversations with users, processing audio instantly without transcription delays. This improves response quality by maintaining nuances like emphasis and accents, which is beneficial for quick interaction-based applications such as virtual assistants handling tasks like food orders or appointment bookings.

Throughway