OpenAI has launched the OpenAI Pioneers Program to develop industry-specific AI benchmarks and fine-tuned models, addressing the lack of unified benchmarks for AI model performance in various sectors.
The program aims to advance AI model development for specific industries and real-world use cases through a two-pronged effort. Companies will collaborate with OpenAI researchers to develop more domain-specific evaluations and fine-tuned models. OpenAI noted that industries like legal, finance, insurance, healthcare, accounting, and many others are missing a unified source of truth for model benchmarking. As a result, OpenAI will work with multiple companies across each industry to develop those evaluations, which are aimed not only at developing models but also at building better trust between the public and these systems.
Research has highlighted the void of benchmarks as a major gap in AI for enterprise use cases. Silvio Savarese, head of Salesforce AI Research, released a blog post on Enterprise General Intelligence (EGI), a concept he is pioneering that refers to more advanced AI solutions tailored to businesses’ domain-specific needs. He shared that one of the major steps needed to reach EGI is benchmarks that look at evaluating domain-specific functions.
Beyond evaluations, OpenAI will also collaborate with the team to refine existing models for industry-specific use cases using a technique known as reinforcement fine-tuning (RFT). The OpenAI team will guide the companies on how to use RFT, and then the companies can decide how to deploy the models, which should be ready for large-scale deployment, according to OpenAI.
The first cohort will consist of a handful of startups working on use cases that can “drive real-world impact.” Companies can apply to the OpenAI Pioneers Program by filling out a form with basic information about the company on the OpenAI Pioneers Program webpage.
The program seeks to strengthen public trust in AI systems by developing more relevant and reliable benchmarks. By working with multiple companies across various industries, OpenAI aims to create a more robust and trustworthy AI ecosystem.
