AI microservices level up with Red Hat, Nvidia partnership – Business
Two artificial intelligence powerhouses, Red Hat Inc. and Nvidia Corp., are partnering together to better serve enterprise and business users with AI microservices.
“Everyone knows AI is going to play a critical role in their enterprise going forward,” said Steven Huels (pictured, right), vice president and general manager of the AI Business Unit at Red Hat. “The challenges they run into have to do with a lot of the tooling, the ease of integration, the deployment and consumption. And the partnership here is really targeted at accelerating that and mak[ing] it as easy to adopt as possible.”
Huels and Justin Boitano (left), vice president of enterprise AI at Nvidia, spoke with theCUBE’s Rob Strechay and Paul Gillin at Red Hat Summit, during an exclusive broadcast on theCUBE, SiliconANGLE Media’s livestreaming studio. They discussed Red Hat and Nvidia’s unique partnership and what users are looking for from AI providers. (* Disclosure below.)
Justin Boitano and Steven Huels talk about what enterprises want from AI providers.
Homing in on faster, individualized models and microservices
Red Hat is partnering with Nvidia to enable users to integrate Nvidia’s NIM microservices into models trained on Red Hat OpenShift AI. The goal is to shorten time-to-market for AI applications.
“Generative AI is no good if it’s not in production,” said Boitano. “What you want to do is figure out how to drive the accuracy up to get a business outcome going, get it into production, and then you can figure out how to shrink the models and cost-reduce it and make it more cost-effective.”
Nvidia looks to balance proprietary technology with open source, giving users the tools they need to run AI models tailored to the needs of their business. The focus for companies going forward will be on customized models, predicts Huels.
“We focus on our strength, which is giving the core components you’ll need in an AI management and system,” he said. “But then we rely on our partners to go deep in specific areas. We’re going to continue to see customers journey towards smaller models, more efficient models, targeted specific use cases.”
The AI space is increasingly competitive as companies look to capitalize on the generative AI boom. But with an emphasis on collaboration and innovation, Nvidia aims to stay on top.
“There’s a new industry being born through generative AI,” Boitano said. “We got to keep running faster. We got to work more with our partners to help customers achieve success quickly with generative AI, which is part of the reason for the work we do.”
Here’s the complete video interview, part of SiliconANGLE’s and theCUBE Research’s coverage of Red Hat Summit:
(* Disclosure: Nvidia Corp and Red Hat Inc. sponsored this segment . Neither Nvidia, Red Hat )