News

Red Hat, Nvidia Launch Co-Engineered AI Factory Platform for Enterprise Deployments

Red Hat on Tuesday introduced the Red Hat AI Factory with NVIDIA, a co-engineered software platform that combines Red Hat AI Enterprise with NVIDIA AI Enterprise to help organizations deploy and operate AI systems at scale.

The companies said the offering is designed to support a shift among enterprises from pilot projects to production deployments, as more organizations try to run higher-density AI workloads and “agentic” applications that can increase demand for inference computing and associated infrastructure.

Red Hat, the enterprise software company best known for Red Hat Enterprise Linux and its open-source-based platforms for hybrid cloud, automation, and application development, said the platform is intended to give IT operations teams a single foundation to manage both conventional enterprise workloads and the additional layers of an AI stack. The company said it provides “Day 0” support for NVIDIA hardware architectures, referring to the availability of software support at the time new NVIDIA systems ship.

According to Red Hat, the platform is supported on AI infrastructure from systems vendors including Cisco, Dell Technologies, Lenovo, andSupermicro, and can be deployed on-premises, in the cloud, or at the edge.

Chris Wright, Red Hat’s chief technology officer, said in a blog post that enterprises are moving toward “industrial-scale” AI production that requires new approaches to managing compute infrastructure and software.

Red Hat said the platform includes capabilities for AI inference, model tuning and customization, and deployment and management of AI agents, with a focus on security. It also said customers can access pre-configured models delivered as NVIDIA NIM microservices, including the IBM Granite model family, as well as NVIDIA’s Nemotron and Cosmos open models. Red Hat added that model alignment and tuning can be performed using NVIDIA NeMo.

On performance, Red Hat said the platform integrates components such as vLLM, NVIDIA TensorRT-LLM, and NVIDIA Dynamo to help meet service-level objectives for inference workloads, and includes built-in observability features to improve utilization and lower the total cost of ownership.

The companies said the system also provides GPU resource pooling and orchestration features, including automatic checkpointing for longer-running jobs, and incorporates security features based on Red Hat Enterprise Linux. Red Hat said NVIDIA DOCA microservices can be used to add what it described as a zero-trust architecture and runtime security.

Red Hat said the Red Hat AI Factory with NVIDIA is available now.

About the Author

John K. Waters is the editor in chief of a number of Converge360.com sites, with a focus on high-end development, AI and future tech. He's been writing about cutting-edge technologies and culture of Silicon Valley for more than two decades, and he's written more than a dozen books. He also co-scripted the documentary film Silicon Valley: A 100 Year Renaissance, which aired on PBS.  He can be reached at [email protected].