The annual GTC 2024 conference, presented by Nvidia, served as a central hub for the exchange of groundbreaking ideas and advancements in the field of AI. VentureBeat’s editorial team was granted exclusive backstage access, allowing for in-depth interviews with key figures from influential companies like Microsoft, Dell, and Deloitte. The event highlighted the critical role of GPU-based data centers, or “AI factories,” and discussed the economic practicality of AI models for businesses of all sizes.
The Future of AI Factories
In an enlightening conversation with VentureBeat’s senior writer Sharon Goldman, industry experts from Nvidia and Deloitte, alongside Sustainable Metal Cloud representatives, delved into the evolution of AI factories. Rohit Tandon, general manager of AI at Deloitte, emphasized the significance of not only the GPU’s power but the comprehensive infrastructure supporting it. “It’s akin to possessing the finest engine and constructing the car around it, topped with a knowledgeable driver at the helm,” Tandon surmised.
Building a More Cost-Effective AI Infrastructure
Dean Takahashi, VentureBeat’s lead writer, engaged in a dialogue with Dan Diasio of Ernst and Young (EY) about the firm’s role in cultivating AI-powered businesses. They introduced the MIN framework, which stands for the Minimum Intelligence Necessary, arguing that not every company requires cutting-edge, and often expensive, AI models to achieve their objectives.
Microsoft’s Role in Shaping Gen AI
Microsoft’s Nidhi Chappell, general manager of Azure generative AI and HPC, reflected on the company’s key contributions to the gen AI market. Their ongoing partnership with OpenAI since 2019 and deep integration with Nvidia’s Azure OpenAI service, provide clients with the essential “building blocks” to deploy AI on any scale.
Run:ai and Accelerating AI Deployment
Run:ai’s Omri Geller, CEO and co-founder, noted the company’s middleware solution’s effectiveness in optimizing compute power usage when building AI models. Adobe, among others, utilized Run:ai to enhance their AI infrastructure, leading to quicker model deployment.
Simplifying AI Adoption with Dell AI Factory
Dell Technologies announced the Dell AI Factory in collaboration with Nvidia at GTC 2024, marking it as the industry’s first end-to-end AI enterprise solution aimed at streamlining and expediting AI adoption. The customizable solution set meets specific company needs, as explained by Dell’s SVP of product marketing, Varun Chhabra.
AI on the Far Edge with Lenovo
Lenovo’s significant investment in AI and partnership with Nvidia has positioned it as a leader in AI infrastructure. Lenovo’s ThinkEdge product line focuses on bringing AI to where data is generated, with practical applications in retail and urban planning.